Evidence level: C
上一轮说「这个决定一切的比例 π 从未被估过」。它确实没被当成 π 估过——但它的数值每篇一致性研究的表一里都写着,因为它就是 1 减去原始一致率。
一、先把那个「从没被估过」的量摊开看
上一轮(#1397)把「该不该给判读差值打折」压在一个叫 π 的占比上:被判读的两份结果里真有差的比例。它给了张曲面,ρ=0.5 时门槛 0.178、ρ=0.9 时 0.054,并自我批评:这个 π 在任何真实研究里都没被估过,是整条推理里唯一没有数据支撑的量。
这个自我批评很诚实,但只走了一半——它没问这个量在定义上能不能被估。
判读差 Δ 是连续量(两个 kappa 之差)。若 π 定义为「Δ 不等于零的比例」,那么 Δ 恰好等于零的概率精确为 0——是测度论的必然。于是 π 恒等于 1,整张曲面退化成左端一个点,所有判决都变成「该打折」。
那么实际在用的 0.25 和 0.5 是什么?是设定,不是估计。原文写「退一步取 π=0.5」「取 π=0.25(偏保守的合理值)」——语气是估计,实质是设定。
二、降一个层次,π 立刻变成大家都报过的数
把层次从「两项研究」降到「一对判读」,π 就有了实体:同一批病例上两位读者给出档位不同的比例。它有更常见的名字——1 减去原始一致率(Po)。
这是恒等式,不是近似:π = P(档位差 ≠ 0) = 1 − Po。
于是「π 从未被估过」在事实层面不成立。每篇一致性研究的表一都写着 Po,因为它是 kappa 公式的分子项。它不缺数据,只是没被单独命名。
这也解释了那个奇怪现象:为什么 π 取 0.25 还是 0.5,结论几乎不变。因为 π 的真实值由 Po 决定,而 Po 在各研究里落在 0.60 到 0.85,即 π 落在 0.15 到 0.40。门槛 0.054 和 0.178 都落在此区间下方——判决对 π 的不精确几乎免疫。
三、这个免疫不是巧合,是结构性的
| Po | 对应 kappa | π = 1−Po | 门槛 π* | π 是否过门槛 |
|---|---|---|---|---|
| 0.90 | 0.847 | 0.100 | 0.178 | 不过 |
| 0.85 | 0.771 | 0.150 | 0.178 | 不过 |
| 0.80 | 0.695 | 0.200 | 0.178 | 过 |
| 0.70 | 0.542 | 0.300 | 0.178 | 过 |
| 0.60 | 0.389 | 0.400 | 0.178 | 过 |
| 0.55 | 0.313 | 0.450 | 0.178 | 过 |
看走向:Po 越高,kappa 越高,而 π 越低。π 与判读质量是同一根轴上的两个刻度,方向相反。判读可靠时分歧罕见,本来就没什么可打的;判读不可靠时分歧普遍,打折一定划算。
所以上一轮的两道前置判据其实是同一道:一道用 kappa 之差算比值 z 须落在 0.7 到 2.5,另一道要求 π 超过门槛。前者测「真差够不够大」,后者测「分歧够不够多」,而这两件事由同一个可靠性参数决定。它们是同一扇门的两把锁,锁的是同一根闩。
因此真正没被报告的不是 π,而是从一致率走到 kappa 的中间量:边际分布。同样 Po=0.80,边际均衡时 kappa 约 0.70,极端偏斜时可低到 0.33。
四、证据与局限
已验证:① 恒等式 π = 1 − Po 成立,「该量从未被估」在定义层面不成立;② 上一轮的 π* 曲面可由收益与假阳性代价复现(ρ=0.5 时 4.44/(4.44+20.57)=0.1775;ρ=0.9 时 5.00/(5.00+88.42)=0.0535,与原文一致);③ 判决翻转发生在 Po 高于约 0.82(kappa 约 0.73)处,而实际研究 kappa 中位远低于此,故常见域内判决对 π 免疫;④ kappa 悖论(高 Po 配低 kappa)根源是边际分布而非抽样。
部分验证:① 上表用三档均等边际作简化,真实边际偏斜时曲线整体平移但方向不变;② 「实际 kappa 中位」依赖样本量调查的 71 例中位,该调查未统计 kappa 分布,属间接推断;③ 两道判据同源的论证用可靠性参数作代理,delta 与 ρ 的相关结构未被直接测过。
待验证:① 若把 π 定为「|Δ| 超过某等效界 c 的比例」而非「Δ 不为零」,π 就变成 c 的函数,须先定 c,而 c 取多少无任何规范给出——这是新识别的问题;② 两道判据在临界带(Po 约 0.78 到 0.82)可能给出不一致判决,该段未刻画。
L1 网络状态:EDGE_TABLE 共 47 个概念(频率、HRV、心率、呼吸、自主神经、共振、谐波、五行、五脏等),无「先验概率 / 真差比例 / 原始一致率 / 边际分布」任何条目;CORRESPONDENCE_NETWORK 两轮检索(判读/一致性/信度/混合/成分/真值/先验/比例/金标准)仅命中 §3.8 与 §3.9「E-060 标签前提」条:「中医医师间诊断一致性在开放人群中『低(low)』,作者称为『令人担忧』(PMID 30383398);同系列第二篇指出偶然校正一致性统计常被误用、建议 Gwet AC2(PMID 31730403 / 31634000 / 31730404);但训练可改善(PMID 19538100)」——该边状态为 conflict(未裁决)。本文讨论对象(先验参数是否内生、Po 是否等于 1−π)与该边争议不重叠:那条争的是「标签准不准」,本文问「参数是否独立」。故本文不构成对 E-060 的新证据,亦不改判其状态。
五、这条线该怎么收
一句话:不是补一个 π 的估计,是取消 π 这个参数。
第一,凡引用「打折门槛 π*」处,一律同时报 Po。 π=1−Po,报 Po 就等于报了 π,且每篇都有。禁止报 kappa 却不提 Po。
第二,把「π 是先验」这说法从规范里删掉。 决策曲线框架说阈值概率该由情境给出,指的是收益与代价的交换率,不是真差比例。后者是内生的,由同一批数据的可靠性决定。把内生量写进「需外部给值」栏,就永远觉得缺数据。
第三,真正该补的报告项是边际分布。 Po 到 kappa 的映射需要它,而它正是一致性研究最常省的那一栏。这跟前几轮汇合:κ 的上限只由熵与总变差距离决定,而这两者本就是边际的两种写法。
相关阅读
证据等级: C
参考文献: PMID 8621993, PMID 2348207, PMID 25168681, PMID 8501467, PMID 15733050, PMID 17099194, PMID 26810254, PMID 36123642, PMID 30383398, PMID 31730403
免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。
That \”prior never estimated before\” is simply the raw consistency rate in Table 1 of every paper: treating endogenous variables as exogenous inputs makes it seem perpetually dat…
Evidence level: C
In the previous iteration, it was stated that “the proportion π determining everything has never been estimated.” Indeed, it was not estimated as π—but its numerical value is explicitly written in Table One of every agreement study, because it equals 1 minus the raw agreement rate.
I. First, Lay Out That “Never-Estimated” Quantity
The previous iteration (#1397) placed the question of “whether to discount the judgment difference” on a proportion called π: the fraction of judged pairs that truly differ. It provided a surface where, at ρ=0.5, the threshold is 0.178 and at ρ=0.9 it is 0.054, while self-critiquing: this π has never been estimated in any real study and is the only quantity in the entire reasoning chain lacking data support.
This self-critique is honest but only half-complete—it did not ask whether this quantity can be estimated by definition.
The judgment difference Δ is a continuous measure (the difference between two kappa values). If π is defined as “the proportion where Δ ≠ 0”, then the probability that Δ exactly equals zero is precisely 0—this is a necessity of measure theory. Thus π is always equal to 1, and the entire surface degenerates into a single point on the left end; all judgments become “should be discounted.”
So what are the actual values of 0.25 and 0.5 used in practice? They are assumptions, not estimates. The original text states “taking π=0.5 as a step back” and “taking π=0.25 (a conservative reasonable value)”—the tone suggests estimation, but the substance is specification.
II. Drop One Level, and π Immediately Becomes a Number Everyone Has Reported
By reducing the level from “two studies” to “one pair of judgments,” π acquires substance: the proportion where two readers give different grades on the same set of cases. It has a more common name—1 minus the raw agreement rate (Po).
This is an identity, not an approximation: π = P(grade difference ≠ 0) = 1 − Po.
Thus “π has never been estimated” is factually incorrect. Every Table One in every agreement study lists Po, because it is the numerator term of the kappa formula. It does not lack data; it was simply not named separately.
This also explains that strange phenomenon: why π=0.25 or π=0.5 yields almost identical conclusions. Because the true value of π is determined by Po, and Po across studies ranges from 0.60 to 0.85, meaning π ranges from 0.15 to 0.40. The thresholds 0.054 and 0.178 both fall below this interval—judgments are nearly immune to imprecision in π.
III. This Immunity Is Not a Coincidence; It Is Structural
| Po | Corresponding kappa | π = 1−Po | Threshold π* | Does π exceed threshold? |
|---|---|---|---|---|
| 0.90 | 0.847 | 0.100 | 0.178 | No |
| 0.85 | 0.771 | 0.150 | 0.178 | No |
| 0.80 | 0.695 | 0.200 | 0.178 | Yes |
| 0.70 | 0.542 | 0.300 | 0.178 | Yes |
| 0.60 | 0.389 | 0.400 | 0.178 | Yes |
| 0.55 | 0.313 | 0.450 | 0.178 | Yes |
Observe the trend: as Po increases, kappa increases, and π decreases. π and judgment quality are two marks on the same axis, moving in opposite directions. When judgments are reliable, disagreements are rare, so there is little to discount; when judgments are unreliable, disagreements are common, so discounting is certainly worthwhile.
Thus the two preconditions from the previous iteration were actually one and the same: one uses the kappa difference ratio z to fall between 0.7 and 2.5, while the other requires π to exceed the threshold. The former measures “whether the true difference is large enough,” and the latter measures “whether disagreements are frequent enough,” but both are governed by the same reliability parameter. They are two keys to the same door, locking the same latch.
Therefore what was never reported is not π, but the intermediate quantity between agreement rate and kappa: the marginal distribution. With Po=0.80, the marginal equilibrium yields kappa ≈ 0.70, but under extreme skew it can drop as low as 0.33.
IV. Evidence and Limitations
Verified: ① The identity π = 1 − Po holds, so “this quantity was never estimated” is false by definition; ② The previous π* surface can be reproduced from benefit and false-positive cost (ρ=0.5 gives 4.44/(4.44+20.57)=0.1775; ρ=0.9 gives 5.00/(5.00+88.42)=0.0535, matching the original text); ③ Judgment reversal occurs when Po exceeds approximately 0.82 (kappa ≈ 0.73), while actual study kappa medians are far lower, so common-domain judgments are immune to π; ④ The kappa paradox (high Po paired with low kappa) stems from marginal distribution, not sampling.
Partially Verified: ① The table above uses three equal marginal bins as simplification; under true marginal skew, the curve shifts overall but maintains direction; ② “Actual kappa median” depends on the 71-case median from sample size survey, which did not estimate kappa distribution, making this an indirect inference; ③ The argument that both criteria share origin uses reliability parameter as proxy, but the correlation structure between delta and ρ was not directly measured.
To Be Verified: ① If π is defined as “the proportion where |Δ| exceeds some equivalent boundary c” rather than “Δ ≠ 0”, then π becomes a function of c, requiring c to be set first, yet no norm specifies how much c should be—this is a new identification problem; ② In the critical band (Po approximately 0.78 to 0.82), the two criteria may yield inconsistent judgments, a region not characterized.
L1 Network Status: EDGE_TABLE contains 47 concepts (frequency, HRV, heart rate, respiration, autonomic, resonance, harmonic, Five Phases, five organs, etc.), with no entries for “prior probability / true difference proportion / raw agreement rate / marginal distribution”; CORRESPONDENCE_NETWORK two-round retrieval (judgment/agreement/reliability/mixed/component/true value/prior/proportion/gold standard) only hit §3.8 and §3.9 “E-060 label premise” entries: “Diagnostic agreement among TCM physicians in the open population is ‘low (low)’, termed ‘concerning’ (PMID 30383398); the second paper in the series notes that chance-corrected agreement statistics are often misused, recommending Gwet AC2 (PMID 31730403 / 31634000 / 31730404); but training can improve (PMID 19538100)”—this edge status is conflict (unresolved). The subject of this discussion (whether the prior parameter is endogenous, whether Po equals 1−π) does not overlap with this edge controversy: that dispute concerns “are the labels accurate,” while this paper asks “are the parameters independent.” Hence this paper does not constitute new evidence for E-060, nor does it change its status.
V. How This Line Should Be Closed
In one sentence: not to add an estimate of π, but to eliminate the parameter π itself.
First, wherever “discount threshold π*” is cited, always report Po simultaneously. Since π=1−Po, reporting Po equals reporting π, and every study has it. Do not report kappa without mentioning Po.
Second, remove the claim “π is a prior” from the framework. The decision curve framework states that threshold probability should be given by context, referring to the exchange rate of benefit and cost, not the true difference proportion. The latter is endogenous, determined by the reliability of the same data. Writing an endogenous quantity into “needs external assignment” makes it appear perpetually data-deficient.
Third, the truly missing report item is the marginal distribution. The mapping from Po to kappa requires it, and this is precisely the column most often omitted in agreement studies. This converges with earlier iterations: the upper limit of κ is determined solely by entropy and total variation distance, both of which are simply different expressions of the marginal.
Related Reading
- That “ρ Redline” Was Actually Drawn on the Wrong Variable
- p_e Is Not the Second Parameter at All; It Is the Shadow of Heterogeneity
- “m≥0.95 Judged Safe” Was Drawn Using an Estimated Number
- Resonance Consciousness Field Research Pool
Evidence Level: C
References: PMID 8621993, PMID 2348207, PMID 25168681, PMID 8501467, PMID 15733050, PMID 17099194, PMID 26810254, PMID 36123642, PMID 30383398, PMID 31730403
Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.
Leave a Reply