Evidence level: C
上一篇把「δ 稳不稳」的判据画成「批次间标准差 ÷ 抽样地板」,并指出地板不在 1。这一篇要问的是更前一步:这个比值里的分子是「差值的标准差」,而标准差对「两个人一起偏」完全无感。所以它不是「稳不稳」的秤,只是一台「抖不抖」的尺。
正文
上一篇(#1410)把「δ 买不买得回来」压成了一个可算的比值:批次间 δ 的标准差 ÷ 含 ρ 的二项地板。地板是 √(2−2ρ) 而非 1,ρ=0 时 1.414,判据线画在 1.5,离地板只剩 6%。
这件事成立。但往下走会遇到一个从没被问过的问题:比值大于 1.5,到底证明了什么?
答案比想象的窄:它只证明「δ 在各批次之间抖得比抽样噪声大」。而「抖得大」和「偏得稳」是两件完全不同的事。
一、标准差对「一起偏」是瞎的
取两位读者的主档比例 p_A 与 p_B,δ = p_A − p_B。这里有个初等但致命的性质:δ 的标准差只与 p_A、p_B 的散布有关,与它们的共同水平无关。
若把 p_A 与 p_B 同时抬高同一个常数 c,δ 逐批不变,标准差一分不动。同理,若两位读者各带一个固定风格偏移 b_A、b_B——这正是「稳定成分」最直白的形态——δ 每批都是同一个常数,标准差恰好是零。
仿真直接照见这一点。在同一潜变量真值上,让两位读者各带固定门槛偏移(批批不变,这就是最纯粹的「稳定风格」),跑十二批次、每批一百二十例:δ 的批间标准差与完全没有偏移时几乎一模一样,差距在小数点后第二位。二十个百分点的真实系统偏,在分子里一个数字都没挪动。
不是「偏小」,是零敏感度。这也解释了 #1410 那张表里 τ 那一列的量级为何总小得可疑:它测的从来不是稳定偏移的大小,而是批次漂移的散度。
二、它真正在测的是「漂」不是「偏」
把两种形态并排跑,差别立刻摊开(sg=0.5、n=120、B=12,纯噪声基线 S=4.62pp、越 1.5 的概率 1.3%):
| 真实幅度 | 形态 | S(pp) | 越 1.5 的概率 | 符号一致率≥0.75 |
|---|---|---|---|---|
| 10 pp | 固定风格(不漂) | 4.78 | 1.3% | 53.0% |
| 10 pp | 批次漂移 | 6.51 | 30.2% | 9.8% |
| 20 pp | 固定风格(不漂) | 4.87 | 0.5% | 68.5% |
| 20 pp | 批次漂移 | 9.83 | 84.3% | 11.7% |
读到的是两条完全相反的曲线。二十个百分点的固定偏差,越线率只有 0.5%——比纯噪声的 1.3% 还低,因为恒定偏移把方差挤小了。同样的二十个百分点,若换成每批独立漂移,越线率飙到 84.3%。
所以这个比值是一台漂移探测器,而不是一台偏差探测器。 它对「两位读者一直差一格」这种最该被警惕的情形,灵敏度是零。
三、零分布的第 37 类缺口:差值的散布 vs 差值的位置
问题还不在灵敏度低,而在它的零分布与它想回答的问题根本不是同一个分布。
「δ 稳不稳」问的是:δ 的期望值是否偏离零、且偏离得足够一致。这是一个关于位置的问题,零假设是「δ 的均值等于 0」。而比值统计量用的是 δ 的散布,零假设是「δ 的方差等于抽样方差」。两个假设在数学上互相独立:δ 可以均值极大而方差极小(完全稳定的偏差,本判据判「可补偿」),也可以均值恰好为零而方差极大(纯随机漂移,本判据判「有稳定成分」)。
这是判据设计里最易被忽略的一类缺口——不是「估得准不准」,而是统计量瞄准的靶心与要回答的问题不是同一个。
补它不需新数据,只需换统计量:看 δ 的符号在批次间是否一致。同样十二批次,纯噪声下「符号一致率 ≥ 0.75」的误判率 9.5%;十个百分点固定偏差把它推到 53.0%,二十个百分点到 68.5%;而十个百分点批次漂移只有 9.8%、二十个百分点 11.7%。一升一不升,形态就分开了。
四、两个统计量必须并报
单独换成符号一致率也不够。它是离散的、样本效率低:十二批次时,二十个百分点固定偏差的命中率也只有 68.5%,还有三成漏掉。而比值统计量在漂移场景下确实更强(32% vs 12%)。
结论不是二选一,而是两者测的是不同的事,缺一就读不全:
- 比值大、符号乱 → 批次漂移主导,δ 每批往不同方向拉,期望抵消但每批都在锯天花板;
- 比值小、符号齐 → 固定风格偏移主导,δ 是个几乎不变的常数,这才对应 #1396 里「买不回来」的那一半;
- 比值大、符号齐 → 两者叠加,最坏情形,δ 既偏又抖;
- 比值小、符号乱 → 真噪声,可补偿。
只看比值,第二格会被误判成第一格之外的第一类——这正是「二十个百分点稳定偏移被判为可补偿」的现实版本。
五、这对「五脏标签」意味着什么
回到本组最关心的场景。用五脏辨证做分组标签时,两位医师之间的分歧有两种来源:一是诊断标准本身模糊,导致每批病人判得不一样(漂移);二是两位医师对「脾虚」的门槛本来就不在同一位置,且这个位置长期不变(固定风格)。
前者可以靠加批次、加样本平均掉,后者加多少批次都不动——正是 #1396 说的「买不回来」。而 #1410 的比值统计量只看得见前者。若某研究报了「比值 1.2,δ 可补偿」就收工,那个更顽固的固定偏移从头到尾没被称过。
文献侧处境相同。判读者漂移在观察评分领域被反复测到且量级惊人——四百五十八位教师的两年数据显示,漂移在最初几天极大并持续近两年,评分者非但没收敛到共同严厉度,彼此差异反而扩大(PMID 29795823)。而「固定偏移与批次漂移能否分开估」,多数 G 研究给出的答案悲观:设计上 occasion 常与 lesson 完全混淆,只能估交互项(PMID 32655177);临床评分中 rater 方差占 59%、occasion 仅 18%,但那是嵌套分解,不是独立识别(PMID 26925540)。
证据与局限
已验证(纯解析,可复算):δ 的批间标准差对两位读者的恒定共同偏移严格不敏感——这是标准差的定义直接给出的,不是经验发现。仿真数值(4.62 / 4.68 pp)与定义一致。
部分验证(仿真 + 文献方向一致):比值统计量在「固定偏差」与「批次漂移」两种形态下的判别力严重不对称(20pp 时 0.5% vs 84.3%),符号一致率则反向(68.5% vs 11.7%)。文献侧只有间接印证——漂移确实存在且量级大(PMID 29795823),rater 与 occasion 在常规设计中无法独立识别(PMID 32655177、PMID 26925540、PMID 25683899),但没有任何一篇直接比较过这两种统计量的判别力。
待验证:① 符号一致率在真实判读数据上的检验效能(本文只跑了潜变量仿真,未用实测数据);② 固定偏移与批次漂移在 8 位读者 × 12 批次的设计下能否被联合识别;③ 若固定偏移的绝对量级普遍大于漂移,则整条「加批次可补偿」的设计建议需要重估。
明确未做的事:本文没有推翻 #1410 的地板公式(√(2−2ρ) 的推导正确),也没有声称比值统计量无用——它是漂移探测器,只是被当成了偏差探测器用。原题预设的「ρ 与 τ 同源会把比值双向推向 1」,在仿真里只得到部分支持:阈值层漂移下 corr(ρ,τ) 呈强负相关(−0.97),概率层漂移下呈 −0.99,但这是「读者越精准、同一门槛漂移打出更大边际漂移」的放大率效应,与「同一个风格离散度的两种投影」不是一回事。
L1 网络状态:CORRESPONDENCE_NETWORK.md 全文 1274 行逐词检索,「kappa」0 次、「方差」0 次、「边际」0 次、「判读」0 次、「读者」0 次;「一致性」6 次、「信度」8 次全部落在 E-060 标签前提边,且该边状态为 conflict(未裁决)——KB-292(PMID 30383398)判中医师间诊断一致性「低」、作者称「令人担忧」,而 KB-317/334 指出该判断存在样本量单位错配(n≥50 指评定者 vs 120 指病例)与精度区间错配(「一致性 low」正落在加权系数精度最差区间)。EDGE_TABLE 概念最高止于生理概念,无一致性度量节点。该主题尚未进入 L1 对应网络。
相关阅读
证据等级: C
参考文献: PMID 29795823, PMID 25683899, PMID 34111197, PMID 11591433, PMID 16164474
免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。
That scale doesn’t measure stability at all; it only sees how scattered the difference is, so if both people drift together, it remains completely invisible.
Evidence level: C
In the previous post, the criterion for “δ stability” was rendered as the ratio of between-batch standard deviation to sampling floor, noting that this floor is not 1. This post asks the step prior: the numerator of this ratio is the “standard deviation of differences,” and standard deviation is completely insensitive to “both raters drifting together.” Thus, it is not a scale for “stability,” but merely a ruler for “jitter.”
Main Text
The previous post (#1410) compressed the question of “δ buyability” into a calculable ratio: between-batch δ standard deviation ÷ binomial floor containing ρ. The floor is √(2−2ρ) rather than 1; at ρ=0 it equals 1.414, the decision line is drawn at 1.5, leaving only 6% above the floor.
This holds. But proceeding further reveals an unanswered question: what does a ratio greater than 1.5 actually prove?
The answer is narrower than imagined: it proves only that “δ jitters between batches more than sampling noise.” “Jittering greatly” and “drifting steadily” are two entirely different matters.
I. Standard Deviation is Blind to “Shared Drift”
Take two readers’ main proportions p_A and p_B, with δ = p_A − p_B. Here lies an elementary yet fatal property: the standard deviation of δ depends only on the spread of p_A and p_B, not on their common level.
If both p_A and p_B are raised by the same constant c, δ remains unchanged batch-by-batch, and the standard deviation does not move. Similarly, if each reader carries a fixed style offset b_A, b_B—this is the most direct form of “stable component”—δ is a constant each batch, and the standard deviation is exactly zero.
Simulation confirms this. Given the same latent true values, let each reader carry a fixed threshold offset (unchanging across batches, representing pure “stable style”). Running twelve batches of 120 cases each: the between-batch standard deviation of δ is almost identical to the case with no offset, differing only in the second decimal place. Twenty percent of true systematic bias moves not a single digit in the numerator.
It is not “less sensitive,” but zero sensitivity. This explains why the τ column in #1410’s table always appears suspiciously small: it never measures the magnitude of stable offset, but rather the divergence of batch drift.
II. It Actually Measures “Drift,” Not “Bias”
Running both forms side-by-side immediately reveals the difference (sg=0.5, n=120, B=12, pure noise baseline S=4.62pp, probability of exceeding 1.5 is 1.3%):
| True Magnitude | Form | S (pp) | Prob > 1.5 | Symbol Agreement ≥0.75 |
|---|---|---|---|---|
| 10 pp | Fixed style (no drift) | 4.78 | 1.3% | 53.0% |
| 10 pp | Batch drift | 6.51 | 30.2% | 9.8% |
| 20 pp | Fixed style (no drift) | 4.87 | 0.5% | 68.5% |
| 20 pp | Batch drift | 9.83 | 84.3% | 11.7% |
The results trace two completely opposite curves. Twenty percent of fixed bias yields an exceedance rate of only 0.5%—even lower than pure noise at 1.3%, because constant offset compresses the variance. The same twenty percent, if converted to independent batch drift, pushes the exceedance rate up to 84.3%.
Thus this ratio is a drift detector, not a bias detector. Its sensitivity to “two readers consistently differing by one unit”—the scenario most worthy of vigilance—is zero.
III. The 37th Gap in the Zero Distribution: Spread of Differences vs. Position of Differences
The problem is not merely low sensitivity, but that its zero distribution is fundamentally different from the distribution it aims to answer.
“Is δ stable?” asks whether the expected value of δ deviates from zero and does so consistently. This is a question about position; the null hypothesis is “the mean of δ equals zero.” Yet the ratio statistic uses the spread of δ, with the null hypothesis being “the variance of δ equals the sampling variance.” These two hypotheses are mathematically independent: δ can have a large mean and tiny variance (completely stable bias, which this criterion would deem “compensatable”), or it can have a mean exactly zero and large variance (pure random drift, which this criterion would deem “having stable components”).
This is the most overlooked gap in criterion design—not “how accurately it estimates,” but that the target of the statistic does not match the question to be answered.
Fixing it requires no new data, only changing the statistic: examine whether the sign of δ remains consistent across batches. With twelve batches, under pure noise, the misclassification rate for “symbol agreement ≥ 0.75” is 9.5%; ten percent fixed bias pushes it to 53.0%, twenty percent to 68.5%; while ten percent batch drift yields only 9.8%, twenty percent 11.7%. One rises, the other does not; the forms separate clearly.
IV. Both Statistics Must Be Reported
Switching solely to symbol agreement is insufficient. It is discrete and sample-inefficient: with twelve batches, twenty percent of fixed bias achieves a hit rate of only 68.5%, missing thirty percent. Meanwhile, the ratio statistic is indeed stronger under drift scenarios (32% vs 12%).
The conclusion is not a choice between two, but that they measure different things, and lacking one leaves the picture incomplete:
- Ratio high, symbols scattered → batch drift dominates; δ is pulled in different directions each batch, expectations cancel but each batch saws the ceiling;
- Ratio low, symbols aligned → fixed style offset dominates; δ is nearly constant, corresponding to the “unbuyable” half mentioned in #1396;
- Ratio high, symbols aligned → both combined, worst-case scenario; δ is both biased and jittery;
- Ratio low, symbols scattered → true noise, compensatable.
Looking only at the ratio misclassifies the second cell as the first type outside the second—precisely the real-world version of “twenty percent stable offset deemed compensatable.”
V. What This Means for the “Five-Organ Labels”
Returning to the most relevant scenario in this group. When grouping labels via five-organ differentiation, discrepancies between two physicians arise from two sources: either the diagnostic criteria themselves are vague, causing inconsistent patient classification across batches (drift); or the two physicians have fundamentally different thresholds for “spleen deficiency” that remain unchanged over time (fixed style).
The former can be averaged out by adding batches and samples; the latter remains unchanged regardless of how many batches are added—exactly what #1396 calls “unbuyable.” Meanwhile, the ratio statistic in #1410 only detects the former. If a study reports “ratio 1.2, δ compensatable” and stops there, the more stubborn fixed offset goes entirely unmentioned.
The literature faces the same situation. Drift in raters has been repeatedly observed and found to be of remarkable magnitude in the observation-rating domain—data from 458 teachers over two years shows drift is extreme initially and persists for nearly two years, with raters not only failing to converge on common severity but their differences actually expand (PMID 29795823). Whether “fixed offset and batch drift can be separately estimated,” most G studies give a pessimistic answer: by design, occasion often completely confounds with lesson, allowing only interaction terms to be estimated (PMID 32655177); in clinical ratings, rater variance accounts for 59%, occasion only 18%, but that is nested decomposition, not independent identification (PMID 26925540).
Evidence and Limitations
Verified (purely analytical, reproducible): the between-batch standard deviation of δ is strictly insensitive to constant shared offset between two readers—this follows directly from the definition of standard deviation, not empirical discovery. Simulation values (4.62 / 4.68 pp) align with the definition.
Partially Verified (simulation + literature direction consistent): the discriminative power of the ratio statistic is severely asymmetric between “fixed bias” and “batch drift” forms (0.5% vs 84.3% at 20pp), while symbol agreement reverses (68.5% vs 11.7%). The literature offers only indirect corroboration—drift indeed exists and is of large magnitude (PMID 29795823), and rater and occasion cannot be independently identified in conventional designs (PMID 32655177, PMID 26925540, PMID 25683899), but no study has directly compared the discriminative power of these two statistics.
Pending Verification: ① the statistical power of symbol agreement on real judgment data (this paper ran only latent variable simulations, not actual measured data); ② whether fixed offset and batch drift can be jointly identified under an 8 readers × 12 batches design; ③ if the absolute magnitude of fixed offset is generally larger than drift, the design recommendation of “adding batches compensates” needs reevaluation.
Explicitly Not Done: This paper does not overturn the floor formula in #1410 (the derivation of √(2−2ρ) is correct), nor does it claim the ratio statistic is useless—it is a drift detector, merely misused as a bias detector. The original premise that “ρ and τ share the same source, pushing the ratio bidirectionally toward 1” receives only partial support in simulation: under threshold-layer drift, corr(ρ,τ) shows strong negative correlation (−0.97), under probability-layer drift −0.99, but this is an amplification effect of “the more precise the reader, the larger the marginal drift from the same threshold,” not the same as “two projections of the same style dispersion.”
L1 Network Status: Full text search of CORRESPONDENCE_NETWORK.md (1274 lines) yields zero occurrences of “kappa,” “variance,” “marginal,” “judgment,” or “rater”; “consistency” (6 times) and “reliability” (8 times) all fall under the E-060 label premise edge, which is in state conflict (unresolved)—KB-292 (PMID 30383398) judges inter-physician diagnostic consistency as “low,” with authors calling it “concerning,” while KB-317/334 indicates this judgment suffers from sample unit mismatch (n≥50 refers to raters vs 120 cases) and precision interval mismatch (“consistency low” falls precisely in the worst-precision weighted coefficient region). The EDGE_TABLE concept extends only to physiological concepts, with no consistency measurement node. This topic has not yet entered the L1 corresponding network.
Related Reading
- The ruler used to divide “buyable / unbuyable” has its zero mark not at 1
- The half of δ that cannot be bought back, the half of ρ that can
- The σ qualified zone and the δ detection ceiling
- Resonance consciousness field: evidence basis for judgment consistency
Evidence Level: C
References: PMID 29795823, PMID 25683899, PMID 34111197, PMID 11591433, PMID 16164474
Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.
Leave a Reply