Evidence level: C
代数上 E 与 Δ 正交,所以 r 被消掉;但正交只是坐标变换的产物。真去测的时候,共同偏移这条轴根本不由「一起偏」生成,而由两人精度不同生成——投影出来的东西是假的。
一、那道代数恒等式是真的,但它什么都没证明
上一轮(#1407)推出一个漂亮的式子:判据的放宽倍数可写成 1+2E,其中 E 是两位判读者的共同偏移、Δ 是两人的偏离差。推导里有一句关键话:E 与 Δ 在代数上正交,所以两人的偏差和 r 在式子里消掉了,倍数只由 E 决定。这在数学上没错,但它只说明两件事能以这种坐标写下来,不代表这两个坐标在数据里能被分别看见。
所有把这些论文放在一起看的读者都会撞上同一个坑。医学统计早就区分系统差与随机差,也早知偏倚和患病率会一起把 kappa 压下去(PMID 7701145、PMID 8501467)。但区分的前提是两者的生成机制不同——这不是观测结论,是建模假设。假设成立,分解才有意义;不成立,分解出的两个数只是同一堆噪声的两种切法。本篇就是把这条假设拿去撞一遍。
二、把三种「一起偏」分别投到同一对坐标上
做法很直接:造一个已知真值的判读场景,两位判读者对同一批材料各自独立落档,再计算 E 与 Δ 的样本相关。真值设为无任何关联,那么测出来的相关全是伪的。四种机制分开注入,看哪一种真能把 E 和 Δ 搅在一起。
结果很干脆:共用的材料难度项(两人被同一批材料同时推移)无论强度从 0 加到 2.5,测出的相关一直在正负 0.015 以内,等于零。共同平移本身不生事。真正制造相关的只有两个东西:两人精度不等,噪声比 2 倍时有 0.455、3 倍时有 0.628;两人敏感度斜率不等,斜率比 2 倍时给 −0.241,符号稳定。换成可读的话:所谓「两人一起往同一边偏」,在数据里根本不是共同偏移起作用,是其中一人比另一人更不稳。
三、敏感度这项得靠共用难度才发作,单独注入等于零
上一条还藏着一个更细的结构。斜率不等单独注入、不给共用材料难度时,相关只有 −0.0013,测不出东西。把共用难度逐步加大,同样的斜率比 2.0 才依次走到 0.068、0.145、0.163、0.123——先涨后落。斜率不等是交互项,要借共同难度这个载体才显形。
这一条把 backlog 原来的假设整个翻过来。原来担心「共同难度让两人一起偏,于是 E 与 Δ 混在一起」;实测是共同难度单独完全不生事,它是斜率不等与精度不等这两个真凶的放大器。而斜率比从 1 到 2,相关从 0 走到 −0.482,符号还相反,与精度不等正对着干。两个真凶在同一份数据里互抵,谁大谁说话。
四、按难度分层不是洗掉它,是把假的换成另一个假的
backlog 给的对策是按材料难度分层,层内重算,看相关是否消失。这条对策实测下来是加害者。
在共用难度很强(2.5)、斜率相等(真值应为零)的情形下,不分层的相关是 0.0037,几乎干净;按真实难度三分位分层后,层内平均变成 −0.004,还是干净。但只要斜率比 1.6,不分层只 0.094,分层后跳到 −0.325;斜率比 2.0 时从 0.128 跳到 −0.430。精度不等的情形同样:噪声比 2 倍,不分层 0.017,分层后 0.371;3 倍时从 0.021 跳到 0.432。
根子在分层这个动作本身。条件于共用难度之后,两人潜在读数仍只靠各自噪声分开,而把连续值切进档位这一步是非线性的,会把「同层内一人偏高必然另一人偏低」的互补关系放大成负相关。层内两读者原始档位的相关,从 0.200 一路掉到 0.033、0.133、0.221、0.326——分层剥掉的正是两人真正共有的部分,剩下的是切档放大的人工互补。分层把「共同难度造成的伪相关」换成了「切档非线性造成的伪相关」,而后者更大。
五、三档量表自己就有一个天花板,0.6 这条线根本到不了
backlog 给的判据是:相关绝对值小于 0.2 则两轴可分立;大于 0.6 则不可分、1+2E 只能做事后诊断。这两个数在真实的三档量表上都不可能实现。
把参数全扫一遍(噪声比 1 到 5、共用难度 0 到 3、斜率比 1 到 2),三档数据能达到的相关绝对值上限只有 0.391。原因在分辨率:档位越粗,E 与 Δ 的信息被压得越扁。二档能到 0.873,三档掉到 0.205,五档 0.612,十一档 0.705。所以「0.6 以上判不可分」对三档材料是永不可能触发的死条款,「0.2 以下判可分立」则会把真值 0.39 误判成可分立。
估计精度更麻烦。n=120 时单次相关的标准差 0.0785,真值为零也有约 1.5% 的实验读出超过 0.2;要看穿 0.2 这个量级,n=400 才把检出率做到 71.5%,n=800 才 97.2%。而 1+2E 这个修正项,n=120 时 90% 区间宽 0.250,比它要修正的量还大。
六、二十人时这条轴的性质变了,不能从两人情形外推
backlog 的实验设计是 20 位判读者。这个规模下 E 与 Δ 的定义要重写:E 变成二十人的平均偏移,Δ 变成二百一十对差值的平均。等精度等斜率时相关是 −0.003,干净。但只要一人斜率 1.6,相关变 0.070;十人精度差两倍,变 −0.244。方向与两人情形也不一致——两人时精度不等给正、二十人时给负。
所以两人情形的结论不能直接搬到多人设计上。而修正项的可估性在多人时略有改善,却仍不足:n=480 时 2E 的 90% 区间宽 0.133,n=1920 时才降到 0.067。要让修正项窄于它要修正的量,材料得过千例,这在针灸得气这类现场判读里不现实。
证据与局限
已验证: 共用加性难度项不产生 E 与 Δ 的相关,这是模拟里的稳定结论(五种强度全部落在 ±0.015 内),且有代数根据。精度不等与斜率不等确实产生非零相关,方向确定且随参数单调。三档量表的相关系数存在分辨率天花板(0.391),随档位增加而抬升,这是离散化的结构性质。按共同难度分层会诱导更大的伪相关,方向与幅度在两组参数下一致。
部分验证: 分层诱导伪相关的机制解释(条件化后切档放大互补)在模拟里方向明确,但没有在真实判读数据上验证过。二十人与两人情形的方向不一致只在三组参数下出现,样本不足以断言规律。1+2E 修正项的精度随例数改善的速度是按模型算的,真实判读的误差结构更复杂。
待验证: 真实判读材料里三种不对称的实际混合比例未知,本篇只能给出「哪种机制给多大相关」,给不出「实际数据里各占多少」。贴阈例子的占比是否真如假设那样影响结论,需要真实材料检验。斜率不等与精度不等在真人身上是否独立、还是一起变化,本篇当作独立注入,这一条没测。
相关阅读
证据等级: C
参考文献: PMID 7701145, PMID 8501467, PMID 26095449, PMID 30080056, PMID 25090041, PMID 33853549
L1 网络状态: 该主题尚未进入 L1 对应网络。最接近的边是 E-060 标签前提(五脏辨证作为分组标签|前提|标签信度),该边在 L1 中标为「冲突(未裁决)」,涉及 KB-292/KB-317/KB-333/KB-334 关于中医师间诊断一致性的争论;本篇讨论的「共同偏移与偏离差能否分别报告」属于该边的估计层前提,但 L1 中尚无对应条目(检索「共同偏移」「偏离差」「方差成分」「GLMM」「可辨识」均为 0 命中)。
免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。
When Two People Deviate Together, Their Deviations Differ: Who Is Taking the Blame for Whom? Three Distinct Things Are Simultaneously Impersonating This Shared Axis of Deviation.
Evidence level: C
Algebraically, E is orthogonal to Δ, so r is eliminated; yet orthogonality is merely a product of coordinate transformation. In true measurement, the axis of common offset does not arise from “drifting together,” but from differing precision between the two observers—the projected result is spurious.
I. That algebraic identity holds, but proves nothing
In the previous round (#1407), a neat formula was derived: the relaxation factor of the criterion can be written as 1+2E, where E represents the common offset shared by two readers and Δ denotes their deviation difference. A key statement in the derivation notes that E and Δ are algebraically orthogonal, causing the sum of deviations r to vanish from the equation, leaving the multiplier determined solely by E. This is mathematically correct, yet it only indicates that two quantities can be expressed in this coordinate system; it does not mean these coordinates can be separately observed in the data.
Readers who assemble all these papers will inevitably encounter the same pitfall. Medical statistics long ago distinguished systematic error from random error, and also knew that bias and prevalence jointly depress kappa (PMID 7701145, PMID 8501467). However, the premise of this distinction is that their generation mechanisms differ—this is not an observational conclusion but a modeling assumption. If the assumption holds, decomposition is meaningful; if not, the two decomposed numbers are merely two ways of slicing the same noise. This paper tests that assumption head-on.
II. Projecting three types of “drifting together” onto the same pair of coordinates
The approach is straightforward: construct a reading scenario with known truth values, have two independent readers classify the same batch of materials, then compute the sample correlation between E and Δ. If truth values are set to have no association, any measured correlation is entirely spurious. Each of the four mechanisms is injected separately to see which one truly mixes E and Δ.
The results are crisp: the shared difficulty component (both observers shifted by the same batch of materials) yields a correlation within ±0.015 regardless of intensity ranging from 0 to 2.5, effectively zero. Common translation itself generates no correlation. Only two factors create correlation: unequal precision between observers (with noise ratio 2, correlation is 0.455; with noise ratio 3, it is 0.628); unequal sensitivity slopes (with slope ratio 2, correlation is −0.241, with stable sign). In plain terms: the notion of “both drifting together in the same direction” does not reflect common offset acting in the data; rather, it reflects that one observer is less stable than the other.
III. Sensitivity requires shared difficulty to activate; injecting it alone yields zero
The previous section also conceals a finer structure. When slope inequality is injected alone without shared difficulty, correlation is only −0.0013, yielding no measurable effect. As shared difficulty increases stepwise, the same slope ratio of 2.0 sequentially produces correlations of 0.068, 0.145, 0.163, 0.123—rising then falling. Slope inequality acts as an interaction term; it becomes visible only through the carrier of shared difficulty.
This finding overturns the original backlog assumption entirely. Previously, concern focused on “shared difficulty causing both to drift together, thus mixing E and Δ.” In reality, shared difficulty alone does nothing; it amplifies the two true culprits: unequal slopes and unequal precision. Meanwhile, as slope ratio increases from 1 to 2, correlation moves from 0 to −0.482, with the sign opposite to that of unequal precision, directly opposing it. In the same dataset, the two culprits counteract each other; whichever is stronger dominates.
IV. Stratifying by difficulty does not wash it away—it replaces one falsehood with another
The countermeasure proposed in the backlog is to stratify by material difficulty, recalculate within each layer, and observe whether correlation disappears. In practice, this strategy proves harmful.
Under strong shared difficulty (2.5) and equal slopes (truth should be zero), the unstratified correlation is 0.0037, nearly clean; stratifying by true difficulty tertiles keeps the within-layer average at −0.004, still clean. However, with slope ratio 1.6, unstratified correlation is only 0.094, whereas stratification jumps it to −0.325; with slope ratio 2.0, it leaps from 0.128 to −0.430. The same pattern holds for unequal precision: with noise ratio 2, unstratified correlation is 0.017, stratified becomes 0.371; with noise ratio 3, it rises from 0.021 to 0.432.
The root lies in the stratification action itself. Conditional on shared difficulty, the two potential readings still separate only via their respective noise. Cutting continuous values into bins is nonlinear, amplifying the complementary relationship—”one higher within the same layer necessarily implies the other lower”—into negative correlation. The raw within-layer correlations of the two readers drop from 0.200 to 0.033, 0.133, 0.221, 0.326—stratification strips away precisely the part they truly share, leaving behind artificial complementarity magnified by binning. Stratification replaces “spurious correlation caused by shared difficulty” with “spurious correlation caused by nonlinear binning,” and the latter is larger.
V. The three-tier scale itself has a ceiling; the 0.6 threshold is never reached
The backlog criterion states: if absolute correlation < 0.2, the two axes can be separated; if > 0.6, they cannot—and 1+2E serves only as post-hoc diagnosis. These thresholds are unattainable on real three-tier scales.
Scanning all parameters (noise ratio 1–5, shared difficulty 0–3, slope ratio 1–2), the maximum absolute correlation achievable on three-tier data is only 0.391. The reason lies in resolution: coarser tiers compress the information of E and Δ more severely. Two-tier reaches 0.873, three-tier drops to 0.205, five-tier hits 0.612, eleven-tier achieves 0.705. Thus, “unseparable if >0.6” is a dead clause never triggered for three-tier materials; “separable if <0.2” would falsely classify true value 0.39 as separable.
Estimating precision is even more problematic. With n=120, the standard deviation of single correlation is 0.0785; even with true zero, about 1.5% of experimental readings exceed 0.2. To detect the 0.2 scale, n=400 yields 71.5% detection rate, n=800 reaches 97.2%. Meanwhile, the correction term 1+2E: with n=120, its 90% interval width is 0.250, larger than the quantity it aims to correct.
VI. With twenty observers, the nature of this axis changes; conclusions from two cannot be extrapolated
The backlog experimental design involves 20 readers. At this scale, the definitions of E and Δ must be rewritten: E becomes the average offset across twenty people, while Δ becomes the average of 210 pairwise differences. Under equal precision and equal slopes, correlation is −0.003, clean. But if one person has slope 1.6, correlation shifts to 0.070; with ten people having twice the precision difference, it becomes −0.244. The direction differs from the two-person case—unequal precision yields positive correlation for two, negative for twenty.
Thus, conclusions from the two-person scenario cannot be directly transferred to multi-person designs. While the estimability of the correction term improves slightly with more people, it remains insufficient: with n=480, the 90% interval width of 2E is 0.133; only at n=1920 does it drop to 0.067. To make the correction term narrower than the quantity it must correct, materials would need over a thousand cases—impractical in real-world reading tasks like acupuncture qi sensation.
Evidence and Limitations
Verified: Shared additive difficulty does not generate correlation between E and Δ, a stable conclusion from simulation (all five intensities fell within ±0.015), supported by algebraic reasoning. Unequal precision and unequal slopes indeed produce non-zero correlation, with determined direction and monotonic dependence on parameters. The correlation coefficient for three-tier scales has a resolution ceiling (0.391), rising with tier count, reflecting the structural nature of discretization. Stratifying by shared difficulty induces larger spurious correlation, with direction and magnitude consistent across both parameter sets.
Partially Verified: The mechanism explanation for stratification-induced spurious correlation (amplification of complementarity after conditioning and binning) is directionally clear in simulation but has not been validated on real reading data. The directional inconsistency between twenty-person and two-person cases appears only under three parameter sets, insufficient to establish a general rule. The precision improvement rate of the 1+2E correction term with sample size follows model calculation, while real reading error structures are more complex.
To Be Verified: The actual mixing ratios of the three asymmetries in real reading materials remain unknown; this paper can only indicate “which mechanism produces how much correlation,” not “what proportion each occupies in real data.” Whether threshold-proximate cases truly affect conclusions as assumed requires validation with real materials. Whether slope inequality and precision inequality operate independently or co-vary in humans has not been tested; this paper assumes independent injection.
Related Reading
- Invariance of epsilon and r: why the common offset ratio deserves separate reporting
- Memory lifts ICC, stability pulls it back
- Environment-Life Frequency Interface Research Pool
Evidence Level: C
References: PMID 7701145, PMID 8501467, PMID 26095449, PMID 30080056, PMID 25090041, PMID 33853549
L1 Network Status: This topic has not yet entered the L1 corresponding network. The closest edge is the E-060 label premise (organ differentiation as grouping label | premise | label reliability), which is marked as “Conflict (Unresolved)” in L1, involving debates among KB-292/KB-317/KB-333/KB-334 regarding diagnostic consistency among TCM practitioners; the issue of “whether common offset and deviation difference can be separately reported” discussed here belongs to the estimation layer of that edge, but no corresponding entry exists in L1 (searches for “common offset,” “deviation difference,” “variance component,” “GLMM,” “identifiable” all yield zero hits).
Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.
Leave a Reply