漂移和抽样误差不是两笔账,是同一笔数了两遍:那个相关系数不是 0.2,是 0.98

Written by

in

Language

Evidence level: C

把漂移当作独立误差去和抽样误差相加,等于把同一块方差记了两次账;真正被漏掉的那一项不是协方差,是合格率对漂移的凹性。

一、相加之前先问一句:这两项是两个东西吗

1405 把漂移地板 5.31 个百分点与 m̂ 的抽样误差按方差相加,n=60 得 6.01 个百分点。这个做法只有一个前提:两项独立。但这两项的来源根本分不开——漂移是判读者的位置在变,m̂ 是同一批判读者在变过位置的尺子上判出来的合格比例。漂移不是 m̂ 之外的另一股噪声,漂移就是 m̂ 的生成过程。 一个量怎么可能是自己生成过程的独立误差项。

二、一阶上不是「有点相关」,是几乎完全相关

把漂移 b 设成均值零、标准差 0.167 的正态扰动,m̂ 是按切点算出的合格率,两者的一阶相关可以直接积出来。实测:m=0.90 时是 0.9930,m=0.95 时是 0.9825,m=0.70 时是 0.9982。在全部条件上都超过 0.98。

换算成那条待验证项想量的比值更直观:2 倍协方差除以漂移方差,在 m=0.95、σ=0.167 时等于 18.30,而解析预言是 2 除以切点处的标准正态密度,即 19.39。不是「多加两成」,是那一项本身被放大了十八倍。 原设问的判据是「相关使合计方差比独立假设大百分之二十」,可这个量根本没停在百分之二十这个量级上。

三、所以那个 2Cov 不是修正项,是重复计入

到这里会想:那就把 2Cov 加进去。不行,加进去就错得更远。原因是全方差公式已经把两块算全了:

Var(m̂) 等于 E[m(1−m)/n] 加上 Var(m)。

前一项是「给定尺子位置、数 n 个人」的二项抖动,后一项是「尺子位置本身在变」的全部后果。两项相加即完整方差,没有第三项可加。所谓 2Cov,是把这个分解误当成「两个独立误差相加」才冒出来的影子项,它和 Var(m) 是同一块方差的两种写法。原设问的真正问题也在这里:它把符号问题(加还是减)当成了关键,而实际是记账单位问题——这笔方差只能记一次。

四、漏掉的那一项:合格率对漂移是凹的

真正的偏差在别处。二项项里那个 m(1−m) 不是常数,它随漂移变化,而且是凹函数,所以它的期望大于在均值处取值——这是詹森不等式。实测比值:σ=0.167、m=0.95 时是 1.0374,即二项项被抬高 3.7%;σ=0.515 时是 1.3018,抬高 30.2%,且这个比例不随 n 变。 后者意味着即使把 n 抬到无穷,二项项也只按三成折扣计入。加上地板一起算,σ=0.167 时 n=60 的有效样本量只剩名义的 41.5。

方向也值得记一笔:E[m] 本身被漂移单向压低。m=0.95、σ=0.515 时算出 0.92818,缺口 −2.18 个百分点,是 5.31 这个一阶项的 41.1%。漂移对判据线的真实作用不是让 m̂ 上下抖,而是把合格率的期望值单向拽下去。

五、两篇的口径其实对不上

还有一处不自洽要摊开。5.31 个百分点反解出的漂移标准差是 0.5149,是 #1404 用值 0.167 的 3.08 倍。同一个 0.167 标准差在不同切点上换算出的百分点差着 14.8 倍:m=0.50 时 6.66,m=0.95 时 1.72,m=0.99 时 0.45。漂移的百分点值不可跨研究移植,只报百分点的漂移量没有可比性。

后果落到地板上:按 5.31 反推的真地板是 6.97,不是 5.31。n=60 时真合计 7.67 对 6.01,低估 27.6%;n 抬到 2000 时真值仍有 6.99,那个 5.33 的收敛值本身就是错的。换回 0.167 那一档,要把标准误压到 2.00,#1405 式算出 n=119 就够,按真公式要 466——四倍差。

六、四条判据

一、记账单位:凡报漂移与抽样的合计误差,只许用全方差公式,禁写成「漂移方差 + 抽样方差 + 2Cov」。

二、设计效应必须并报:须报 k 等于 E[m(1−m)] 除以 m0(1−m0),并由 k 反算有效样本量;只报名义 n 者其精度不可用于设计。

三、漂移以标准差报:或同时报切点处的密度;只报百分点者禁作跨研究比较。

四、地板先行:先算漂移导致的地板,目标标准误低于地板者判不可达,不得以加样本作答。

证据与局限

已验证:全方差公式、一阶相关 0.98 以上、2Cov 与 Var(m) 之比约 18 倍、凹性比值 1.0374 与 1.3018、詹森缺口 41.1%、n=119 与 466 的对照——全部是解析式加数值积分,可复算到任意精度,不依赖实测数据。

部分验证:漂移取正态、判读取单切点阈值模型,这是最简设定;真实判读有多档、有读者特异成分,k 会偏离 1.30 这个数。

待验证:① 多档判读下 k 实际上界;② 漂移含读者特异成分时一阶相关掉到多少(共同模与差模混在一起时,m̂ 只吃共同模);③ 切点也随漂移移动时,凹性与一阶项是否互相抵消。

该主题尚未进入 L1 对应网络:研究内核的边表止于 E-061,网络正文第 202 行只有 E-060 标签前提这一条与一致性有关,且只裁决「标签信度低不低、训练能否改善」。全表检索漂移、协方差、方差成分、全方差、设计效应、凹性、詹森均无对应边。

L1 网络状态:无对应边(E-060 标签前提仅登记「一致性低」与「训练可改善」的对立,状态 conflict 未裁决;网络无「误差结构」「方差记账」「设计效应」任何节点)

相关阅读

证据等级: C
参考文献: PMID 8501467, PMID 2348207, PMID 15939215, PMID 26925540, PMID 23343209, PMID 29881127, PMID 34893998, PMID 31018678


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Drift and sampling error are not two separate accounts but the same number counted twice: that correlation coefficient is not 0.2, it is 0.98.

Evidence level: C

Treating drift as an independent error to be added to sampling error equals double-counting the same variance component; the term truly omitted is not the covariance, but the concavity of pass rate with respect to drift.

I. Before Adding, Ask: Are These Two Items Distinct Entities?

1405 sums the drift floor of 5.31 percentage points with the sampling error of m̂ (n=60) via variance addition to obtain 6.01 percentage points. This approach rests on a single prerequisite: independence between the two terms. Yet their origins cannot be disentangled—drift arises from shifts in the rater’s position, while m̂ is the pass rate measured on that same shifting scale. Drift is not an additional noise source outside m̂; drift constitutes the generative process of m̂ itself. How can a quantity be an independent error term of its own generative process?

II. At the First Order, It Is Not “Somewhat Correlated,” It Is Nearly Perfectly Correlated

Setting drift b as a normal perturbation with mean zero and standard deviation 0.167, and m̂ as the pass rate calculated at the cutpoint, their first-order correlation can be directly computed. Measured values: when m=0.90 the correlation is 0.9930; when m=0.95 it is 0.9825; when m=0.70 it is 0.9982. Under all conditions, the correlation exceeds 0.98.

Expressing this in terms of the ratio of the term to be verified becomes more intuitive: twice the covariance divided by the drift variance equals 18.30 when m=0.95 and σ=0.167, whereas the analytical prediction is 2 divided by the standard normal density at the cutpoint, yielding 19.39. It is not “adding two-tenths more”; that term itself is amplified eighteenfold. The original criterion asked whether “correlation increases the total variance by twenty percent,” but this quantity never reaches that order of magnitude.

III. Therefore That 2Cov Term Is Not a Correction; It Is a Double Counting

At this point one might think: then add 2Cov. No; adding it makes the error worse. The reason is that the full variance formula already accounts for both components:

Var(m̂) equals E[m(1−m)/n] plus Var(m).

The first term represents the binomial jitter given a fixed ruler position and counting n individuals; the second term captures all consequences of the ruler position itself shifting. Their sum constitutes the complete variance, leaving no third term to add. The so-called 2Cov is merely a shadow term arising from misinterpreting this decomposition as “two independent errors added together.” It and Var(m) are simply two expressions of the same variance component. The real issue in the original question lies here: it mistook the sign problem (plus or minus) for the critical factor, whereas the actual issue is one of accounting units—this variance can be counted only once.

IV. The Omitted Term: Pass Rate Is Concave with Respect to Drift

The true discrepancy lies elsewhere. Within the binomial term, m(1−m) is not constant; it varies with drift and forms a concave function, so its expectation exceeds the value at the mean—this is Jensen’s inequality. Measured ratios: when σ=0.167 and m=0.95 the ratio is 1.0374, meaning the binomial term is elevated by 3.7%; when σ=0.515 it becomes 1.3018, elevated by 30.2%, and this proportion does not vary with n. The latter implies that even if n is raised to infinity, the binomial term contributes only at a thirty percent discount. Including the floor together, when σ=0.167 and n=60, the effective sample size drops to only 41.5 of the nominal value.

The direction also warrants note: E[m] itself is unidirectionally depressed by drift. When m=0.95 and σ=0.515, the calculated value is 0.92818, leaving a gap of −2.18 percentage points, which equals 41.1% of the first-order term 5.31. The true effect of drift on the criterion line is not to make m̂ jitter up and down, but to unidirectionally pull the expected pass rate downward.

V. The Two Papers’ Calibers Are Inconsistent

One further inconsistency must be laid bare. The drift standard deviation reverse-engineered from 5.31 percentage points is 0.5149, which is 3.08 times the value of 0.167 used in #1404. The same standard deviation of 0.167 yields percentage differences varying by a factor of 14.8 across different cutpoints: 6.66 when m=0.50, 1.72 when m=0.95, and 0.45 when m=0.99. The percentage-point value of drift cannot be transferred across studies; reporting only percentage-point drift renders comparisons meaningless.

Consequences fall onto the floor: the true floor reverse-calculated from 5.31 is 6.97, not 5.31. When n=60, the true sum is 7.67 versus 6.01, underestimating by 27.6%; when n is raised to 2000, the true value remains 6.99, meaning that convergence value of 5.33 is itself wrong. Returning to the 0.167 tier, to suppress the standard error to 2.00, #1405’s formula yields n=119 as sufficient, whereas the true formula requires 466—a fourfold difference.

VI. Four Criteria

I. Accounting Units: When reporting the combined error of drift and sampling, use only the full variance formula; forbid writing “drift variance + sampling variance + 2Cov.”

II. Design Effect Must Be Reported: Report k equal to E[m(1−m)] divided by m0(1−m0), and derive the effective sample size from k; reporting only the nominal n renders the precision unusable for design.

III. Drift Reported as Standard Deviation: Or simultaneously report the density at the cutpoint; reporting only percentage points prohibits cross-study comparison.

IV. Floor First: Calculate the floor caused by drift first; if the target standard error is below the floor, deem it unachievable and do not answer by adding samples.

Evidence and Limitations

Verified: Full variance formula, first-order correlation above 0.98, ratio of 2Cov to Var(m) approximately 18 times, concavity ratios 1.0374 and 1.3018, Jensen gap 41.1%, comparison of n=119 and 466—all derived from analytical expressions plus numerical integration, reproducible to arbitrary precision without relying on empirical data.

Partially Verified: Drift modeled as normal, rater judgment using a single cutpoint threshold model—this is the simplest setup; real judgments involve multiple tiers and reader-specific components, causing k to deviate from 1.30.

Pending Verification: ① the actual upper bound of k under multi-tier judgment; ② how much the first-order correlation drops when drift contains reader-specific components (when common mode and difference mode mix, m̂ consumes only the common mode); ③ whether concavity and the first-order term cancel each other when cutpoints also shift with drift.

This topic has not yet entered the L1 corresponding network: the edge table of the research core stops at E-061; in the network body at line 202 there is only the E-060 label premise concerning consistency, and it merely adjudicates “whether label reliability is low and whether training can improve.” A full table search for drift, covariance, variance components, full variance, design effect, concavity, and Jensen yields no corresponding edges.

L1 Network Status: No corresponding edges (the E-060 label premise only registers the opposition between “low consistency” and “training can improve,” with the conflict state unresolved; the network lacks any nodes for “error structure,” “variance accounting,” or “design effect”)

Related Reading

Evidence Level: C
References: PMID 8501467, PMID 2348207, PMID 15939215, PMID 26925540, PMID 23343209, PMID 29881127, PMID 34893998, PMID 31018678


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *