AC1 减 κ 那个差根本不携带边际差的信息:它对边际差的偏导恒为零,而归零点压在表格边线上

Written by

in

Language

Evidence level: C

两位读者分档边际差多少,不可能从 Gwet 的 AC1 与 Cohen 的 κ 之差里反解出来——因为 AC1 的期望一致率只含两边际的平均、不含它们的差,所以那个”差”全程只有 κ 一侧在动。

上一轮留下一条诱人的路:两位读者各自的分档边际差了多少,可以从 Gwet 的 AC1 与 Cohen 的 κ 之差里反解出来。理由听上去很硬——这两个系数对边际差的敏感程度不同,κ 的期望一致率里含两个边际的乘积,差多少会直接改它;AC1 的期望一致率只用两者的平均。一相减,剩下的就该是边际差。上一轮还算出这个差在均值接近 0.43、边际差接近 19.8pp 时归零,据此判定指纹在最需要它的地方失明。方向对,理由不是它给的那个。

先把 AC1 拆开。分子是观察一致率,是数据;分母里的期望一致率等于两倍均值乘一减均值——均值只管和,不管差。这意味着两位读者一个偏阳性、一个偏阴性,只要平均不变,AC1 一个数都不动。数值上钉死:均值 0.43、观察一致率 0.80 固定,边际差取 1pp、5pp、10pp、15pp 四档,AC1 全部等于 0.6076892899,小数点后十位完全一致;同一组四档下 κ 从 0.592045 走到 0.601157。对边际差求偏导,AC1 与 Scott 的 π 都是精确的零,κ 在 0.025 到 0.140 之间。

这件事的性质得说清楚:不是差太小读不出来,是 AC1 这个量在定义上根本不含边际差。所谓”两系数之差携带边际差信息”,其实是 κ 那一半在单向运动,AC1 只是被减数位置上的一个常数。上一轮看到的”归零”,本质是一条只含 κ 的曲线穿过一条水平线。

接着是更硬的一击。原题把一致率 0.85 上下、边际差 14 到 20pp 当成”判读研究最常见的量级”,这个组合在二乘二表上不存在。四格概率非负给出一条精确约束:左下格等于一减观察一致率再减边际差的一半,必须非负,于是边际差不超过一减观察一致率,与均值无关。观察一致率 0.85 时边际差最大 15pp,0.90 时只有 10pp。二十万张随机表逐张核对,违反零张。换言之”高一致率”和”大边际差”是两个互相排斥的处境:真的差到 20pp,一致率就不可能高过 0.80。

归零点于是不再神秘。AC1 与 κ 归零的条件是边际差等于根号二乘二的均值减一的绝对值,均值 0.43 时正是 19.80pp,而它落在可行域内的前提是观察一致率不超过 0.802——此时左下格恰好等于零。所以那条线不是藏在参数空间深处的陷阱,它压在单纯形的一条边上。一致率一旦高过 0.802,这条线就出了可行域,差恒为正、永不归零。上一轮把”归零”当成普遍威胁,实际只在表格退化到边界时才发生。

真正的救法不在差值,在两个水平值本身。边际均值只由 AC1 与观察一致率决定,解一元二次即得,闭式解是均值等于一减根号下一减二倍期望一致率再除以二;拿到均值后,κ 的期望一致率反解出边际差,闭式解是根号下二倍的中括号,中括号里是三个含均值的项减去观察一致率与 κ 决定的项。在 1188 组随机参数上回代,最大误差 8.3×10⁻¹⁴——这不是近似,是恒等。

这条路的代价是精度,不是可解性。以均值 0.43、一致率 0.80、真边际差 6pp 做参数 bootstrap:样本量 60 时边际差的抽样标准差 4.68pp,200 时 3.01pp,400 时 2.24pp,800 时 1.56pp。要让 95% 区间半宽压到 3pp,大约需要八百例。作为对照,只用差值反解时同一批样本有 42% 到 61% 根本无解,且标准差始终卡在 4.1 到 4.8pp 不随样本量下降——因为差值本身丢掉了大部分信息。

这条结论不只是二分类的性质。多类别下 AC1 的期望一致率等于各档边际占比乘一减占比之和再除以档数减一,仍然只含边际、不含任何跨档配对结构;而加权 κ 的期望一致率含跨档权重与边际乘积之积,配对结构才从那里进来。所以”AC1 对边际差零响应”在多档判读里同样成立,且越是把判读压成二分类、越是把人往高一致率推,这条零响应就越彻底。

实践含义很直接:AC1 与 κ 并列报告是可以的,但两者之差不能当边际差的度量,只能当”κ 被边际结构惩罚了多少”的粗略指示。要边际差本身,报两档边际占比即可,成本为零。PMID 23627889 在九位精神科医师、六十七例人格障碍样本上报告 AC1 在所有条目上高于 κ(0.752 到 1.000 对 0 到 1.00),并把差异归因于患病率敏感性,正是这条零响应的临床痕迹;PMID 8501467 早年就要求偏差与患病率分报才能解读 κ;PMID 24338600 给出的按目标精度反解样本量,可直接用于上文那条”八百例换 3pp”的规划;PMID 36123642 抽样八十二项一致性研究,只有三成给了样本量依据,说明这条精度账在实务里基本没被算过。

证据与局限

已验证(数学恒等,非经验结论):AC1 的期望一致率等于两倍均值乘一减均值,只含边际之和、不含之差;对边际差求偏导精确为零,与均值、一致率取值无关。固定均值 0.43、观察一致率 0.80 时,边际差从 1pp 到 15pp 四档,AC1 恒为 0.6076892899。归零条件为边际差等于根号二乘二的均值减一的绝对值,其可达前提是观察一致率不超过 1 减该值。可行域约束”边际差不超过 1 减观察一致率”由四格概率非负直接推出,二十万张随机表零违反。两个水平值联立可闭式反解均值与边际差,1188 组随机参数回代最大误差 8.3×10⁻¹⁴。

部分验证:反解精度由参数 bootstrap 给出量级——真边际差 6pp 时,样本量 60/200/400/800 对应抽样标准差 4.68/3.01/2.24/1.56pp;该量级依赖”观察一致率已知且无系统误差”这一理想条件。作为对照,仅用差值反解在同批样本有 42% 到 61% 无解且标准差卡在 4.1 到 4.8pp 不随样本量下降。

待验证:真实判读研究的(均值,边际差,观察一致率)三元组分布尚未实测,本稿所有量级都建在参数网格上而非文献回填;”AC1 对边际差零响应”在多档加权场景下虽已由公式给出,但缺实测数据集核验档数增加时零响应是否仍精确;本文未讨论三人及以上评定者情形下 AC1 的期望一致率结构是否仍只含边际。

证据等级: C
参考文献: PMID 23627889, PMID 8501467, PMID 24338600, PMID 36123642, PMID 25090041, PMID 33853549

相关阅读

L1 网络状态:EDGE_TABLE_science-yixue.md 概念最高止于生理层(频率 407 篇/谐波 147 篇/脉象 73 篇),无统计一致性系数层条目;CORRESPONDENCE_NETWORK.md 中「AC1」命中 1 处、「Gwet」3 处、「Brennan」1 处,全部落在 E-060 标签前提(五脏辨证作分组标签|前提|标签信度,状态 conflict,未裁决);「可辨识」「识别性」「prevalence」「零分布」「系数对」命中均为 0。该主题尚未进入 L1 对应网络。


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

AC1 minus κ carries no information about the marginal difference: its partial derivative with respect to the marginal difference is identically zero, and its zero point lies on…

Evidence level: C

Two readers’ marginal differences cannot be reverse-engineered from the difference between Gwet’s AC1 and Cohen’s κ. This is because AC1’s expected agreement rate contains only the sum of the two margins, not their difference; therefore, throughout the calculation, only the κ side moves.

The previous section left an enticing path: one could reverse-engineer how much the two readers’ marginal differences differ from the difference between Gwet’s AC1 and Cohen’s κ. The reasoning sounded solid—these two coefficients have different sensitivities to marginal differences. In κ’s expected agreement rate, the product of the two margins appears; changing them directly alters the value. In AC1’s expected agreement rate, only their average matters. Subtracting them should leave the marginal difference. The previous calculation showed this difference goes to zero when the mean is near 0.43 and the marginal difference is near 19.8 percentage points (pp), leading to the conclusion that fingerprints are blind where they are most needed. The direction was right, but the reason was not.

Let’s break down AC1. The numerator is the observed agreement rate, which is data. The denominator’s expected agreement rate equals twice the mean multiplied by one minus the mean—the mean handles only the sum, not the difference. This means if one reader is biased positive and the other negative, as long as the average remains unchanged, AC1 does not move at all. Numerically fixed: mean 0.43, observed agreement rate 0.80, with marginal differences of 1pp, 5pp, 10pp, and 15pp, AC1 remains exactly 0.6076892899, identical to ten decimal places; under the same four scenarios, κ ranges from 0.592045 to 0.601157. Taking the partial derivative with respect to the marginal difference, AC1 and Scott’s π are precisely zero, while κ varies between 0.025 and 0.140.

The nature of this result must be clarified: it is not that the difference is too small to detect, but that AC1 itself, by definition, contains no information about the marginal difference. The claim that “the difference between the two coefficients carries information about the marginal difference” is actually because only the κ half moves unidirectionally, while AC1 acts as a constant in the subtraction. The “zeroing” observed earlier is essentially a curve containing only κ intersecting a horizontal line.

A harder blow follows. The original problem treats agreement rates between 0.85 and marginal differences from 14 to 20pp as “the most common scale in diagnostic studies,” yet this combination does not exist on a 2×2 table. Non-negative four-cell probabilities impose an exact constraint: the bottom-left cell equals one minus the observed agreement rate minus half the marginal difference, which must be non-negative; thus, the marginal difference cannot exceed one minus the observed agreement rate, regardless of the mean. When the observed agreement rate is 0.85, the maximum marginal difference is 15pp; at 0.90, it drops to 10pp. Checking 200,000 random tables individually, zero violations occurred. In other words, “high agreement rate” and “large marginal difference” are mutually exclusive states: if the marginal difference truly reaches 20pp, the agreement rate cannot exceed 0.80.

The zeroing point is no longer mysterious. AC1 and κ go to zero when the marginal difference equals the absolute value of √2 times twice the mean minus one; at mean 0.43, this is exactly 19.80pp, but it falls within the feasible region only if the observed agreement rate does not exceed 1 minus this value. At that threshold, the bottom-left cell is precisely zero. Thus, the line is not hidden deep within parameter space; it lies on the edge of the simplex. Once the agreement rate exceeds 0.802, this line exits the feasible region, and the difference remains positive forever. The previous assumption that “zeroing” is a universal threat only occurs when the table degenerates to its boundary.

The true solution lies not in the difference, but in the two level values themselves. The marginal mean is determined solely by AC1 and the observed agreement rate; solving the quadratic yields a closed-form expression: mean equals one minus √(one minus twice the expected agreement rate) divided by two. Once the mean is obtained, κ’s expected agreement rate allows reverse-solving for the marginal difference, yielding another closed form: √(twice the bracket), where the bracket contains three terms involving the mean minus the terms determined by the observed agreement rate and κ. Substituting back into 1,188 sets of random parameters yields a maximum error of 8.3×10⁻¹⁴—not an approximation, but an identity.

The cost of this path is precision, not solvability. Using mean 0.43, agreement rate 0.80, and true marginal difference of 6pp as parameters for bootstrap: with sample sizes of 60, 200, 400, and 800, the sampling standard deviation of the marginal difference is 4.68pp, 3.01pp, 2.24pp, and 1.56pp respectively. To bring the 95% confidence interval half-width down to 3pp, approximately 800 cases are needed. By contrast, reverse-solving using only the difference leaves 42% to 61% of the same samples unsolvable, with standard deviations stuck between 4.1 and 4.8pp regardless of sample size—because the difference itself discards most information.

This conclusion extends beyond binary classification. In multi-class settings, AC1’s expected agreement rate equals the sum of each category’s marginal proportion multiplied by one minus that proportion, divided by (number of categories minus one); it still contains only margins, no cross-category pairing structure. Weighted κ’s expected agreement rate includes products of cross-category weights and marginal products, introducing pairing structure. Thus, “AC1’s zero response to marginal difference” holds even in multi-class diagnosis, and the more one forces classification into binary form or pushes people toward high agreement rates, the more complete this zero response becomes.

Practical implications are direct: reporting AC1 and κ together is acceptable, but their difference cannot serve as a measure of marginal difference; it can only act as a rough indicator of “how much κ is penalized by the marginal structure.” To obtain the marginal difference itself, report the two level proportions—the cost is zero. PMID 23627889 reports AC1 exceeding κ across all items in nine psychiatrists and 67 personality disorder cases (0.752 to 1.000 versus 0 to 1.00), attributing the difference to prevalence sensitivity—this is precisely the clinical trace of this zero response; PMID 8501467 early on required separate reporting of bias and prevalence to interpret κ; PMID 24338600 provides sample size reverse-solution based on target precision, directly applicable to the “800 cases for 3pp” planning above; PMID 36123642 sampled 82 consistency studies, yet only one-third provided sample size justification, indicating this precision accounting is largely overlooked in practice.

Evidence and Limitations

Verified (mathematical identity, not empirical conclusion): AC1’s expected agreement rate equals twice the mean multiplied by one minus the mean, containing only the sum of margins, not their difference; the partial derivative with respect to marginal difference is precisely zero, independent of mean and agreement rate values. With fixed mean 0.43 and observed agreement rate 0.80, as marginal difference ranges from 1pp to 15pp, AC1 remains exactly 0.6076892899. The zeroing condition occurs when marginal difference equals the absolute value of √2 times twice the mean minus one, achievable only if observed agreement rate does not exceed one minus this value. The feasible region constraint “marginal difference ≤ 1 − observed agreement rate” follows directly from non-negative four-cell probabilities, with zero violations among 200,000 random tables. Solving two level values jointly yields closed-form reverse solutions for mean and marginal difference, with maximum error of 8.3×10⁻¹⁴ upon substitution into 1,188 random parameter sets.

Partially Verified: Reverse-solution precision is quantified via parameter bootstrap—when true marginal difference is 6pp, sample sizes of 60/200/400/800 correspond to sampling standard deviations of 4.68/3.01/2.24/1.56pp; this scale depends on the ideal condition that “observed agreement rate is known and free of systematic error.” By contrast, reverse-solving using only the difference leaves 42% to 61% of the same samples unsolvable, with standard deviations stuck between 4.1 and 4.8pp regardless of sample size.

To Be Verified: The distribution of (mean, marginal difference, observed agreement rate) triplets in real diagnostic studies has not been empirically measured; all scales in this draft are built on parameter grids rather than literature backfill. While “AC1’s zero response to marginal difference” is given by formula in multi-class weighted scenarios, it lacks empirical dataset verification of whether zero response remains precise as the number of classes increases; this paper does not discuss whether AC1’s expected agreement rate structure still contains only margins in cases with three or more raters.

Evidence Level: C
References: PMID 23627889, PMID 8501467, PMID 24338600, PMID 36123642, PMID 25090041, PMID 33853549

Further Reading

L1 Network Status: EDGE_TABLE_science-yixue.md concepts stop at the physiological layer (407 articles on frequency, 147 on harmonics, 73 on pulse), with no entries for statistical agreement coefficients; CORRESPONDENCE_NETWORK.md shows “AC1” hits once, “Gwet” three times, and “Brennan” once, all falling under the E-060 label premise (organ differentiation as grouping label | premise | label reliability, status conflict, undecided); “identifiable,” “recognizability,” “prevalence,” “zero distribution,” and “coefficient pairs” all hit zero. This topic has not yet entered the corresponding L1 network.


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *