合格区里的尺子本来就够不到那条线:κ_s 拼尽全力只造得出 2.5 个百分点,而它要拦的是 5 个

Written by

in

Language

Evidence level: C

一个代理量能不能守住一条判据线,不取决于它测得准不准,取决于它自己的机制最多能造出多大的偏离——如果这个上界低于判据线,那它合格一万次也证明不了任何事。

正文

上一篇(#1386 / #1392)把判据从「两位判读者对主档占比的判断差 δ 是 1pp 还是 5pp」改成「先看两人打分的标准差之比 κ_s 在不在 0.90–1.10」。理由是 κ_s 测得更准、更省事。上一篇也指出 κ_s 对位置精确盲:纯平移时 κ_s 恒等于 1.000,而 δ 照样可能到 8pp。

本篇要回答的是下一个问题,也是 backlog 里被写成一个假设的问题:κ_s 合格、但 δ 已经超过 5pp 的那个窗口,到底有多宽、偏向哪一边? backlog 当时的猜测是「窗口多半集中在 m>0.95 的高主档区,所以给高 m 区加一道附加门就行」。

算完之后,这个猜测在两个方向上都是反的。原因是一个此前没人写下来的初等事实。

一、δ 有一条与 κ_s 无关的天花板

δ 的定义是「两位判读者把同一批受试者判进主档的人数比例之差」。那么它最多能是多少?把所有人推到主档,δ=(1−m)×100;把所有人在主档里全删掉,δ=−m×100。就这样,没有别的可能。

于是 δ 的物理上界是 (1−m)×100 pp,与两位读者的尺度差、位置差、打分形状全都无关,只由基准比例 m 决定:

m=0.60 时上界 40pp;m=0.75 时 25pp;m=0.85 时 15pp;m=0.90 时 10pp;m=0.95 时正好 5.00pp;m=0.99 时只剩 1.00pp。

这条天花板把所有讨论改写了。当 m≥0.95 时,「δ>5pp」这件事在数学上就不可能发生——不是 κ_s 把它拦住了,是这个人群里根本没有 5 个百分点的空间可以挪。所以「m>0.95 是危险区」这个直觉,正好说反了:高 m 区是全表最安全的地方。

二、反向门:m 越低越必须报 δ

在 m<0.95 的每一格,κ_s 合格都不可能推出 δ<5pp。给定 m 与 κ_s,让读者整体上下挪一点(纯位置错位 b,以潜变量标准差为单位),δ 就会跨过 5pp,而 κ_s 纹丝不动:

基准 m 该 m 下 δ 上界 b 需偏移多少 SD 才到 δ=+5pp(κ_s=1.00,完美合格)
0.75 +25.0pp 0.167 SD
0.85 +15.0pp 0.245 SD
0.90 +10.0pp 0.363 SD
0.93 +7.0pp 0.578 SD
0.95 以上 ≤5.00pp 不可能

也就是说:在最常见的低主档场景(m=0.75,即「约四分之一的人被判为有明显变化」),读者只要把整条尺子整体挪六分之一个标准差,δ 就到 5pp,而 κ_s 会诚实地报 1.000。这个错位量小到任何校准训练都不会当回事。

三、真正致命的一条:κ_s 的探测上界低于判据线

上面是「κ_s 看不见 b」。但更根本的问题是:κ_s 自己能动的那一部分,本来也造不出 5pp。

在合格区 κ_s∈[0.90,1.10] 内、只让尺度变(b=0,纯尺度错位),δ 的最大绝对值是:

m=0.75 时 2.32pp;m=0.85 时 2.53pp(全表最大);m=0.90 时 2.28pp;m=0.95 时 1.74pp;m=0.99 时 0.72pp。

把这条曲线说白:κ_s 这个机制在整个合格区里,无论怎么扫,最多只能解释 2.5 个百分点的 δ。 而它被派去守的是一条 5pp 的线。探测上界不到判据阈值的一半——这不是精度问题、不是样本量问题、不是「多做几次重复判读」能解决的问题,是结构性无覆盖:κ_s 合格所覆盖的那部分 δ 空间,与「δ>5pp」那部分空间在合格边界上几乎不重叠(重叠只在 m 极靠近 0.95、δ 勉强够到 5.0pp 的一条缝里)。

顺带一个可以核验的闭合性:κ_s 与 δ 之间不是独立的,存在一条「零脊线」b = c(1−a)(c 是该 m 的潜变量阈值)。在这条线上,无论 a 偏离 1 多远、κ_s 读到 0.80 还是 1.30,δ 恒等于 0.0000pp。也就是说 κ_s 的变化可以在 δ 完全不变的情况下任意大幅摆动——这条脊线就是「κ_s 合格」与「δ 合格」两张判据之间那条永远对不齐的缝。

四、「那再补报 kappa 不就行了」——也不行

常规的补救是「两个都报,看 κ_obs 有没有掉下来」。算一遍就知道这条也堵不住。

在单调阈值模型下,δ=+10.53pp(m=0.75,κ_s=0.92、b=+0.30 SD)时,κ_obs 是 0.673;δ=+7.91pp 时 0.76;δ=+5.01pp 时 0.86。在全参数网格里,δ>5pp 的格子共有 618 个,其中 361 个格子的 κ_obs 高于 0.60(最高 0.891)。原因很清楚:κ_obs 在单调模型下只是 |δ| 的另一个刻度,它不提供关于「哪个自由度偏了」的任何新信息,所以它只能在 |δ| 很大(≈11pp 以上)时才报警。

结论是:κ_s 守不住这条线,κ_obs 也守不住,两个一起报还是不构成拦截。

五、这道门该往哪边设

正确的附加门不是「高 m 区强制报 δ」,而是反过来:

  • m≥0.95:δ>5pp 数学上不可达,δ 可正式降为事后量,不必强制;
  • m<0.95:δ 一律必报,且报告时必须同时给 m——因为同一个 b 在不同 m 上造成的 δ 完全不同;
  • m<0.85:这是最危险的一段。此处 κ_s=1.00 只需 0.17–0.25 SD 的位置错位就能把 δ 推过线,而 δ 上界还有 15–25pp 的余量。凡落在这段的判读研究,κ_s 读数不得作为「不必报 δ」的依据。

这一条对气功外气研究特别要紧:这类试验里「有响应者比例」通常就在 20%–50% 区间,m≈0.5–0.75——正好是全表 δ 上界最高、κ_s 最无力的那一段。换句话说,本领域最典型的样本构型,恰好撞在代理量最失效的位置上。

证据与局限

已验证(本文内部推导,可独立复算):δ 的物理上界 (1−m)×100;δ=+5pp 所需位置错位量随 m 单调上升(0.167→0.578 SD);κ_s 合格区内纯尺度 δ 上界 ≤2.53pp;零脊线 b=c(1−a) 上 δ≡0;δ>5pp 且 κ_obs>0.60 的格子占比 58.4%。

部分验证:κ 类系数受边际分布(prevalence)与观察者偏倚(bias)双重影响、单报一个系数会误导,这一点有直接的文献支撑(PMID 8501467 明确提出应分列偏倚指数与流行度指数;PMID 25168681 在 2×2 表的系统比较中显示不同边际构型下各系数行为分化、并给出 B 统计量在两类悖论下更稳定的证据)。本文的贡献是把这条定性警告在「阈值模型 + 仿射错位」的具体参数化下算成了闭式数字。

待验证:① 本文全程假定两位读者的判读是同一个潜变量上的单调阈值(无交互、无个体级差异),真实判读里读者与受试者可能有交互项,交互会改变 δ 的可达上界;②「b=0.167 SD 的位置错位在实践中算不算小」没有本领域实测——需要先测出判读者在重复判读之间的位置漂移量级;③ 低 m 高危这一结论依赖于 m 的准确已知,而 m 本身是从判读结果估的,估 m 的误差会传导到门槛上;④ 本文未处理「两位读者对同一批人判读顺序不同」造成的顺序效应。

相关阅读

证据等级: C
参考文献: PMID 8501467, PMID 25168681, PMID 40839487

L1 网络状态:CORRESPONDENCE_NETWORK 边表全部边止于 L1 同构层、状态 open、现代证据栏多为「待补」;结构层统计「L2 以上边数 | 有「操作+观测量+阈值」的边 | 0」。全文件检索「判读 / 信度 / 一致率 / 尺度 / 位置 / 偏倚 / 代理 / 斜率 / 回归 / kappa / κ / 标准差 / 阈值 / 边际」共零命中,EDGE_TABLE_science-yixue 47 个概念条目中亦无「判读一致性」任何条目。该主题尚未进入 L1 对应网络,故本篇封顶 C。


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

The ruler in the qualified zone was already too short to reach that line: κ_s exerted its utmost effort yet could only produce 2.5 percentage points, whereas it needed to block 5.

Evidence level: C

Whether a proxy measure can hold a decision criterion line does not depend on how accurately it measures, but on the maximum deviation its mechanism can produce. If this upper bound lies below the criterion line, then qualifying a proxy measure one hundred thousand times proves nothing.

Body

The previous post (#1386 / #1392) revised the criterion from “the difference δ between two readers’ proportions of main cases (1pp vs. 5pp)” to “whether the ratio of standard deviations κ_s falls within 0.90–1.10”. The rationale was that κ_s measures more accurately and is more convenient. The previous post also noted that κ_s is blind to positional precision: under pure translation, κ_s remains constant at 1.000, yet δ can still reach 8pp.

This post addresses the next question, which was formulated as a hypothesis in the backlog: If κ_s qualifies but δ exceeds 5pp, how wide is this window and which side does it favor? The backlog’s initial guess was “the window mostly concentrates in the high main-case region (m>0.95), so adding an extra gate for high m regions would suffice.”

After calculation, this guess is reversed in both directions. The reason is an elementary fact that had not been written down before.

I. δ Has a Ceiling Independent of κ_s

δ is defined as “the difference in the proportion of subjects assigned to main cases by two readers.” What is its maximum possible value? Pushing everyone into main cases yields δ=(1−m)×100; removing everyone from main cases yields δ=−m×100. No other possibilities exist.

Thus, the physical upper bound of δ is (1−m)×100 pp, determined solely by the baseline proportion m, regardless of scale differences, positional shifts, or scoring shapes:

  • m=0.60 → upper bound 40pp
  • m=0.75 → 25pp
  • m=0.85 → 15pp
  • m=0.90 → 10pp
  • m=0.95 → exactly 5.00pp
  • m=0.99 → only 1.00pp

This ceiling fundamentally rewrites the discussion. When m≥0.95, the event “δ>5pp” is mathematically impossible—not because κ_s blocks it, but because there is simply no space of 5 percentage points available in that population. Therefore, the intuition “m>0.95 is the danger zone” is exactly backwards: the high m region is actually the safest part of the entire table.

II. Reverse Gate: Lower m Requires Reporting δ

In every cell where m<0.95, qualifying κ_s cannot imply δ<5pp. Given m and κ_s, shifting the readers’ scale up or down slightly (pure positional offset b, measured in latent standard deviations) causes δ to cross 5pp while κ_s remains unchanged:

Baseline m Upper bound of δ under this m b offset required (in SD) to reach δ=+5pp (with κ_s=1.00, perfect qualification)
0.75 +25.0pp 0.167 SD
0.85 +15.0pp 0.245 SD
0.90 +10.0pp 0.363 SD
0.93 +7.0pp 0.578 SD
>0.95 ≤5.00pp Impossible

In other words, in the most common low-main-case scenario (m=0.75, meaning “about one-quarter of people are judged to have significant change”), readers need only shift their entire ruler by one-sixth of a standard deviation for δ to reach 5pp, while κ_s honestly reports 1.000. This positional shift is so small that any calibration training would overlook it.

III. The Truly Fatal Issue: κ_s’s Detection Upper Bound Lies Below the Criterion Line

The above shows that “κ_s cannot see b.” But the more fundamental problem is: the part of δ that κ_s can actually move never reaches 5pp.

Within the qualifying region κ_s∈[0.90,1.10], considering only scale changes (b=0, pure scale offset), the maximum absolute value of δ is:

  • m=0.75 → 2.32pp
  • m=0.85 → 2.53pp (maximum across the entire table)
  • m=0.90 → 2.28pp
  • m=0.95 → 1.74pp
  • m=0.99 → 0.72pp

Put plainly: κ_s’s mechanism, throughout the entire qualifying region, can at most explain 2.5 percentage points of δ. Yet it is tasked with guarding a 5pp line. The detection upper bound falls below half the criterion threshold—this is not an accuracy issue, nor a sample size issue, nor something solvable by “repeating readings multiple times.” It is structural non-coverage: the δ space covered by qualifying κ_s barely overlaps with the “δ>5pp” region (overlap exists only in a narrow seam where m is extremely close to 0.95 and δ barely reaches 5.0pp).

As a verifiable closure: κ_s and δ are not independent; there exists a “zero ridge line” b = c(1−a) (where c is the latent threshold for this m). Along this line, regardless of how far a deviates from 1 (whether κ_s reads 0.80 or 1.30), δ remains exactly 0.0000pp. This means κ_s can swing wildly while δ stays completely unchanged—this ridge line represents the permanent misalignment between “κ_s qualifies” and “δ qualifies.”

IV. “Then Just Report kappa Too”—That Also Fails

The conventional remedy is “report both and check if κ_obs drops.” Calculation shows this also fails.

Under the monotonic threshold model:
– When δ=+10.53pp (m=0.75, κ_s=0.92, b=+0.30 SD), κ_obs = 0.673
– When δ=+7.91pp, κ_obs = 0.76
– When δ=+5.01pp, κ_obs = 0.86

Across the full parameter grid, there are 618 cells where δ>5pp, of which 361 have κ_obs above 0.60 (maximum 0.891). The reason is clear: under the monotonic model, κ_obs is merely another scale of |δ|; it provides no new information about “which degree of freedom shifted.” Thus, κ_obs only triggers an alarm when |δ| is large (≈11pp or more).

Conclusion: Neither κ_s nor κ_obs can guard this line; reporting both together does not constitute interception.

V. Which Way Should This Gate Face?

The correct supplementary gate is not “force δ reporting in high m regions,” but rather the reverse:

  • m≥0.95: δ>5pp is mathematically unreachable; δ can formally be reduced to a post-hoc measure and does not need mandatory reporting;
  • m<0.95: δ must always be reported, and the report must include m—because the same b produces completely different δ values at different m levels;
  • m<0.85: This is the most dangerous segment. Here, even κ_s=1.00 requires only 0.17–0.25 SD of positional shift to push δ over the line, while δ’s upper bound still leaves 15–25pp of margin. Any reading study falling in this segment must not use κ_s readings as grounds for “no need to report δ.”

This rule is especially critical for qigong external qi studies: in such trials, the “proportion of responders” typically falls between 20%–50%, meaning m≈0.5–0.75—precisely the region where δ’s upper bound is highest and κ_s is weakest. In other words, the most typical sample configurations in this field exactly collide with the region where the proxy measure fails most severely.

Evidence and Limitations

Verified (derived internally in this paper, independently reproducible):
– δ’s physical upper bound (1−m)×100;
– the positional shift required for δ=+5pp increases monotonically with m (0.167→0.578 SD);
– within κ_s’s qualifying region, pure-scale δ upper bound ≤2.53pp;
– along the zero ridge line b=c(1−a), δ≡0;
– 58.4% of cells have both δ>5pp and κ_obs>0.60.

Partially verified:
– κ-type coefficients are doubly affected by marginal distribution (prevalence) and observer bias; reporting only one coefficient is misleading. This has direct literature support: PMID 8501467 explicitly calls for separate reporting of bias index and prevalence index; PMID 25168681 shows in a systematic comparison of 2×2 tables that coefficient behaviors diverge under different marginal configurations and provides evidence that B statistics are more stable under both types of paradoxes. This paper’s contribution is converting this qualitative warning into closed-form numbers under the specific parameterization of “threshold model + affine offset.”

To be verified:
1. This paper assumes throughout that both readers’ judgments are monotonic thresholds on the same latent variable (no interaction, no individual-level differences); in real judgments, readers and subjects may have interaction terms, which would alter δ’s reachable upper bound;
2. “Is b=0.167 SD considered small in practice?” lacks empirical measurement in this field—first, the magnitude of positional drift between repeated readings must be measured;
3. The conclusion that low m is high-risk depends on accurate knowledge of m, yet m itself is estimated from reading results; error in estimating m propagates to the threshold;
4. This paper does not address order effects caused by different reading orders of the same subjects by two readers.

Related Reading

Evidence level: C
References: PMID 8501467, PMID 25168681, PMID 40839487

L1 Network Status: All edges in the CORRESPONDENCE_NETWORK edge table terminate at the L1 isomorphic layer, state open, with most modern evidence columns marked “to be filled”; structural statistics show “number of edges above L2 | edges with ‘operation + observable + threshold’ | 0“. A full file search for “reading / reliability / consistency rate / scale / position / bias / proxy / slope / regression / kappa / κ / standard deviation / threshold / marginal” yields zero hits; among the 47 concept entries in EDGE_TABLE_science-yixue, there is no entry for “reading consistency.” This topic has not yet entered the L1 corresponding network, hence this paper is capped at C.


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *