「m≥0.95 判安全」这条线是用估出来的数画的:真到门槛的人一半能过,加多少样本都压不到零

Written by

in

Language

Evidence level: C

一条判据线如果画在它自己那个「被估出来的门槛」上,那么无论加多少样本,它的通过率都只能趋近 50%,永远回不到 0。

一、门槛是从一个恒等式里来的,而恒等式偷偷把 m 当成了已知数

1393 的核心门槛是「m≥0.95 ⇒ δ>5pp 数学上不可达」,依据是一条恒等式:(1−m)×100 就是 δ 的上界,m=0.95 时恰好等于 5。这条式子本身没错。但它有一个没说出口的前提——m 是已知的。

实际的 m 是数出来的:n 个人判读,m̂ = 合格数 / n。只要 n 有限,m̂ 就带抽样误差,SE = √(m(1−m)/n);m=0.95 时 SE = √(0.0475/n)。代进常见样本量:

n m̂ 的 SE 95% 区间半宽 半宽 ÷ 5pp 预算
30 3.98pp 7.80pp 1.56
60 2.81pp 5.51pp 1.10
73 2.55pp 5.00pp 1.00
120 1.99pp 3.90pp 0.78
240 1.41pp 2.76pp 0.55
480 0.99pp 1.95pp 0.39
960 0.70pp 1.35pp 0.27

要让 m̂ 的区间半宽正好等于 5pp(也就是把整个 δ 预算吃光),需要 n=73。低于 73 例的研究,它的 m̂ 误差比它能担保的余量还大。 这个比值有闭式:噪声 ÷ 余量 = √(19/n),n=19 时恰好等于 1——样本量低于 19,后面关于「安全」的话都不成立。

二、判据线压在门槛上,就永远不比抛硬币更准

现行规则是「m̂ ≥ 0.95 判安全」。算真 m 正好等于 0.95(就在门槛上)时的通过率:n=60 是 64.7%,n=240 是 57.6%,n=480 是 55.4%,n=960 是 53.8%,n=5000 是 51.7%。

单调趋向 50%,永远回不到 0。原因是结构性的:判据线与真值门槛重合时,误差对称地分在两边,一半在上、一半在下。 被它判为「安全」的那一半,恰好是运气好的那一半。这说明 #1404 发现的「判据线正好压在噪声底上」不是巧合,而是通病:拿一个带误差的估计,去跟它自己的定义线比。

三、误差不是对称的:既放行两倍超标者,又拒掉合格者

n=60 时的完整通过率(真 m → 通过率):0.90→13.7%,0.93→38.7%,0.96→78.1%,0.97→89.4%,0.99→99.7%。两端都有问题。

真 m=0.90 意味着 δ 上界 10pp,是预算的两倍,仍有 13.7% 被放行;真 m=0.93(7pp,超标 40%)有 38.7% 被放行。反过来,真 m=0.97(3pp,余量充足)只有 89.4% 通过——合格者被拒掉十分之一。 同时具备「放行两倍超标者」和「驳回合规者」两个缺陷,说明它不是保守或激进的偏斜,而是根本没有分辨力。

抽样模拟(真 m 在 0.90–0.99 间均匀取)更直接:n=60 时被放行的研究里有 33.8% 实际 δ>5pp;n=240 时仍有 17.8%。被放行者的真实上界 P90,n=60 是 7.62pp,n=240 是 5.71pp。这批研究报告上写着「≤5pp」,但其中三成到一成七,真实值已经越线。

四、诚实的数:报告「5pp」的时候,真值可能是 12.4pp

m̂ 恰好等于 0.95(刚好卡线过关)时,m 的 95% 单侧下界(精确二项法)给出的诚实 δ 上界是:

n m 的单侧下界 诚实 δ 上界 是名义 5pp 的几倍
60 0.8758 12.4pp 2.5
120 0.9037 9.6pp 1.9
240 0.9202 8.0pp 1.6
480 0.9304 7.0pp 1.4
960 0.9368 6.3pp 1.3

即便做到 n=960,卡线过关也只能担保 6.3pp。想担保到 5pp 理论上要 n 趋于无穷——5pp 是这条线的渐近值,不是任何有限样本能报出的数。 凡报告写「δ 上界 ≤5pp」,实际含义是「m̂ 刚好过了 0.95」,而不是「δ 被证明 ≤5pp」,两者差 1.3 到 2.5 倍。

五、改法:用精确单侧上界,不用点估计过线

正确判据不是「m̂ 过线」,而是「合格率的下界过线」,等价于「失败率的精确单侧上界 ≤5%」。这个量可精确算(Clopper-Pearson)。

(1)零失败时最简单。 全合格时失败率上界 = 1−0.05^(1/n)。要它 ≤5%,需 n ≥ ln0.05/ln0.95 = 58.4,即 59 例。n=30 时零失败上界 9.50pp,永远过不了关——30 例这个规模从一开始就没资格谈 5pp。n=60 给 4.87pp,n=120 给 2.47pp,n=240 给 1.24pp。

(2)允许失败时按 n 定 c_max。 n=120 允许 1 例,n=240 允许 6 例,n=480 允许 15 例,n=960 允许 36 例,n=3000 允许 130 例。换算成等价名义门槛 t = 1 − c_max/n:0.9917 / 0.9750 / 0.9688 / 0.9625 / 0.9567。n=6000 才降到 0.9548——名义门槛应抬到 0.96–0.99,不是 0.95。*

代价是真实的。精确判据很保守:真 m=0.97 时,n=240 通过率仅 41.8%,n=480 是 63.0%,n=960 才到 92.3%。要「守住 5pp、又有八成把握放行合规研究」,n 得在 1000 上下。

六、真正的瓶颈:这笔样本量买在了错的那一项上

1404 已算出:漂移导致的 δ̂ 标准误,n 无穷时停在 5.31pp,不随样本量下降。把 m̂ 的误差按方差与之相加:

n 漂移项 m̂ 项 合计
60 5.31pp 2.81pp 6.01pp
240 5.31pp 1.41pp 5.49pp
960 5.31pp 0.70pp 5.36pp
2000 5.31pp 0.49pp 5.33pp

从 60 例加到 2000 例,总误差只从 6.01pp 降到 5.33pp,降了 11%:n 只能治 m̂ 那一项(门槛侧),治不了漂移那一项(输入侧),而漂移本来就是大项。

所以「为满足精确判据把 n 抬到 1000」这条建议,买的是较小那一项。抬到 1000 后误差结构变成 5.31 + 0.70,瓶颈完全落在漂移上,再抬 n 一分钱效果都没有。样本量能买到的,只是把门槛侧误差抹平;它抹不平尺子本身在动。

证据与局限

已验证:m̂ 抽样误差公式、各样本量下的通过率、Clopper-Pearson 精确上界、n≥59 的零失败下限、t* 序列——全部是纯数学关系,可直接复算,不依赖任何实测数据。

部分验证:#1404 的漂移地板 5.31pp 是换算链产物,非实测值;两处误差按方差相加的前提是二者独立,与 #1424 要量的相关系数直接相关,目前未测。

待验证:① 漂移与 m̂ 误差是否真独立;② 贝叶斯收缩估计能否在 n 较小时把「放行超标者」比例压下来,若不能说明是信息不足只能加 n;③ 若研究者看到 m̂ 后追加样本(可选停止),上述精确上界失效,须改用序贯设计上界。

该主题尚未进入 L1 对应网络:边表止于 E-050,检索「门槛 / 阈值 / 样本量 / 置信 / 抽样 / 比例 / 基准 / kappa / 一致性 / 判读 / 信度」均无对应边,仅第 192 行「生克一致性」字面相近但所指不同。按硬约束,本篇证据等级封顶为 C。

L1 网络状态:无对应边(边表末项 E-050,概念表内无「一致性/门槛/样本量」类节点;第 192 行仅有「生克一致性|相生/相克方向能否复现|未测」,与判读一致性无关)

相关阅读

证据等级: C
参考文献: PMID 24338600, PMID 15733050, PMID 8501467, PMID 36123642, PMID 29707825, PMID 26519187


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

The line \”m≥0.95 is safe\” was drawn using an estimated number: half of those who truly reach the threshold pass, and adding more samples never drives it to zero.

Evidence level: C

A decision line drawn at its own “estimated threshold” will have a pass rate approaching 50% regardless of sample size, never returning to zero.

I. The Threshold Derives from an Identity That Secretly Treats m as Known

The core threshold of #1393, “m≥0.95 ⇒ δ>5pp mathematically unreachable,” relies on the identity: (1−m)×100 is the upper bound of δ; when m=0.95, this equals exactly 5. This equation itself is correct. However, it has an unstated premise—m is known.

The actual m is estimated: n people judge, m̂ = qualified count / n. As long as n is finite, m̂ carries sampling error, SE = √(m(1−m)/n); at m=0.95, SE = √(0.0475/n). Substituting common sample sizes:

n m̂ SE 95% CI half-width half-width ÷ 5pp budget
30 3.98pp 7.80pp 1.56
60 2.81pp 5.51pp 1.10
73 2.55pp 5.00pp 1.00
120 1.99pp 3.90pp 0.78
240 1.41pp 2.76pp 0.55
480 0.99pp 1.95pp 0.39
960 0.70pp 1.35pp 0.27

To make the CI half-width exactly equal 5pp (consuming the entire δ budget), n must be 73. Studies with fewer than 73 cases have m̂ error larger than the margin they can may support. This ratio has a closed form: noise ÷ margin = √(19/n); at n=19, it equals exactly 1—below this sample size, all subsequent claims about “safety” do not hold.

II. When the Decision Line Presses Against the Threshold, Accuracy Never Exceeds Coin Flipping

Current rules state “m̂ ≥ 0.95 implies safety.” Calculating the pass rate when true m equals exactly 0.95 (right at the threshold): n=60 yields 64.7%, n=240 yields 57.6%, n=480 yields 55.4%, n=960 yields 53.8%, and n=5000 yields 51.7%.

Monotonically approaching 50%, never returning to zero. The reason is structural: when the decision line coincides with the true threshold, error splits symmetrically—half above, half below. The half judged “safe” is precisely the lucky half. This indicates that #1404’s finding of “the decision line presses exactly on the noise floor” is not coincidental but a systemic flaw: comparing an estimated quantity with its own definition line.

III. Error is Asymmetric: It Releases Twice the Exceeders and Rejects Qualified Cases

At n=60, the complete pass rate (true m → pass rate): 0.90→13.7%, 0.93→38.7%, 0.96→78.1%, 0.97→89.4%, 0.99→99.7%. Both ends exhibit problems.

True m=0.90 implies δ upper bound 10pp, twice the budget; yet 13.7% are released. True m=0.93 (7pp, exceeding by 40%) has 38.7% released. Conversely, true m=0.97 (3pp, ample margin) only passes 89.4%—qualified cases rejected at one-tenth. Simultaneously exhibiting “releasing twice the exceeders” and “rejecting compliant cases” reveals it is neither conservative nor radical bias, but lacks discriminative power entirely.

Simulation with uniform true m between 0.90–0.99: at n=60, 33.8% of released studies actually have δ>5pp; at n=240, still 17.8%. The true P90 upper bound for released studies: n=60 is 7.62pp, n=240 is 5.71pp. These reports claim “≤5pp,” yet one-third to seventeen percent actually exceed the line.

IV. Honest Numbers: When Reporting “5pp,” True Value May Be 12.4pp

When m̂ exactly equals 0.95 (just crossing the line), the honest δ upper bound given by m’s 95% one-sided lower bound (exact binomial method):

n m one-sided lower bound honest δ upper bound multiple of nominal 5pp
60 0.8758 12.4pp 2.5
120 0.9037 9.6pp 1.9
240 0.9202 8.0pp 1.6
480 0.9304 7.0pp 1.4
960 0.9368 6.3pp 1.3

Even at n=960, crossing the line may support only 6.3pp. To may support 5pp theoretically requires n approaching infinity—5pp is the asymptotic value of this line, not a number any finite sample can report. Any report stating “δ upper bound ≤5pp” actually means “m̂ just passed 0.95,” not “δ proven ≤5pp”—a difference of 1.3 to 2.5 times.

V. Correction: Use Exact One-Sided Upper Bound, Not Point Estimate Crossing Line

The correct criterion is not “m̂ crosses the line,” but “lower bound of pass rate crosses the line,” equivalent to “exact one-sided upper bound of failure rate ≤5%.” This quantity can be precisely calculated (Clopper-Pearson).

(1) Zero failures is simplest. When all pass, failure rate upper bound = 1−0.05^(1/n). To keep it ≤5%, need n ≥ ln0.05/ln0.95 = 58.4, i.e., 59 cases. At n=30, zero-failure upper bound is 9.50pp—never passes the test—30 cases lack qualification for 5pp from the start. At n=60, gives 4.87pp; n=120 gives 2.47pp; n=240 gives 1.24pp.

(2) When allowing failures, set c_max by n. n=120 allows 1 failure, n=240 allows 6, n=480 allows 15, n=960 allows 36, n=3000 allows 130. Converted to equivalent nominal threshold t = 1 − c_max/n: 0.9917 / 0.9750 / 0.9688 / 0.9625 / 0.9567. Only at n=6000 does it drop to 0.9548—nominal threshold should be raised to 0.96–0.99, not 0.95.*

The cost is real. Exact criteria are conservative: at true m=0.97, n=240 pass rate is only 41.8%, n=480 is 63.0%, and n=960 reaches 92.3%. To “maintain 5pp with 80% confidence to release compliant studies,” n must be around 1000.

VI. True Bottleneck: Sample Size Bought the Wrong Term

1404 calculated: drift-induced δ̂ standard error, as n→∞, stabilizes at 5.31pp—does not decrease with sample size. Adding m̂ error via variance:

n drift term m̂ term total
60 5.31pp 2.81pp 6.01pp
240 5.31pp 1.41pp 5.49pp
960 5.31pp 0.70pp 5.36pp
2000 5.31pp 0.49pp 5.33pp

Increasing from 60 to 2000 cases, total error drops only from 6.01pp to 5.33pp—a 11% reduction: n can only fix the m̂ term (threshold side), not the drift term (input side), which is already the dominant component.

Thus, “raising n to 1000 for exact criteria” buys the smaller term. After raising to 1000, error structure becomes 5.31 + 0.70—the bottleneck lies entirely in drift; further increasing n yields no effect. Sample size can only flatten the threshold-side error; it cannot correct the ruler itself moving.

Evidence and Limitations

Verified: m̂ sampling error formula, pass rates at various sample sizes, Clopper-Pearson exact upper bounds, n≥59 zero-failure lower bound, t* sequence—all pure mathematical relations, directly reproducible without empirical data.

Partially verified: #1404’s drift floor of 5.31pp is a conversion chain product, not measured; adding two errors via variance assumes independence, directly related to #1424’s correlation coefficient, currently unmeasured.

Pending verification: (1) whether drift and m̂ error are truly independent; (2) whether Bayesian shrinkage estimation can reduce “releasing exceeders” proportion at small n—if not, information insufficiency requires increasing n; (3) if researchers add samples after observing m̂ (optional stopping), exact upper bounds fail, requiring sequential design upper bounds.

This topic has not entered the L1 corresponding network: edge table stops at E-050; searching “threshold / threshold / sample size / confidence / sampling / proportion / baseline / kappa / consistency / interpretation / reliability” yields no corresponding edges; only row 192 “生克一致性” (generative-restraining consistency) is superficially similar but refers to something different. Under hard constraints, this topic’s evidence level caps at C.

L1 Network Status: No corresponding edges (edge table final item E-050, concept table lacks “consistency/threshold/sample size” nodes; row 192 contains only “generative-restraining consistency | whether generative/restraining directions can replicate | unmeasured,” unrelated to interpretation consistency)

Further Reading

Evidence Level: C
References: PMID 24338600, PMID 15733050, PMID 8501467, PMID 36123642, PMID 29707825, PMID 26519187


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *