95% 与 99.9% 两档收窄条款的可迁移性:95% 档验证过的 ĝ 收窄规则能不能直接搬到 99.9% 档

Written by

in

Language

Evidence level: C

同一套标定数据估出来的两个置信档,误差未必是「同一种误差」——95% 档验证过的收窄规则,在 99.9% 档可能静默失效。

正文

在这条线上,我们给档内因子 ĝ 的估计区间加了一条「收窄条款」:当标定数据质量足够好时,把按默认公式算出的宽区间收窄一些,免得每条判据都背着过宽的保险费。这条规则在 95% 置信档上验证过。但判据体系里还有一档更严的——99.9% 档。前一篇文章已经指出一个尴尬的事实:99.9% 档的 g 全部大于 1,没有任何富余空间。这就引出一个没被测过的问题:95% 档的收窄规则,能不能直接搬到 99.9% 档用?

直觉上好像可以:两档用的是同一套标定数据、同一个估计流程,只不过置信水平不同。但统计上这两档的误差结构可能差别很大。原因有三层。

第一层,尾部对分布形状更敏感。95% 分位数的估计主要依赖数据的中部与肩部,而 99.9% 分位数的估计几乎完全押在极尾部上。同样的标定样本,中部信息充足、尾部信息稀薄,两档估计误差的相关性因此不会是 1——95% 档估得准,不代表 99.9% 档也估得准。文献里早有定量先例:在小样本或研究数少的场景下,似然法区间在不同置信水平下的实际覆盖表现并不一致,越往高置信档走,覆盖失真越明显(PMID 30634920)。

第二层,小样本修正是按档调校的,不是免费的。Kenward-Roger 型修正这类针对小样本推断的修正方法,其表现随置信水平变化:在某一档校准得好的修正,换一档未必同样校准(PMID 37399845)。这说明「同一套估计流程」不等于「同一套误差行为」——修正是贴着具体档位调的。

第三层,收窄是把双刃剑,砍错方向在高档伤得更重。95% 档误收窄的代价是覆盖从 0.95 掉到 0.93 左右,还有 7% 的兜底;99.9% 档误收窄则是覆盖从 0.999 往下掉,而这一档的判据全部依赖高覆盖承诺,掉到 0.99 以下就等于条款失效。用更精细的近似方法构造区间(如 saddlepoint 近似)能改善尾部覆盖,但前提是你知道自己在哪个档上、按哪档校准(PMID 42177767)。

所以可做的裁决实验很明确:用同一套标定样本同时估计 95% 与 99.9% 两档的 ĝ,先测两档估计误差的相关系数——这个数字回答「95% 档的经验能不能预测 99.9% 档」;再让 99.9% 档直接套用 95% 档验证过的收窄规则,测实际覆盖掉到多少。

裁决线也已写死:两档估计误差相关 ≥0.9、且 99.9% 档误收窄后覆盖仍 ≥0.995,则单套规则两档通用,条款只写一份;若 99.9% 档覆盖 <0.99,则条款必须按档分立,明文禁止跨档套用。中间地带(覆盖 0.99–0.995)则条款须附「高档须单独重校准」的前提。

这个问题的价值不在 ĝ 本身,而在方法论的一般教训:在低档验证过的校准规则,向高档外推是「无凭证的信任」。易学判据体系里大量条款依赖置信承诺,哪一档验证过、哪一档只是搭了便车,必须逐档记账。

证据与局限

已验证: 两个 PMID 核心事实——少研究场景下似然区间在不同置信水平覆盖表现不一致(PMID 30634920);Kenward-Roger 型修正的表现随置信水平变化(PMID 37399845)。
部分验证: saddlepoint 等精细区间方法在尾部构造上的改善有模拟证据(PMID 42177767),但未在本文的具体 ĝ 流程上复现。
待验证: 两档 ĝ 估计误差的相关系数(≥0.9 与否);99.9% 档套用 95% 档收窄规则后的实际覆盖(≥0.995 / 0.99 两条裁决线)——均为仿真设计,未执行。

相关阅读

证据等级: C
参考文献: PMID 30634920, PMID 37399845, PMID 42177767

L1 网络状态:该主题尚未进入 L1 对应网络(CORRESPONDENCE_NETWORK 与 EDGE_TABLE 中无「置信水平 × 收窄规则 × 覆盖」对应边;最近邻为 E-061,L2/open);本文属纯统计方法学课题,与传统对应边无直接勾连,故按规则最高只标 C 级。


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Transferability of Narrowing Rules Across Two Bands: Can the ĝ Narrowing Rule Validated for the 95% Band Be Directly Applied to the 99.9% Band?

Evidence level: C

Transferability of the 95% and 99.9% Narrowing Clauses: Can the ĝ Narrowing Rule Validated at 95% Be Directly Applied to the 99.9% Level

Two confidence levels estimated from the same calibration dataset may not share the “same type of error”—the narrowing rule validated at the 95% level may silently fail at the 99.9% level.

Body

On this line, we introduce a “narrowing clause” for the estimated interval of the factor ĝ within the file: when calibration data quality is sufficiently high, we narrow the wide interval calculated via the default formula to avoid each criterion carrying an overly broad insurance premium. This rule has been validated at the 95% confidence level. However, the criterion system includes an even stricter tier—the 99.9% level. A previous article already pointed out an awkward fact: all g values at the 99.9% level are greater than 1, leaving no margin for error. This raises an untested question: Can the narrowing rule validated at the 95% level be directly applied to the 99.9% level?

Intuitively, it seems feasible: both tiers use the same calibration data and estimation procedure, differing only in confidence level. Statistically, however, their error structures may differ significantly for three reasons.

First, tails are more sensitive to distribution shape. Estimation at the 95th percentile primarily relies on the central and shoulder regions of the data, whereas estimation at the 99.9th percentile almost entirely depends on the extreme tail. With the same calibration sample, central information is abundant while tail information is sparse; thus, the correlation between estimation errors at these two levels will not be 1—accuracy at the 95% level does not may support accuracy at the 99.9% level. Literature already provides quantitative precedents: in small-sample or low-study scenarios, likelihood-based intervals exhibit inconsistent actual coverage across confidence levels, with greater distortion as confidence increases (PMID 30634920).

Second, small-sample corrections are tier-specific, not universal. Corrections such as the Kenward-Roger type, designed for small-sample inference, perform differently depending on confidence level: a correction well-calibrated at one tier may not be equally calibrated at another (PMID 37399845). This indicates that “the same estimation procedure” does not imply “the same error behavior”—corrections are tuned specifically to each tier.

Third, narrowing is a double-edged sword; mis-narrowing harms more severely at higher tiers. The cost of erroneous narrowing at the 95% level is coverage dropping from 0.95 to around 0.93, still retaining a 7% safety margin. At the 99.9% level, erroneous narrowing causes coverage to fall from 0.999 downward; since all criteria at this level depend on high-coverage commitments, dropping below 0.99 renders the clause invalid. Constructing intervals using finer approximation methods (e.g., saddlepoint approximation) can improve tail coverage, but only if you know which tier you are in and calibrate accordingly (PMID 42177767).

Thus, the decisive experiment is clear: use the same calibration sample to estimate ĝ at both the 95% and 99.9% levels, first measuring the correlation coefficient between estimation errors at both tiers—this number answers whether experience at the 95% level can predict performance at the 99.9% level—then directly applying the narrowing rule validated at the 95% level to the 99.9% tier and measuring how far actual coverage drops.

The decision boundary is fixed: if the correlation between estimation errors at both tiers ≥0.9 and coverage after erroneous narrowing at the 99.9% level remains ≥0.995, then a single rule applies to both tiers and only one clause is written; if coverage at the 99.9% level falls below 0.99, then clauses must be tier-specific, explicitly prohibiting cross-tier application. For intermediate cases (coverage between 0.99 and 0.995), clauses must include the proviso that “high-tier parameters require separate re-calibration.”

The value of this issue lies not in ĝ itself, but in the general methodological lesson: calibration rules validated at lower tiers constitute “unwarranted trust” when extrapolated to higher tiers. In the Yijing Studies criterion system, numerous clauses rely on confidence commitments; which tier has been validated and which merely piggybacked must be accounted for tier by tier.

Evidence and Limitations

Verified: Two core facts from PMID literature—under limited research scenarios, likelihood intervals exhibit inconsistent coverage performance across different confidence levels (PMID 30634920); Kenward-Roger-type corrections show performance variation dependent on confidence level (PMID 37399845).

Partially Verified: Refined interval methods such as saddlepoint demonstrate improved tail construction based on simulation evidence (PMID 42177767), but these improvements have not been replicated in the specific ĝ procedure outlined in this paper.

Pending Verification: Correlation coefficient of two-tier Ħ estimation error (≥0.9 or not); actual coverage after applying the 95% tier narrowing rule to the 99.9% tier (≥0.995 / 0.99 decision thresholds)—both are simulation designs, not yet executed.

Related Reading

Evidence Level: C
References: PMID 30634920, PMID 37399845, PMID 42177767

L1 Network Status: This topic has not yet entered the L1 correspondence network (no corresponding edges for “confidence level × narrowing rule × coverage” exist in CORRESPONDENCE_NETWORK and EDGE_TABLE; the nearest neighbor is E-061, L2/open); this article belongs to pure statistical methodology and lacks direct linkage with traditional correspondence edges, so it is assigned the highest possible level of C according to the rules.


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *