「三条判据都同意」到底是不是三个独立证据:把输入重叠度算出来,一致率就只剩一个自由度

Written by

in

Language

Evidence level: C

三条判据读的是同一批变量、同一批人、同一台仪器的数据——它们”都同意”很可能只是同一份输入被读了三次,而不是三份独立证据指向同一个结论。

正文

在方法学写作里有一句话几乎是条件反射:「合成指数、逐变量诊断、比例口径三条判据都指向同一结论,所以结论稳健。」这句话读起来像证据叠加,但在大多数实际场合它不是。三条判据用的是同一批候选变量、同一批受试者、同一套设备采集的数据;如果它们的输入集合重叠八成,那”三口径互证”就不是三个证人各自作证,而是同一个人换了三套说辞。

先看重叠度怎么算。 最直接的是 Jaccard 系数:两条判据实际用到的输入变量集合,交集除以并集。这是集合相似度的标准量,在特征选择稳定性评价里被当作可复现性的代理——文献里常见用法是拿它比较不同重抽样下选出的特征集重合程度,分布集中在 1 附近才算稳定(PMID 33375940 的多视图特征选择即以此类集合相似度评估所选标记的非冗余性)。但 Jaccard 有个已知的坑:它对集合大小敏感——这一点在特征选择文献里被明确点出为”list-size bias”,即两条清单越接近特征全集,越容易凑出高重叠(PMID 16077740 同族的有效检验数思路正是为了处理这种”看似很多、实则高度相关”的冗余)。所以 Jaccard 只能当重叠的下界参照,不能单独当独立性证据。

再看重叠度能不能直接换算成一致率。 可以做一步自算,不需要任何额外假设之外的东西。设两条判据的输入共享份额为 f,把它看成裁决分数的方差里共享的比例(即相关系数 ρ=f);裁决被压成二值(保留/降级)时,两条独立正态、相关 ρ 的分数符号相同的概率是:

一致率下界 = 1 − arccos(ρ)/π

把 Jaccard 换成 f 需要一步:等大小两集合,交集份额 f = 2J/(1+J)。代进去得到一张表:

输入 Jaccard 共享方差 f = 2J/(1+J) 二值裁决一致率下界
0.20 0.333 60.8%
0.40 0.571 69.4%
0.60 0.750 77.0%
0.70 0.824 80.8%
0.80 0.889 84.9%
0.90 0.947 89.6%

反过来解更刺眼:要让三条判据的一致率达到 90%,输入 Jaccard 得高到 0.907;要到 95%,J 得 0.976。也就是说,只要两条判据的输入集合有一成不同,它们的一致率在结构上就已经上不了 90%。反过来说,若观察到一致率 95% 以上,先不要庆祝——几乎可以肯定它的输入集合是同一个。

第二个量是有效独立信息条数。 这才是”是不是三个证据”的直接答案。三种算法都给同一个方向的答案:

  • Cheverud 型(用相关矩阵特征值方差):特征值越分散,独立检验数越少(PMID 11678987 在区间定位基因组扫描里提出这条思路);
  • Li–Ji 型(特征值超 1 的部分抵扣掉):M_eff = m − Σ(λᵢ−1),只要 λᵢ>1(PMID 16077740 指出 Cheverud 的估计偏大、偏保守,给出了更准的版本);
  • 特征值熵(Hill 数):exp(−Σpᵢln pᵢ),pᵢ 为归一化特征值。

三条判据等相相关 ρ 时,特征值是 1+2ρ、1−ρ、1−ρ。代进去:

判据间相关 ρ Li–Ji 有效条数 特征值熵有效条数
0.00 3.000 3.000
0.30 2.400 2.758
0.50 2.000 2.381
0.70 1.600 1.895
0.90 1.200 1.338
0.99 1.020 1.046

ρ = 0.75 时 Li–Ji 给 1.50——三条判据合起来不到两条独立信息;ρ=0.8 时是 1.4。而”输入重叠八成”在 Jaccard 上是 0.7、换成 ρ 是 0.82,已经落在这条线上。换句话说:只要输入 Jaccard 过 0.7,「三条判据互证」的独立条数就已经跌破 2。

这件事的后果不是修辞问题。 一个具体例子:三条判据各自的输入集合是 12、14、12 个变量,交集 10 个——J(合成指数, 逐变量诊断) = 10/14 ≈ 0.714。按上表,这两条的一致率下界是 81%,有效独立条数约 1.4。此时若真观察到 92% 的一致率,多出来的 11 个百分点不能算作”稳健性证据”,它只说明两条判据的裁决规则形式(阈值设在哪、权重怎么给)也高度雷同——那已经不是输入冗余,是规则冗余。

真正值得追查的,恰恰是重叠 >0.9 却仍出现 >15% 不一致的情形。 这时输入几乎完全一样,分歧只能来自规则形式:一条用了标准化均值差 0.1/0.25 双阈值,另一条用了 20%/30% 的结论成立比例。这种不一致才是信息——它暴露的是阈值选择而非数据,应当被单独写成敏感性分析,而不是被”三口径”的多数票抹平。

方法论上还能再退一步。 与其先算三条判据再比较,不如先把输入集合的冗余结构清出来:算相关矩阵的特征值谱,看”12 个候选变量实际能撑起几个自由度”。若谱显示只有一个大特征值(λ₁ 占了 70% 以上方差),那么不论后面写几条判据,它们读的都是那一个方向;此时正确的报告方式不是”三口径一致”,而是”该批数据仅含约 1.4 个独立信息方向,结论的不确定度未因多口径而收窄“。

要注意这里有个不能越的界。 上面的换算把裁决分数当成了等方差正态、把共享份额当成相关系数——这是最粗的一阶近似,真实规则里的阈值截断、加权方式、非线性变换都会让它偏。所以表里的数字应当读成量级判据(”八成重叠 → 独立条数不到两条”),而不是精确预测(”一致率一定等于 80.8%”)。这也正是本文只能标 C 的原因:换算链条是自算的解析结果,但整条”判据独立性”的边在 L1 对应网络里根本没有登记位。

最后一句直白的话:三条判据都同意,只有在你能证明它们读的不是同一份输入时才算证据。证明方式很简单——把三条判据实际用到的变量列出来,算 Jaccard,算特征值。如果 J 过 0.7,就把”三口径互证”这四个字删掉,改成报告”约 1.4 条独立信息下的单一结论”。前者是修辞,后者是可以被检验的陈述。

证据与局限

已验证: Jaccard 系数作为集合重叠度量、有效独立检验数(特征值法)作为相关多重检验的校正量,两者在生物信息与统计遗传学里都是成熟工具(PMID 11678987、PMID 16077740、PMID 33375940)。多重共线性会膨胀系数方差、使推断不可靠,也是既成结论(PMID 31304696);把 VIF 直接接入变量选择流程已有实践(PMID 34896682)。

部分验证: “输入重叠 → 裁决相关 → 一致率”这条换算链在本文是按等方差正态、二值裁决的最简模型自算的;共享份额当作相关系数这一步只在一阶近似下成立,未在真实判据规则上做过仿真标定。Jaccard 本身对集合大小的偏倚是已知问题,本文未做大小校正(如相对加权一致性)。

待验证: ① 三条判据在真实丹田数据集上的输入集合到底是什么,交集有几个变量——从未清点过;② 按 30%/60%/90% 三档人为构造重叠后,一致率曲线的实测斜率与本文解析下界差多少;③ 输入重叠 >0.9 却仍出现 >15% 不一致时,分歧是否确实由阈值设定而非数据驱动。

相关阅读

证据等级: C
参考文献: PMID 11678987, PMID 16077740, PMID 31304696, PMID 34896682, PMID 33375940, PMID 30788363, PMID 15066682, PMID 41626969

L1 网络状态:该主题尚未进入 L1 对应网络。CORRESPONDENCE_NETWORK.md 三域节点表仅登记单点信号(物理侧「相位 / 节律 | — | 周期性耦合的关键」、生理侧「呼吸率 / 呼吸模式 | 可穿戴 | 与节律耦合最直接」),全表检索「判据 / 裁决 / 一致率 / Jaccard / 重叠 / 有效独立」零命中;边表止于 E-050(纳音↔频率,L1、open,现代证据栏原文「尚无任何可测来源」);EDGE_TABLE 概念计数无「判据独立性 / 信息重叠 / 有效检验数」条目。故本文证据等级封顶 C,不得读作已验证机制。

本文自算说明:文中所有 Jaccard→一致率换算(f = 2J/(1+J);一致率 = 1 − arccos(ρ)/π)、有效独立条数(Li–Ji 型 M_eff = m − Σ(λᵢ−1);特征值熵 exp(−Σpᵢln pᵢ))、三判据特征值谱(1+2ρ, 1−ρ, 1−ρ)均为按定义直接推导所得,非引自文献;文献仅用于支撑方法本身的合法性与已有实践。


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Do the three criteria agree: calculating input overlap leaves only one degree of freedom for consistency.

Evidence level: C

“Three criteria agreeing” likely means the same input was read three times, not three independent pieces of evidence pointing to the same conclusion.

Body

In methodological writing, there is almost a reflexive phrase: “Synthetic index, variable-by-variable diagnosis, and proportion caliber—all three criteria point to the same conclusion, so the conclusion is robust.” This sounds like evidence stacking, but in most practical cases it is not. The three criteria use the same candidate variables, the same subjects, and data collected by the same equipment; if their input sets overlap by 80%, then “three-way cross-verification” is not three witnesses testifying separately, but one person changing three different narratives.

First, how to calculate overlap. The most direct is the Jaccard coefficient: the intersection of the actual input variable sets used by two criteria divided by their union. This is the standard measure of set similarity and serves as a proxy for reproducibility in feature selection stability evaluation—commonly used in literature to compare the overlap of feature sets selected under different resampling schemes, where a distribution centered near 1 indicates stability (PMID 33375940 uses such set similarity to assess the non-redundancy of selected markers in multi-view feature selection). However, Jaccard has a known pitfall: it is sensitive to set size—a point explicitly noted in feature selection literature as “list-size bias,” meaning the closer two lists are to the full feature set, the easier it is to achieve high overlap (PMID 16077740’s concept of valid test numbers for the same family precisely addresses this “appears numerous but actually highly correlated” redundancy). Therefore, Jaccard should only serve as a lower-bound reference for overlap, not as sole evidence of independence.

Next, can overlap directly convert to agreement rate? One step of self-calculation suffices, requiring nothing beyond the stated assumptions. Let f be the shared proportion of inputs between two criteria, treated as the fraction of variance in decision scores attributable to shared components (i.e., correlation coefficient ρ = f). When decisions are reduced to binary (retain/degrade), the probability that two independent normal scores with correlation ρ have the same sign is:

Lower bound of agreement rate = 1 − arccos(ρ)/π

Converting Jaccard to f requires one step: for two sets of equal size, the shared fraction f = 2J/(1+J). Substituting yields this table:

Input Jaccard Shared variance f = 2J/(1+J) Lower bound of binary decision agreement rate
0.20 0.333 60.8%
0.40 0.571 69.4%
0.60 0.750 77.0%
0.70 0.824 80.8%
0.80 0.889 84.9%
0.90 0.947 89.6%

Working backwards is even more striking: to achieve 90% agreement among three criteria, input Jaccard must reach 0.907; for 95%, J must be 0.976. That is, if two criteria’ input sets differ by just 10%, their structural agreement rate cannot exceed 80.8%. Conversely, observing an agreement rate above 95% should not be celebrated—it almost certainly means the input sets are identical.

The second quantity is the number of effective independent information streams. This is the direct answer to “are there three pieces of evidence?” All three algorithms point in the same direction:

  • Cheverud-type (using eigenvalue variance of the correlation matrix): the more dispersed the eigenvalues, the fewer independent test numbers (PMID 11678987 proposes this approach for interval-based genome-wide association studies);
  • Li–Ji-type (subtracting eigenvalues exceeding 1): M_eff = m − Σ(λᵢ−1), provided λᵢ>1 (PMID 16077740 notes Cheverud’s estimate is biased upward and conservative, offering a more accurate version);
  • Eigenvalue entropy (Hill number): exp(−Σpᵢln pᵢ), where pᵢ are normalized eigenvalues.

When all three criteria have equal correlation ρ, the eigenvalues are 1+2ρ, 1−ρ, and 1−ρ. Substituting yields:

Correlation ρ between criteria Li–Ji effective count Eigenvalue entropy effective count
0.00 3.000 3.000
0.30 2.400 2.758
0.50 2.000 2.381
0.70 1.600 1.895
0.90 1.200 1.338
0.99 1.020 1.046

At ρ = 0.75, Li–Ji gives 1.50—three criteria together provide less than two independent pieces of information; at ρ = 0.8, it drops to 1.4. Meanwhile, “input overlap at 80%” corresponds to Jaccard = 0.7, which translates to ρ = 0.82, placing it right on this line. In short: once input Jaccard exceeds 0.7, the independent count for “three-way cross-verification” falls below 2.

The consequence is not merely rhetorical. A concrete example: three criteria have input sets of 12, 14, and 12 variables respectively, with an intersection of 10—yielding J(synthetic index, variable-by-variable diagnosis) = 10/14 ≈ 0.714. From the table above, the lower bound of agreement between these two is 81%, and the effective independent count is approximately 1.4. If we truly observe 92% agreement, the extra 11 percentage points cannot be counted as “robustness evidence”; it merely indicates that the decision rules themselves (where thresholds are set, how weights are assigned) are also highly similar—this is no longer input redundancy, but rule redundancy.

What truly deserves investigation is the case where overlap >0.9 yet disagreement remains >15%. Here, inputs are nearly identical, so divergence must stem from rule structure: one uses dual thresholds of standardized mean difference 0.1/0.25, while another employs a conclusion-valid proportion of 20%/30%. This disagreement is the actual information—it exposes threshold selection rather than data, and should be reported separately as a sensitivity analysis, not smoothed out by “three-way majority voting.”

Methodologically, we can go further. Instead of computing three criteria first and then comparing, clear the redundant structure of input sets upfront: calculate the eigenvalue spectrum of the correlation matrix to see “how many degrees of freedom can 12 candidate variables actually support.” If the spectrum shows only one dominant eigenvalue (λ₁ accounting for over 70% of total variance), then regardless of how many criteria are written, they all read the same direction; the correct reporting style is not “three-way agreement,” but “this dataset contains only about 1.4 independent information directions, and uncertainty did not shrink due to multiple calibers.”

Note there is a boundary that cannot be crossed. The above conversions treat decision scores as equal-variance normal distributions and shared fraction as the correlation coefficient—the coarsest first-order approximation. Real-world rules involving threshold truncation, weighting schemes, and nonlinear transformations will introduce bias. Thus, numbers in the table should be read as order-of-magnitude indicators (“80% overlap → fewer than two independent streams”), not precise predictions (“agreement rate exactly equals 80.8%”). This is precisely why this paper can only be labeled C: the conversion chain derives analytically, but the entire “criteria independence” edge lacks registration in the L1 corresponding network.

The final plain statement: three criteria agreeing counts as evidence only if you can prove they did not read the same input. The proof is simple—list the variables actually used by each criterion, compute Jaccard, and calculate eigenvalues. If J exceeds 0.7, delete “three-way cross-verification” and report instead “a single conclusion under approximately 1.4 independent information streams.” The former is rhetoric; the latter is a testable claim.

Evidence and Limitations

Verified: Jaccard coefficient as a set overlap measure, and effective independent test counts (eigenvalue methods) as corrections for correlated multiple testing, are both mature tools in bioinformatics and statistical genetics (PMID 11678987, PMID 16077740, PMID 33375940). Multicollinearity inflates coefficient variance and makes inference unreliable, which is an established conclusion (PMID 31304696); integrating VIF directly into variable selection workflows has practical precedent (PMID 34896682).

Partially verified: The conversion chain “input overlap → decision correlation → agreement rate” in this paper is derived via the simplest model assuming equal-variance normal distributions and binary decisions; treating shared fraction as the correlation coefficient holds only under first-order approximation, without simulation calibration against real-world criterion rules. Jaccard’s inherent sensitivity to set size is a known issue, and this paper does not perform size correction (e.g., relative-weighted agreement).

To be verified: ① what exactly are the input sets of three criteria on real Dantian datasets, and how many variables lie in their intersection—never counted; ② after artificially constructing overlap at 30%/60%/90%, how much does the measured slope of the agreement rate curve deviate from this paper’s analytical lower bound; ③ when input overlap exceeds 0.9 yet disagreement remains above 15%, is the divergence truly driven by threshold settings rather than data.

Related Reading

Evidence level: C
References: PMID 11678987, PMID 16077740, PMID 31304696, PMID 34896682, PMID 33375940, PMID 30788363, PMID 15066682, PMID 41626969

L1 Network Status: This topic has not yet entered the L1 corresponding network. The three-domain node table in CORRESPONDENCE_NETWORK.md registers only single-point signals (physical side “phase/rhythm | — | periodic coupling key”, physiological side “breathing rate / breathing pattern | wearable | most directly coupled with rhythm”), and full-table search for “criteria / decision / agreement rate / Jaccard / overlap / effective independent” yields zero hits; edge table stops at E-050 (Na Yin ↔ frequency, L1, open, original text of modern evidence column states “no measurable source yet”); EDGE_TABLE concept count lacks entries for “criteria independence / information overlap / effective test numbers.” Hence this paper’s evidence level caps at C and cannot be read as verified mechanism.

Self-calculation explanation: All Jaccard→agreement rate conversions (f = 2J/(1+J); agreement rate = 1 − arccos(ρ)/π), effective independent counts (Li–Ji type M_eff = m − Σ(λᵢ−1); eigenvalue entropy exp(−Σpᵢln pᵢ)), and three-criteria eigenvalue spectra (1+2ρ, 1−ρ, 1−ρ) are derived directly by definition, not cited from literature; literature serves only to support the legitimacy of the methods and existing practice.


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *