「两个参数要并排测」是个假问题:p_e 根本不是第二个参数,它是异质性的影子——真正该测的是「随机抽两个案子不一样」的那个概率

Written by

in

Language

Evidence level: C

上一篇把报告规范压在 κmax = (1−TVD−p_e)/(1−p_e) 上,说 TVD 与 p_e 是「两个精确充分统计量」,于是担心实测里两者相关多少。这一轮把代数学完:p_e 被 TVD 和异质性 H 完全锁死,只剩 TVD²/8 量级的自由度;真正的第二个自变量从来不是 p_e,而是 H。

正文

上一篇(#1395)留了个待验证:真实三档裁决研究里 (TVD, p_e) 落在哪个区域、两者相关多少,一片空白;若强负相关,高一致区的警告可以降级;若近乎独立,警告要整体加重。这个设计有个前提没被检查——p_e 到底能不能算作独立于 TVD 的第二个参数。

先把三位判读者的边际分布记成 p 与 q,写 p_e = Σpᵢqᵢ。用恒等式 (p−q)² = p²+q²−2pq,把 pq 解出来再求和,得到一个纯代数关系:p_e = S − ‖p−q‖²/4,其中 S = Σmᵢ²,m = (p+q)/2 是合并边际。这一步没有任何假设,是把 p_e 换了个写法。

关键在第二项。给定 TVD,差向量 v = p−q 满足「正部之和 = 负部之和 = TVD」且和为 0,于是 ‖v‖² 只能在一个确定的区间里跑:最集中时 ‖v‖² = 4TVD²(全部差额压在一格),最分散时 ‖v‖² = 4TVD²·c_min,c_min 由档数决定(三档是 3/8,四档 1/4,五档 5/24)。代入上式,p_e 就被夹在 [S − TVD², S − TVD²/3] 之间,宽度是 TVD² 量级。

所以 p_e 不是第二个独立参数,它等于「异质性」减去「分歧」。 令 H = 1 − S,H 就是「随机抽两个案子,它们的真实判读档不同的概率」——判读问题里最常见的异质性指标(simpson 意义上的 diversity)。实测最能说明问题:同一组 H = 0.5592、TVD = 0.05,分别把差额压在三个不同的格上,算出的 κmax 全是 0.9108,一位小数都不差。集中在哪一格、哪个档位是多数——全都不影响。κmax 只是 (H, TVD) 的二元函数,没有第三个自变量在起作用。

这就把上一篇的担心反转了。它怕的是「两参数相关会不会让高一致区的警告失真」。实际上两者不是「相关」,是代数的同一件事:在 H 固定时,TVD 一升 p_e 必降(因为 ‖v‖² 必须跟着涨),斜率是 −TVD/2 量级,这不是经验相关而是恒等式的推论。而我按「研究实际分布」做的 2 万组仿真给出 r(TVD, p_e) = −0.074——几乎无相关。但那个数没有信息含量:它完全由我假设的抽样范围决定,换个范围就换个数。当一个相关系数可以被构造分布任意摆布时,把判据挂在它身上是错的。

反过来说,二分类情形最能露出底牌。两个档时 c 恒等于 1/2(五万组随机边际实测 c 的方差为 0),于是 p_e = S − TVD²/2 是恒等式,p_e 在 (m, TVD) 之外零自由度。也就是说,越简单的判读设计,p_e 越冗余;它看起来像个独立参数,只是档数多了以后代数松了一点。

那「松了一点」有多大? 三档、H = 0.45、TVD = 0.10 时,形状带来的 κmax 摆动是 0.0006;TVD = 0.20 时也才 0.0046。作为对照,同样是 TVD = 0.10,只把 H 从 0.80 降到 0.15,κmax 从 0.876 掉到 0.352。换形状动 0.0006,换异质性动 0.52——差三个数量级。 上一篇花在「残余跨度随 m̄ 上升」上的那一整节,量级上抓错了对象:真正决定浪费多少一致性的不是判读档位集中在哪,而是这批案子本身有多难分。

放大关系还有个干净的读法:同样的 TVD,H 从 0.80 压到 0.15,伤害放大 5.1–5.3 倍,几乎恒定。原因是伤害约等于 TVD/H——把 TVD 除以「案子之间的差异」,得到的是一个无量纲的分歧率。H = 0.45 时,TVD/H = 0.03 / 0.06 / 0.12 / 0.25 / 0.50 分别对应伤害 0.030 / 0.060 / 0.120 / 0.247 / 0.478。这是一条近似直线,斜率约 1。 判读研究里 5 个百分点的容差,到 H = 0.15 的样本上只等于 0.75 个百分点的 TVD 容差——这就是「高一致区警告」的真实来源,跟边际形状无关。

上一轮的另一半担心也顺手解决了。它怕 TVD̂ 正偏与 p̂_e 的偏倚在 κmax 里部分对冲,使「n = 71 时偏倚 −0.105」这个数要整体修正。把偏倚按两路拆开:TVD 路(固定 p_e,只换成 TVD̂)与 p_e 路(固定 TVD,只换成 p̂_e)。真表 TVD = 0.03、n = 71 时,总偏倚 −0.1076,其中 TVD 路 −0.1066、p_e 路 −0.0004——TVD 路占 99.6%。TVD = 0.08 时占 98.2%。n = 400 时仍是 98.8%。所谓对冲比不是 50%,是 1.3%:p_e 这一路小到不构成一个可以对冲的量。 原因是 pe 路对 κmax 的偏导被 (1−p_e)² 压住,而 p_e 的量级本身又只有 0.3–0.5。

顺带发现 TVD̂ 的偏倚是相当大的:真 TVD = 0 时,n = 71 下平均估出 0.0884,n = 3000 才降到 0.0135。这意味着一个真正完全对齐的判读系统,在 71 例的样本里会被报告成「边际有 8.8 个百分点的分歧」。这一项直接进 κmax,按 −TVD/H 折算,H = 0.45 时就是 −0.196 的天花板——比「−0.105」还重。上一篇报的 −0.105 对应的是 TVD = 0.03 这个特定真值,不是普遍情形。

最后是上一篇那条最硬的判据本身没法执行。「取 ≥8 份三档判读原始表逐份算 (TVD, p_e) 打点,判相关系数的绝对值大于 0.6 则重算曲线、小于 0.3 则独立报」。八份表下 r 的 95% 区间是 [−0.703, +0.705];真 r = 0.6 时判对概率 55.2%,真 r = 0.3 时 40.8%——判对的概率比抛硬币好一点点。 扩到 120 份,真 r = 0.6 判对 51.1%、真 r = 0.3 判对 49.6%,因为判据线正好压在零假设分布的两侧尾上,加样本不解决问题。而按本轮的代数,这个相关本来就不该测——它测的是一个被构造分布支配的量。

证据与局限

已验证(纯代数,可复算):
– 恒等式 p_e = S − ‖p−q‖²/4,三十万组随机三档边际零偏差。
– p_e 的可行区间 [S − TVD², S − 3TVD²/8](三档),四十万组网格零越界。档数 K 的一般式为 c_min = (1/4)(1/⌈K/2⌉ + 1/⌊K/2⌋),K = 2…8 全部与实测吻合(K = 2 实测 c 方差为 0)。
– κmax 只依赖 (H, TVD):同 (H, TVD) 下不同集中格给出完全相同的 κmax;形状带宽在三档 TVD = 0.20 时仅 0.0046。
– 伤害 ≈ TVD/H,斜率约 1;H 从 0.80 到 0.15 放大 5.1–5.3 倍。
– 偏倚分解:TVD 路占 98–99.7%,p_e 路 < 2%,对冲比接近 1(即无对冲)。

部分验证:
– TVD̂ 正偏的量级(n = 71 时真值 0 估成 0.088)来自独立二项抽样模拟,与 #1404 的漂移地板是同源推理,但未经真实三档表的联合 bootstrap 核验。
– H = 1 − S 作为「案子难度」的代理,与经典 simpson diversity 同构,但判读问题里「真实档」不可观测,H 只能从合并边际估,这一步的估计误差本轮未算。

待验证:
– H 的抽样误差有多大、它占 κmax 误差预算多少——若 H 本身估得不准,「伤害 = TVD/H」这个比值会把两路误差放大成一个更糟的量。
– 判读档位是有序的(轻/中/重),而 TVD 与 H 都是无序指标,丢失了「错一格 vs 错两格」的区分;有序情形下 H 是否还够用、还是必须换成累积分布的差异,未验。
– 8 份表的可分辨性结果是按 Fisher z 近似算的,真实三档表的 (TVD, p_e) 联合分布不是二元正态,实际判决力可能更差。

L1 网络状态:CORRESPONDENCE_NETWORK.md 与 EDGE_TABLE_science-yixue.md 全表检索「TVD / 边际 / 天花板 / p_e / 一致性 / 信度 / 判读」无对应边:唯一相关命中为 §3.8「E-060 标签前提」行(状态 conflict,讨论「中医医师间诊断一致性低 vs 统计误用致低估」这一标签信度前提),语义是「分组标签可不可靠」,不是「天花板由哪几个量决定」;其余命中均无关(第 192 行「生克一致性」指五行生克方向、物理侧第 57 行「相位 / 节律」指两振荡锁相)。边表止于 E-050,对齐指标行原文「L2 以上边数:0」。该主题尚未进入 L1 对应网络。

相关阅读

证据等级: C
参考文献: PMID 8501467, PMID 8621993, PMID 23776034, PMID 25168681, PMID 37127220, PMID 38283651

证据等级:A=有PubMed直接支撑,B=科学类比/间接证据,C=传统文化共识/初步探索


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Two parameters side-by-side is a false problem: p_e isn’t the second parameter; it’s the shadow of heterogeneity—the true measure is the probability that two randomly drawn case…

Evidence level: C

In the previous post, the report specification was pressed against $\kappa_{\text{max}} = (1-\text{TVD}-p_e)/(1-p_e)$, stating that TVD and $p_e$ are “two exact sufficient statistics,” thus raising concern about how much they correlate in actual measurement. This round completes the algebra: $p_e$ is completely locked by TVD and heterogeneity $H$, leaving only degrees of freedom on the order of $\text{TVD}^2/8$; the true second independent variable is never $p_e$, but rather $H$.

Body

The previous post (#1395) left an unverified point: in real three-tier adjudication studies, which region $(\text{TVD}, p_e)$ falls into and how much they correlate remains blank; if the correlation is strongly negative, warnings for high-consistency regions can be downgraded; if nearly independent, warnings must be overall intensified. This design has a premise that was not checked—whether $p_e$ can truly be counted as the second parameter independent of TVD.

Let us denote the marginal distributions of the three adjudicators as $p$ and $q$, writing $p_e = \sum p_i q_i$. Using the identity $(p-q)^2 = p^2 + q^2 – 2pq$, we solve for $pq$ and sum, yielding a purely algebraic relation: $p_e = S – |p-q|^2/4$, where $S = \sum m_i^2$ and $m = (p+q)/2$ is the merged marginal. This step involves no assumption; it merely rewrites $p_e$.

The key lies in the second term. Given TVD, the difference vector $v = p-q$ satisfies “sum of positive parts = sum of negative parts = TVD” and sums to 0, so $|v|^2$ can only run within a fixed interval: most concentrated, $|v|^2 = 4\text{TVD}^2$ (all differences compressed into one cell); most dispersed, $|v|^2 = 4\text{TVD}^2 \cdot c_{\min}$, where $c_{\min}$ is determined by the number of tiers (for three tiers $c_{\min} = 3/8$, for four tiers $1/4$, for five tiers $5/24$). Substituting into the equation, $p_e$ is squeezed between $[S – \text{TVD}^2, S – \text{TVD}^2/3]$, with width on the order of $\text{TVD}^2$.

Thus $p_e$ is not the second independent parameter; it equals “heterogeneity minus divergence.” Let $H = 1 – S$; $H$ is “the probability that two randomly drawn cases have different true adjudication tiers”—the most common heterogeneity indicator in adjudication problems (diversity in the Simpson sense). Actual measurement best illustrates the point: with the same $H = 0.5592$ and $\text{TVD} = 0.05$, compressing the difference into three different cells respectively, the calculated $\kappa_{\text{max}}$ is all $0.9108$, not differing by even one decimal place. Where it concentrates, which tier is the majority—all do not affect anything. $\kappa_{\text{max}}$ is simply a binary function of $(H, \text{TVD})$; no third independent variable plays a role.

This reverses the previous concern. It feared “whether correlation between two parameters would distort warnings for high-consistency regions.” In fact, they are not “correlated”; they are algebraically the same thing: when $H$ is fixed, as TVD rises, $p_e$ must fall (because $|v|^2$ must increase accordingly), with slope on the order of $-\text{TVD}/2$. This is not empirical correlation but a consequence of the identity. Our 20,000 simulations based on “actual study distribution” yield $r(\text{TVD}, p_e) = -0.074$—almost no correlation. But that number carries no information content: it is entirely determined by the assumed sampling range; change the range, and the number changes. When a correlation coefficient can be arbitrarily manipulated by constructed distribution, hanging the criterion on it is wrong.

Conversely, the two-tier case most clearly reveals the bottom line. With two tiers, $c$ is constantly $1/2$ (in 50,000 random marginal tests, the variance of $c$ is 0), so $p_e = S – \text{TVD}^2/2$ is an identity, and $p_e$ has zero degrees of freedom outside $(m, \text{TVD})$. That is, the simpler the adjudication design, the more redundant $p_e$ becomes; it looks like an independent parameter only because algebra loosens slightly as the number of tiers increases.

How much does it loosen? With three tiers, $H = 0.45$, $\text{TVD} = 0.10$, the shape-induced swing in $\kappa_{\text{max}}$ is $0.0006$; even with $\text{TVD} = 0.20$, it is only $0.0046$. As contrast, with the same $\text{TVD} = 0.10$, reducing $H$ from $0.80$ to $0.15$ causes $\kappa_{\text{max}}$ to drop from $0.876$ to $0.352$. Changing shape moves $0.0006$, changing heterogeneity moves $0.52$—a difference of three orders of magnitude. The entire section in the previous post spent on “residual span increasing with $\bar{m}$” caught the wrong object in terms of magnitude: what truly determines how much consistency is wasted is not where the adjudication tiers concentrate, but how hard these cases themselves are to distinguish.

The amplification relationship also has a clean reading: with the same TVD, compressing $H$ from $0.80$ to $0.15$ amplifies harm by $5.1–5.3$ times, almost constant. This is because harm is approximately $\text{TVD}/H$—dividing TVD by “difference between cases” yields a dimensionless divergence rate. When $H = 0.45$, $\text{TVD}/H = 0.03/0.06/0.12/0.25/0.50$ correspond to harms $0.030/0.060/0.120/0.247/0.478$. This is nearly a straight line with slope about 1. In adjudication studies, a 5-percentage-point tolerance corresponds to only $0.75$-percentage-point TVD tolerance when $H = 0.15$—this is the true source of “warnings for high-consistency regions,” independent of marginal shape.

The other half of the previous concern is also resolved. It feared that positive bias in $\widehat{\text{TVD}}$ and bias in $\widehat{p_e}$ would partially offset each other in $\kappa_{\text{max}}$, requiring overall correction of the number “bias $-0.105$ when $n = 71$. Splitting the bias into two paths: TVD path (fix $p_e$, replace with $\widehat{\text{TVD}}$) and $p_e$ path (fix TVD, replace with $\widehat{p_e}$). With true $\text{TVD} = 0.03$ and $n = 71$, total bias is $-0.1076$, where TVD path contributes $-0.1066$ and $p_e$ path $-0.0004$—the TVD path accounts for 99.6%. When $\text{TVD} = 0.08$, it accounts for 98.2%. Even at $n = 400$, it remains 98.8%. The so-called offset ratio is not 50%, but 1.3%: the $p_e$ path is too small to constitute an offset quantity. This is because the partial derivative of $\kappa_{\text{max}}$ with respect to $p_e$ is suppressed by $(1-p_e)^2$, while the magnitude of $p_e$ itself is only $0.3–0.5$.

Incidentally, we discover that the bias in $\widehat{\text{TVD}}$ is quite large: when true $\text{TVD} = 0$, with $n = 71$ the average estimate is $0.0884$, dropping to $0.0135$ only at $n = 3,000$. This means a truly perfectly aligned adjudication system would be reported as “marginal divergence of 8.8 percentage points” in a sample of 71 cases. This term directly enters $\kappa_{\text{max}}$; converting via $-\text{TVD}/H$, when $H = 0.45$ it reaches a ceiling of $-0.196$—heavier than the reported “$-0.105$.” The $-0.105$ reported previously corresponds to the specific true value $\text{TVD} = 0.03$, not the general case.

Finally, the hardest criterion itself from the previous post cannot be executed: “Take $\ge 8$ three-tier adjudication raw tables, calculate $(\text{TVD}, p_e)$ point-by-point, if absolute value of correlation coefficient $> 0.6$ recalculate curve, $< 0.3$ report independently.” With eight tables, the 95% interval of $r$ is $[-0.703, +0.705]$; when true $r = 0.6$, probability of correct judgment is $55.2\%$, when true $r = 0.3$ it is $40.8\%$—probability of correct judgment is slightly better than flipping a coin. Expanding to 120 tables, true $r = 0.6$ yields $51.1\%$ correct judgment, true $r = 0.3$ yields $49.6\%$, because the criterion line sits exactly on both tails of the null hypothesis distribution; adding samples does not solve the problem. And according to this round’s algebra, this correlation should not be measured at all—it measures a quantity dominated by constructed distribution.

Evidence and Limitations

Verified (pure algebra, reproducible):
– Identity $p_e = S – |p-q|^2/4$, zero bias across 300,000 random three-tier marginals.
– Feasible interval for $p_e$: $[S – \text{TVD}^2, S – 3\text{TVD}^2/8]$ (three tiers), zero out-of-bound across 400,000 grid points. General formula for $K$ tiers: $c_{\min} = (1/4)(1/\lceil K/2 \rceil + 1/\lfloor K/2 \rfloor)$, all $K = 2\ldots8$ match actual measurement (for $K=2$, variance of $c$ is 0).
– $\kappa_{\text{max}}$ depends only on $(H, \text{TVD})$: different concentrated cells under same $(H, \text{TVD})$ yield identical $\kappa_{\text{max}}$; shape bandwidth is only $0.0046$ at three-tier $\text{TVD} = 0.20$.
– Harm $\approx \text{TVD}/H$, slope about 1; $H$ from $0.80$ to $0.15$ amplifies harm by $5.1–5.3$ times.
– Bias decomposition: TVD path accounts for $98–99.7\%$, $p_e$ path $< 2\%$, offset ratio nearly 1 (i.e., no offset).

Partially verified:
– Magnitude of positive bias in $\widehat{\text{TVD}}$ (true value $0$ estimated as $0.088$ when $n=71$) comes from independent binomial sampling simulation, sharing the same drift-floor reasoning as #1404, but not yet cross-validated by joint bootstrap on real three-tier tables.
– $H = 1 – S$ as proxy for “case difficulty” is isomorphic to classic Simpson diversity, but in adjudication problems “true tiers” are unobservable; $H$ can only be estimated from merged marginals, and this estimation error is not calculated in this round.

To be verified:
– How large is the sampling error of $H$, and what proportion of $\kappa_{\text{max}}$ error budget does it consume—if $H$ itself is poorly estimated, the ratio “harm = TVD/H” will amplify errors from both paths into an even worse quantity.
– Whether adjudication tiers are ordered (light/medium/heavy), while TVD and $H$ are both unordered indicators, losing the distinction between “off by one tier vs off by two tiers”; in ordered cases, is $H$ still sufficient or must it be replaced by cumulative distribution differences, unverified.
– The resolvability result for 8 tables was calculated using Fisher $z$ approximation; the joint distribution of $(\text{TVD}, p_e)$ on real three-tier tables is not bivariate normal, so actual adjudicative power may be even worse.

L1 Network Status: No corresponding edges found in full retrieval of CORRESPONDENCE_NETWORK.md and EDGE_TABLE_science-yixue.md for terms “TVD / marginal / ceiling / $p_e$ / consistency / reliability / adjudication”. The only relevant hit is §3.8 “E-060 label premise” row (status conflict, discussing “low diagnostic consistency among TCM physicians vs statistical misuse leading to underestimation”—this label reliability premise), whose semantics is “whether grouping labels are reliable,” not “which quantities determine the ceiling”; all other hits are irrelevant (row 192 “sheng-ke consistency” refers to Five Phases sheng-ke direction, physical side row 57 “phase/rhythm” refers to two oscillators phase-locked). Edge table stops at E-050; alignment indicator row states “L2 and above edge count: 0.” This topic has not yet entered the L1 correspondence network.

Related Reading

Evidence Level: C
References: PMID 8501467, PMID 8621993, PMID 23776034, PMID 25168681, PMID 37127220, PMID 38283651

Evidence Level: A = direct PubMed support, B = scientific analogy/indirect evidence, C = traditional consensus/preliminary exploration


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *