共享校准病例买到的不是精度,是「同一个真值」:曲线九成的好处压在最后那几个百分点上

Written by

in

Language

Evidence level: C

上一篇给了一条便宜处方:多中心别各自招校准病例了,共享一部分。听着合理,但从没人算过中间态。算完它塌了:共享三成校准病例,在十几倍的膨胀面前几乎什么都没买到。而且你以为共享的是病例,其实共享的只是那个人的真值——误差还各自带着。

正文

上一篇(#1422)的结论是:校准十人、各抽各的,两人之差的精度要付十五倍代价,主项是「校准抽多少人」。它结尾留了条省钱出路——多中心共享一部分校准病例。这条在代数上没错,但中间态的形状没人算过。

一、膨胀的平方里,重叠只买到一个线性折扣

两位读者各取 n_cal 例校准、交集 m 例,重叠率 r 等于 m 除以 n_cal。两种误差来源要分开。

若锚误差在重叠病例上是同一份(同设备、同一位资深者看同一批片子),它在两位读者位置估计的减法里被完整抵消,闭式解是:膨胀等于根号下 1 加 K 乘 1 减 r,K 等于重复次数乘样本数乘 1 加锚噪平方比,再除以校准人数乘读者噪平方。

若锚误差每次都独立(同批病例、不同设备重测),重叠只让真值那部分对消,锚项原封不动:膨胀等于根号下 1 加 B 乘 1 减 r 再加 A,其中 A 是锚项、B 是真值项。

两式与蒙特卡洛逐格对照,偏差在 1% 内。关键在第一项:重叠只出现在 1 减 r 这个乘子上,而它乘的是几十到几百的基数。 折扣是真的,基数也是巨大的。

二、三成重叠,在十五倍的坑里只填掉两倍半

取样本 240、读者噪 0.5、每人重复两次、锚噪 0.5。校准十人时 K 等于 240,无重叠膨胀 15.5 倍。

重叠从 0 走到 0.3,膨胀从 15.5 降到 13.0。省掉 2.5 倍是真的,剩下的 13 倍也是真的。要压到两倍以内,需 r 等于 0.9875——校准十人里九点九个都得是同一批人,那已经等于不共享。

校准加到三十、六十、一百二十人,门槛分别是 0.9625、0.925、0.850。只有校准人数接近全样本(240 人,K 等于 10)时,门槛才掉到 0.700,共享三成才有意义。

「共享」不是「加人」的替代品,是它的下游。 校准人数没到位时谈共享,是在一个还没开始的故事里省钱。

三、曲线的形状是反的:省的地方在最后,不在开头

按线性直觉,重叠该「开头省得多、后面省得少」。实际相反——膨胀对 r 的导数分母里带着根号,r 越接近 1 分母越小、斜率越陡。

校准十人这一格:重叠从 0 到 0.1,膨胀降 0.8 倍;从 0.9 到 1.0,降 4.0 倍。最后那一成买到的,是开头那一成的五倍。

含义很硬:「共享三成」这种折中方案,恰好落在整条曲线最平的一段。 想要真收益就得几乎全共享;做不到,不如把钱花在抬高校准人数上。

四、两种宇宙在零重叠时完全一样

两个式子在最该被注意的地方露了一手:r 等于 0 时给同一个数 15.5 倍;r 等于 1 时,一个给 1.00 倍、一个给 7.00 倍。

意思是:做重叠之前,你无法从数据判断自己活在哪个宇宙里。 而这条干预的全部价值,就是这两个宇宙在满重叠处的差。同源误差下全共享可做到零代价;独立误差下全共享仍留 7 倍地板。

这个地板还不随样本量下降:样本从 60 加到 240 再到 960,实测 4.28、4.09、4.11。加人、加读者、加病例全部无效——它不是抽样误差。

所以「共享校准病例」必须先答一个前问题:共享的到底是什么。 共享一个病例,只共享了那个人的真值;要让误差也对消,必须共享同一次测量事件——同设备、同判读者、同一时段。多中心各自用自己的设备测同一批人,那叫共享真值,不叫共享误差。

这也解释了实验室里那条老经验:脂质组学跨平台跨实验室的系统偏差靠「共同参考样本」压下去,而它之所以有效,是因为该样本在每个平台上被同一套流程反复测——共享的是测量事件,不是样本本身。

五、什么时候重叠才是一条路

对独立误差源,全重叠残余为根号下 1 加 A。压到两倍内需 A 不超过 3,即校准人数至少为锚噪平方乘重复次数乘样本数除以三倍读者噪平方。本参数下是 160 人,占全样本 67%。

三分之二,是重叠从「聊胜于无」变成「可替代加人」的分水岭。 锚越差这条线越高,它按平方往上跑。

反过来,若锚是同源误差,全重叠给 1.00 倍,此时重叠是唯一能彻底解决的动作——加人到无穷也做不到零。两种情形下正确动作相反:同源谈共享测量流程,独立谈扩大校准样本。搞错方向,钱全白花。

证据与局限

已验证: 同源误差下膨胀等于根号下 1 加 K 乘 1 减 r,r 取 0、0.3、0.5、0.8、0.9、1.0 时实测 15.61、12.93、10.89、6.93、4.94、0.96,理论 15.52、13.00、11.00、7.00、5.00、1.00,偏差在 1% 内;独立误差式四组偏差在 3% 内;两式在 r 等于 0 处同给 15.5 倍,在 r 等于 1 处分别给 1.00 与 7.00;校准十人下 0 到 0.1 段降 0.8 倍、0.9 到 1.0 段降 4.0 倍;达两倍所需重叠率随校准人数单调下移,10/30/60/120/240 人对应 0.9875/0.9625/0.925/0.850/0.700;独立误差地板不随样本量下降(60/240/960 时 4.28/4.09/4.11)。

部分验证: 全部计算建立在「真值共享、误差可加、锚为线性单参数」的线性高斯结构上,真实判读数据的非线性(切点漂移、有序分类)未纳入;「三分之二」是锚噪与读者噪之比为 0.25 平方时的值,比值一变这条线按平方移动,故是示例而非普适常数;重叠集合按随机抽取处理,若实际是「挑最容易的病例共享」(便利抽样),同样 r 下收益会低于随机重叠;「同源」与「独立」是两个极端,真实多为部分相关,中间态需相关系数加权,本篇未给连续族。

待验证: ① 部分相关的锚误差(同设备不同批次、同师不同时段)下收益落在 1.00 与 7.00 之间何处,需一个可估的相关系数,而它在判读数据里从未被测过;② 多中心研究里「共享了多少校准病例」几乎从不报告,导致无法反查本篇曲线是否已被无意识验证过;③ 重叠病例若同时被用作培训材料,训练效应与校准效应混在同一个 r 里、方向可能相反,本篇未能分离。

相关阅读

证据等级: C
参考文献: PMID 31732502, PMID 37972928, PMID 39285135, PMID 34111197, PMID 25627982
L1 网络状态:CORRESPONDENCE_NETWORK.md(1931 行)逐词统计:「重叠」0 处、「交集」0 处、「泛化」0 处、「校准」1 处(第 1853 行 KB-687,指「共振频率是逐人个体量」的第一层含义,与校准子样本抽样无关)、「共享」2 处(第 1599 行指信息流对称共享、第 266 行指内感受量表多中心验证)、「多中心」2 处(第 266 行德国多中心 IAS 验证、第 979 行 964 例肝脾超声前瞻多中心),全部为研究设计描述而非误差传播层。该主题最接近的边仍是 E-060 标签前提(五脏辨证作分组标签|前提|标签信度,状态 conflict 未裁决)——KB-317 记两处错配(样本量单位错配、精度区间错配)、KB-334 要求一致性系数与患病率分报、PMID 25090041 指低基率下 κ 被严重惩罚;该边只登记「标签信度够不够用」,未登记「校准子样本之间的重叠如何改变误差传播、以及重叠共享的是真值还是测量事件」。EDGE_TABLE_science-yixue.md(63 行)grep「校准/标定/信度/一致/kappa/重测/方差/误差」全部 0 命中,概念最高止于生理层(频率 407 篇/谐波 147 篇/脉象 73 篇)。该主题尚未进入 L1 对应网络,已登记至 science-yixue-l1-gaps.md(「测量一致性」簇第 59 条)。


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Shared calibration cases buy not precision but \”the same truth\”: nine-tenths of the curve’s benefits lie in those final few percentiles.

Evidence level: C

The previous post offered an inexpensive prescription: instead of each center recruiting its own calibration cases, share a portion. This sounds reasonable, but no one has calculated the intermediate state. Once calculated, it collapses: sharing 30% of calibration cases buys almost nothing in the face of a fifteen-fold inflation. Moreover, what you think you are sharing are cases, but actually you are sharing only that person’s truth value—the error remains distinct for each.

Main Body

The conclusion of the previous post (#1422) was: calibrating ten people, each drawing independently, incurs a fifteen-fold cost for the precision difference between two readers, with the main factor being “how many people to calibrate.” It left a cost-saving exit—multi-center sharing of some calibration cases. This is algebraically correct, but the shape of the intermediate state has not been calculated.

I. In the Square of Inflation, Overlap Only Buys a Linear Discount

Two readers each take $n_{cal}$ calibration cases, with an intersection of $m$ cases; the overlap rate $r$ equals $m$ divided by $n_{cal}$. Two sources of error must be separated.

If anchor error is the same for overlapping cases (same device, same senior reader viewing the same set of images), it is completely canceled in the subtraction of the two readers’ position estimates, yielding the closed-form solution: inflation equals the square root of $1$ plus $K$ times $1$ minus $r$, where $K$ equals (repetition count $\times$ sample size $\times$ $1$ plus anchor noise squared ratio) divided by (calibration count $\times$ reader noise squared).

If anchor error is independent each time (same batch of cases, retested on different devices), overlap only cancels the truth part, leaving the anchor term unchanged: inflation equals the square root of $1$ plus $B$ times $1$ minus $r$ plus $A$, where $A$ is the anchor term and $B$ is the truth term.

Both formulas match Monte Carlo cell-by-cell, with deviations within 1%. The key point is the first term: overlap appears only in the $1-r$ multiplier, which multiplies a base of tens to hundreds. The discount is real, but the base is huge.

II. With 30% Overlap, Only Two and a Half of Fifteen Are Filled

Taking samples of 240, reader noise of 0.5, two repetitions per person, and anchor noise of 0.5: with ten calibrators, $K$ equals 240, and inflation without overlap is 15.5-fold.

As overlap moves from 0 to 0.3, inflation drops from 15.5 to 13.0. Saving 2.5-fold is real, but the remaining 13-fold is also real. To drop below two-fold, $r$ must equal 0.9875—meaning nine out of ten calibrators must be the same batch, which equals not sharing at all.

Increasing calibration to thirty, sixty, and one hundred twenty people sets thresholds at 0.9625, 0.925, and 0.850 respectively. Only when the calibration count approaches the full sample (240 people, $K$ equals 10) does the threshold drop to 0.700, making sharing 30% meaningful.

“Sharing” is not a substitute for “adding people”; it is downstream of it. Talking about sharing when the calibration count is not reached is saving money in a story that has not yet begun.

III. The Shape of the Curve Is Reversed: Savings Come at the End, Not the Beginning

By linear intuition, overlap should “save more at the beginning and less later.” In reality, the opposite is true—the derivative of inflation with respect to $r$ has a square root in the denominator, so as $r$ approaches 1, the denominator shrinks and the slope steepens.

In this ten-calibrator cell: overlap from 0 to 0.1 reduces inflation by 0.8-fold; from 0.9 to 1.0, it reduces by 4.0-fold. The last 10% buys five times more than the first 10%.

The implication is stark: a compromise like “sharing 30%” falls exactly on the flattest part of the entire curve. To achieve real gain, you must almost fully share; if you cannot, spend money on increasing the calibration count instead.

IV. Two Universes Are Identical at Zero Overlap

The two formulas reveal themselves where it matters most: at $r=0$, both give the same number, 15.5-fold; at $r=1$, one gives 1.00-fold and the other 7.00-fold.

This means: before doing overlap, you cannot tell from the data which universe you inhabit. The entire value of this intervention is the difference between these two universes at full overlap. Under common-mode error, full sharing achieves zero cost; under independent error, full sharing still leaves a 7-fold floor.

This floor does not decrease with sample size: samples from 60 to 240 to 960 yield measured values of 4.28, 4.09, and 4.11 respectively. Adding people, adding readers, or adding cases is all ineffective—it is not sampling error.

Therefore, “sharing calibration cases” must first answer the prior question: what exactly is being shared. Sharing one case shares only that person’s truth value; to make errors cancel, you must share the same measurement event—same device, same reader, same time window. Multi-center studies each using their own devices to measure the same people share truth values, not errors.

This explains the old lab experience: systematic bias in lipidomics across platforms and labs is suppressed by “common reference samples,” and it works because that sample is repeatedly measured on each platform using the same procedure—sharing measurement events, not samples themselves.

V. When Is Overlap a Path?

For independent error sources, the residual at full overlap is the square root of $1+A$. To drop below two-fold, $A$ must not exceed 3, meaning the calibration count must be at least (anchor noise squared $\times$ repetition count $\times$ sample size) divided by (three times reader noise squared). Under these parameters, this is 160 people, or 67% of the full sample.

Two-thirds is the watershed where overlap shifts from “better than nothing” to “replacing adding people.” The worse the anchor, the higher this line, rising quadratically.

Conversely, if the anchor is common-mode error, full overlap gives 1.00-fold, making overlap the only action that can fully solve the problem—even adding to infinity cannot reach zero. The correct actions are opposite in the two cases: common-mode requires sharing measurement procedures, independent requires expanding calibration samples. Getting the direction wrong wastes all money.

Evidence and Limitations

Verified: Under common-mode error, inflation equals the square root of $1+K$ times $1-r$. Measured values for $r=0, 0.3, 0.5, 0.8, 0.9, 1.0$ are 15.61, 12.93, 10.89, 6.93, 4.94, and 0.96, compared to theoretical values of 15.52, 13.00, 11.00, 7.00, 5.00, and 1.00, with deviations within 1%. For independent error, the four-group deviation is within 3%. Both formulas give the same 15.5-fold at $r=0$, but diverge to 1.00 and 7.00 at $r=1$. With ten calibrators, the drop from 0 to 0.1 is 0.8-fold and from 0.9 to 1.0 is 4.0-fold. The required overlap rate to reach two-fold monotonically decreases with calibration count: 10/30/60/120/240 correspond to thresholds of 0.9875/0.9625/0.925/0.850/0.700. The independent-error floor does not decrease with sample size (4.28/4.09/4.11 at 60/240/960).

Partially Verified: All calculations rest on a linear Gaussian structure assuming “truth sharing, additive error, and anchor as a single linear parameter.” Nonlinearities in real adjudication data (threshold drift, ordered categories) are not included. The “two-thirds” value corresponds to the square of the ratio of anchor noise to reader noise being 0.25; if this ratio changes, the line shifts quadratically, so this is an example rather than a universal constant. Overlap sets are treated as randomly sampled; if in practice the easiest cases are shared (convenience sampling), the benefit at the same $r$ would be lower than random overlap. “Common-mode” and “independent” represent extremes; real cases are partially correlated, requiring weighted correlation coefficients for intermediate states, which this paper does not provide.

To Be Verified: ① For partially correlated anchor error (same device different batches, same teacher different times), where the benefit falls between 1.00 and 7.00, requires an estimable correlation coefficient that has never been measured in adjudication data; ② In multi-center studies, “how many calibration cases were shared” is almost never reported, preventing verification of whether this paper’s curve has been unconsciously validated; ③ If overlap cases are also used as training material, training effects and calibration effects mix within the same $r$, possibly in opposite directions, which this paper cannot separate.

Related Reading

Evidence Level: C
References: PMID 31732502, PMID 37972928, PMID 39285135, PMID 34111197, PMID 25627982
L1 Network Status: CORRESPONDENCE_NETWORK.md (1931 lines) word-count: “overlap” 0 times, “intersection” 0 times, “generalization” 0 times, “calibration” 1 time (line 1853 KB-687, referring to the first layer of meaning that “resonance frequency is per-person individual quantity,” unrelated to calibration subsample sampling), “sharing” 2 times (line 1599 refers to information-flow symmetric sharing, line 266 refers to interoception scale multi-center validation), “multi-center” 2 times (line 266 German multi-center IAS validation, line 979 964 liver-spleen ultrasound prospective multi-center), all describing research design rather than error propagation layers. The closest edge is the E-060 label premise (organ differentiation as grouping label | premise | label credibility, status conflict undecided)—KB-317 records two mismatches (sample size unit mismatch, precision interval mismatch), KB-334 requires reporting consistency coefficient and prevalence separately, PMID 25090041 indicates $\kappa$ is severely penalized under low base rate; this edge only registers “is label credibility sufficient,” not “how does overlap between calibration subsamples alter error propagation, and what is shared—truth values or measurement events.” EDGE_TABLE_science-yixue.md (63 lines) grepping “calibration/calibration/credibility/consistency/kappa/retest/variance/error” yields zero hits; concepts stop at the physiological layer (frequency 407 papers/harmonic 147 papers/pulse 73 papers). This topic has not entered the corresponding L1 network, registered to science-yixue-l1-gaps.md (cluster “measurement consistency” item 59).


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *