Evidence level: B
池③ 里有一张卡,思路是这样:单模型判证候,置信度低于阈值时,触发 CNN/RNN 多模型加权平均,提升整体预测质量。
这句话听起来无懈可击。但把门槛装上、把模拟跑完,会看到两件反直觉的事:门槛筛出的那批样本,四分之三本来就判对了;而真正需要融合的那批,只有四分之一落在门里。
一、先把这张卡的做法写成可算的形式
原设计(#75)有两个部件,各自选了一个变量:
| 部件 | 作用 | 原设计用的变量 |
|---|---|---|
| 门(gate) | 决定”哪些样本要动用多模型” | 单模型置信度 p̂ < τ(阈值 0.60) |
| 权(weight) | 决定”动用时各模型话语权” | 各模型自己的置信度,w ∝ p̂ |
两个部件都指向同一个量:p̂。这一点后面会变成本文最硬的一条。
模拟设置(全部本库自行执行,百万级样本):五个证候类,单模型准确率 0.90,三个融合模型之间错误相关性 ρ_e 取 0.5–0.9(脉象仪这类同一传感链、同一套谐波分解、同一批标注的模型,错误高度相关是常态而非例外)。ρ_e 的定义是”给定样本会错时,三个模型一起错的概率”。
二、第一个数字:融合到底值多少
先把”多模型融合”的总收益摆在桌上,单位是百分点(pp):
| ρ_e | 单模型 | 等权 K=3 | 加权 K=3 | 等权增益 | 加权增益 |
|---|---|---|---|---|---|
| 0.50 | 0.9249 | 0.9298 | 0.9382 | +0.49 pp | +1.33 pp |
| 0.70 | 0.9212 | 0.9247 | 0.9274 | +0.35 pp | +0.62 pp |
| 0.80 | 0.9159 | 0.9185 | 0.9191 | +0.26 pp | +0.32 pp |
| 0.90 | 0.9092 | 0.9097 | 0.9103 | +0.06 pp | +0.12 pp |
读法:ρ_e = 0.8 时,三个模型融合把准确率从 91.6% 抬到 91.9%。加权比等权多 0.06 pp。
0.06 个百分点,在 n=200 的测试集上是 0.12 个样本。这不是”误差范围内”的问题,而是这个数比随机种子引起的波动还小。也就是说:#75 里”加权”这个动作,本身没有可测的收益。
原因在第三节。
三、加权为什么白做:门和权用了同一个数
这是本轮唯一的新判断,写成一句可执行的话:
同一个统计量,不得同时用于"准入"和"加权"。
用在准入上,它决定"谁进来";用在加权上,它决定"进来后谁说话大声"。
两处用同一个带噪量 ⇒ 同一份噪声被用了两次,且方向一致(p̂ 低者既被选中、又被降权)。
于是子集内的权重差异,测的是"被选中的程度",不是"模型能力的差异"。
实测:在 ρ_e = 0.8、K = 3 下,加权相对等权的输出改动量(RMS)是 0.0314,而融合相对单模型的收益量(RMS)是 0.3652——加权的全部动作只相当于融合收益的 8.6%,其余 91.4% 是把三个模型等权平均这件事本身给的。
而这份 8.6% 的改动,注入的还是带噪置信度。模拟里权重偏离等权的 L1 距离是 0.096(ρ_e 噪声 0.05)到 0.141(噪声 0.20)——权重确实在动,动的方向来自置信度的随机起伏,不是能力。
再补一刀:在触发子集内,p̂ 的平均值被系统性压低(E[p̂]=0.359 而 E[p] = 0.476)。因为门就是”p̂ 低”筛出来的,子集内的 p̂ 自然整体偏低。 这时候再用 p̂ 加权,等于在一个已经按 p̂ 排序过的子集里,再按 p̂ 排一次序。
四、第二个数字:门槛筛出来的是谁
这是本文最该记住的一张表。同一批数据,三种门,ρ_e = 0.8:
| 门 | 触发率 | 门内单模型准确率 | 门内融合后 | 门内净增益 |
|---|---|---|---|---|
置信度低 p̂ < 0.60 |
26.1% | 0.7453 | 0.7538 | +0.84 pp |
| 三模型不全一致 | 8.5% | 0.0672 | 0.0965 | +2.93 pp |
| 有模型偏离多数票 | 8.5% | 0.0672 | 0.0965 | +2.93 pp |
置信度门的门内准确率是 0.755——也就是说,被门槛判定为”需要救助”的样本里,四分之三单模型本来就答对了。
而那些真正判错的样本(门内准确率 0.067,即 93% 是错的),只有 8.5% 落在分歧门上。
更狠的是两个门的重合度:Jaccard = 0.226。置信度门里只有 24.4% 被分歧门覆盖。 两个门抓的是两批不同的人。
五、为什么两个门不重合:低置信度不等于难样本
机制很直白。
分歧门测的是”三个模型给出了三个不同答案”——这件事只有在模型真的处理不了这个样本时才会发生。所以门内准确率 0.067,几乎是纯错误集合。
置信度门测的是”单模型自己的 p̂ 低”。但 p̂ 有两个来源的波动:① 样本真的难;② 模型自己的随机性(树的切分、自助采样、特征子采样)。当 ρ_e 高的时候,三个模型在同一批样本上一起错、或者一起在同一个地方犹豫——这时候”三个模型一致地说’我不确定’”经常发生在一个它们其实答对了的样本上。
于是:门内 74.5% 的样本,是”模型谦虚但实际上答对了”。融合处理它们的动作,是把已经正确的答案再确认一遍——这不是纠错,是重复确认。
六、K 的天花板:加模型不是路
等权融合的方差增益有解析式:
增益(K) = K / [1 + (K-1)·ρ_e] 上限 = 1/ρ_e (K → ∞)
| ρ_e | 天花板(方差) | K=3 取到 | K=10 取到 |
|---|---|---|---|
| 0.60 | 1.667× | 81.8% | 93.8% |
| 0.80 | 1.250× | 92.3% | 97.6% |
| 0.90 | 1.111× | 96.4% | 98.9% |
ρ_e = 0.8 时,三个模型已经吃掉了天花板的 92.3%;从 3 个加到 10 个,只多拿 5.3 个百分点。对应的准确率:K=3 是 0.9181,K=10 是 0.9198,+0.17 pp,而模型数翻了 3.3 倍。
加模型不是提升路径。降 ρ_e 才是。 而 ρ_e 高恰恰是”同一台仪器、同一套特征、同一批标注”的必然结果——这正好是池③ 反复撞到的那堵墙(参见 #76 的跨设备迁移与分辨率下限)。
七、那正确的结构长什么样
把上面的数拼起来,可执行的版本是这样:
门 = 分歧(三模型预测不一致) 触发率 8.5%,门内准确率 0.067
权 = 等权 不用 p̂ 加权
K = 3 已吃掉 92.3% 天花板,不必再加
它的总额外收益:8.5% × 2.93 pp ≈ 0.25 pp,与全域等权融合的 0.25 pp 几乎完全相同——但只动了 8.5% 的样本,计算量与调用次数降一个数量级。
这就是本文能给出的最有用的东西:不是”要不要融合”,而是”融合只在分歧时触发,且触发后不要按置信度加权”。
八、证据与局限(必读)
证据等级 B,不是 A。 理由:所引 6 条 PMID 全部真实、全部经 NCBI E-utilities 逐条比对标题与作者回查通过(见下方核验表),但无一条直接研究”脉诊多模型融合的门控变量该用置信度还是分歧”。文献提供的是各组件(概率校准、弃权判据、集成多样性、门控混合专家)的一般性支撑,本文的拼接与全部数值是本库自行推导与模拟的结果。
四条硬局限,不得省略:
- 全部是模拟,没有一次实测。 每个 pp 差值都是”在设定结构下必然出现的量级”,不是”实测提升”。真实脉象仪数据的
ρ_e、p̂的校准程度、五个证候的真实可分性,一个都还没测。 ρ_e是被假设的,不是被估计的。 本文横扫 0.5–0.9 是为了说明”结论对ρ_e的依赖形状”,不是因为知道脉象仪模型的ρ_e是多少。若实测ρ_e = 0.5,加权确实有 +1.33pp(比等权多 0.84pp),本文”加权白做”的结论在这一区就弱化了。- 错误结构是人为设定。 模拟里”会错的样本”是随机分配的,真实数据里难样本是聚集的(某些证候、某些年龄段、某些体型)。聚集会让分歧门的触发率与门内准确率都改变。
p̂假定为”已校准”。 若p̂本身严重失校准(这在随机森林上很常见,见 Mehrtash 2020、Murugesan 2023),则”置信度门”抓到的甚至不是”模型不确定”,而是”校准曲线在那一端的斜率”。这一层本文没有拆开算。
不许做的推论(三条):
- 不许把这篇文章读成”多模型融合没用”。它读作”在
ρ_e高的情况下融合的边际很小,且加权几乎为零“。 - 不许把这篇文章读成”置信度不可靠”。置信度作为报告不确定性的量仍然必要,问题只出在把它同时用于准入与加权。
- 不许把 0.25 pp / 0.06 pp 当成”实测结论”引用。它们是假设结构下的量级推演。
健康相关声明:本文涉及中医证候的机器判定,属高风险主题。任何模型输出都不构成诊断、不构成治疗建议、不得替代执业医师判断。中医证候的判定标准本身在学界尚未统一(这是池③ 长期未解的 #78 号课题),在这个前提下讨论”融合提升 0.25 pp”必须同时说明:被提升的那个”准确率”,其标签本身的可信度还没有被确立。
九、引文核验(6 条,全部 2026-11-02 回查)
| 编号 | PMID | 真值(比对标题 + 作者,不只验号存在) | 用途 |
|---|---|---|---|
| A1 | 32746129 | Mehrtash A, Wells WM, Tempany CM, Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentation, IEEE Trans Med Imaging 2021;39:3868-3878, doi:10.1109/TMI.2020.3006437 | 置信度不等于正确率(校准层) |
| A2 | 37146441 | Murugesan B, Liu B, Galdran A, Calibrating segmentation networks with margin-based label smoothing, Med Image Anal 2023;87:102826 | 置信度需要显式校准(局限 4 的依据) |
| A3 | 33571099 | Perales-Gonzalez C, Fernandez-Navarro F, Carbonero-Ruz M, Global Negative Correlation Learning: A Unified Framework for Global Optimization of Ensemble Models, IEEE Trans Neural Netw Learn Syst 2022;33:4031-4042 | 集成增益取决于成员间负相关/多样性(第六节依据) |
| A4 | 19171521 | Soda P, Iannello G, Aggregation of classifiers for staining pattern recognition in antinuclear autoantibodies analysis, IEEE Trans Inf Technol Biomed 2009;13:322-329 | 医学分类器聚合的早期实证(融合确实有效,但未分离门控变量) |
| A5 | 38322152 | Hashimoto N, Hanada H, Miyoshi H, Multimodal Gated Mixture of Experts Using Whole Slide Image and Flow Cytometry for Multiple Instance Learning Classification of Lymphoma, J Pathol Inform 2024;15:100359 | 门控混合专家在医学分类的实际用法(对照) |
| A6 | 38269963 | Millar AS, Arnn J, Himes S, Uncertainty in Breast Cancer Risk Prediction: A Conformal Prediction Study of Race Stratification, Stud Health Technol Inform 2024;310:991-995 | 以”覆盖-精度”替代单点阈值报告不确定性的做法 |
按 R11(零参数判据只可证伪、不可验证):本文的”分歧门优于置信度门”是在同一模拟结构下的内部比较,它证伪了”置信度门是最佳门控变量”这一默认假设,但不能反过来证明”分歧门是正确门控”——换一个错误结构(难样本聚集、三模型异构程度不同),排序可能翻转。这条界限必须与结论一起读。
按 R18(断言充分性分层报):本文的 0.25 pp / 0.06 pp 全部建立在”ρ_e 已知且恒定”之上;而 ρ_e 恰恰是唯一没有实测的量。结论的精度远高于输入的精度——这正是池④ 立的 R26 说的那个病,本次在自己的推理上复发了一次,如实记下。
本文是 draft,未标 accepted,未进 779,未发布。配套实验设计:08-ops/experiments/pool3-confidence-gate-vs-disagreement-gate-fusion.md(P3-EXP-060)。
免责声明
本文属传统知识与现代统计方法的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,也不构成诊断依据,不能替代执业医师的判断与诊疗。文中出现的准确率、百分点差值、触发率等全部数值,均为在文内明示的模拟假设结构下推得的量级,不是实测提升,更不代表任何脉象仪或模型输出具有诊断效力。个体情况差异很大;如有身体不适或健康疑虑,请及时就医并由专业医师判断。
免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。
Only fuse when confidence is below the threshold? Samples filtered by the threshold already got it right three out of four.
Evidence level: B
Pool ③ contains a card with the following rationale: the single model classifies the condition; if confidence falls below the threshold, a CNN/RNN multi-model weighted average is triggered to enhance overall prediction quality.
This sounds flawless. However, once the threshold is implemented and the simulation runs, two counterintuitive facts emerge: three-quarters of the samples filtered out by the threshold were already correctly classified; conversely, only one-quarter of those truly requiring fusion fell within the threshold.
I. First, Express the Card’s Procedure in Calculable Form
The original design (#75) comprises two components, each selecting a variable:
| Component | Function | Variable Used in Original Design |
|---|---|---|
| Gate (门) | Determines “which samples require the multi-model approach” | Single-model confidence p̂ < τ (threshold 0.60) |
| Weight (权) | Determines “the relative influence of each model when activated” | Each model’s own confidence, w ∝ p̂ |
Both components point to the same quantity: p̂. This convergence will become the most critical constraint of this paper.
Simulation Setup (all parameters executed within this repository, using million-scale samples): five syndrome categories; single-model accuracy 0.90; the error correlation ρ_e among the three fusion models ranges from 0.5 to 0.9. (Note: For models sharing the same sensor chain, harmonic decomposition method, and annotation batch—such as pulse waveform analyzers—high error correlation is the norm rather than the exception.) ρ_e is defined as “the probability that all three models err simultaneously given a sample error.”
II. The First Number: How Much Does Fusion Bottom Out to?
First, place the total gain of “multi-model fusion” on the table, measured in percentage points (pp):
| ρ_e | Single Model | Equal-Weight K=3 | Weighted K=3 | Equal-Weight Gain | Weighted Gain |
|---|---|---|---|---|---|
| 0.50 | 0.9249 | 0.9298 | 0.9382 | +0.49 pp | +1.33 pp |
| 0.70 | 0.9212 | 0.9247 | 0.9274 | +0.35 pp | +0.62 pp |
| 0.80 | 0.9159 | 0.9185 | 0.9191 | +0.26 pp | +0.32 pp |
| 0.90 | 0.9092 | 0.9097 | 0.9103 | +0.06 pp | +0.12 pp |
Reading: when ρ_e = 0.8, fusing the three models lifts accuracy from 91.6% to 91.9%. Weighted fusion gains 0.06 pp over equal-weighting.
A gain of 0.06 percentage points corresponds to 0.12 samples on an n=200 test set. This is not a matter of “within error bounds”; rather, this magnitude is smaller than the fluctuation caused by random seed variation. Consequently: the “weighting” operation in #75 itself yields no measurable gain.
The reason lies in Section III.
III. Why weighting is done in vain: Gate and Weight use the same number
This is the only new judgment for this round, stated as an executable sentence:
The same statistic must not be used simultaneously for "admission" and "weighting."
When used for admission, it determines "who enters"; when used for weighting, it determines "who speaks louder after entering."
Using the same noisy quantity in both places ⇒ the same noise is applied twice, and in the same direction (low p̂ is both selected and down-weighted).
Thus, within the subset, differences in weight measure "degree of selection," not "differences in model capability."
Empirical test: Under ρ_e = 0.8 and K = 3, the output change due to weighting relative to equal weighting (RMS) is 0.0314, whereas the gain from fusion relative to single models (RMS) is 0.3652—the entire effect of weighting accounts for only 8.6% of the fusion gain, with the remaining 91.4% arising simply from averaging the three models equally.
Furthermore, this 8.6% adjustment is injected via noisy confidence. In the simulation, the L1 distance of weights from equal weighting ranges from 0.096 (ρ_e noise 0.05) to 0.141 (noise 0.20)—weights do indeed shift, but the direction of shift stems from random fluctuations in confidence, not capability.
To add one more point: within the triggered subset, the average of p̂ is systematically depressed (E[p̂]=0.359 versus E[p] = 0.476). Because the gate selects on “low p̂,” the p̂ values within the subset are naturally overall lower. Using p̂ for weighting then amounts to re-sorting an already p̂-sorted subset by p̂.
IV. The Second Number: Who the Threshold Filters Out
This is the most critical table to remember in this paper. Using the same dataset with three gates and ρ_e = 0.8:
| Gate | Trigger Rate | Single Model Accuracy Within Gate | Accuracy After Fusion Within Gate | Net Gain Within Gate |
|---|---|---|---|---|
Low confidence p̂ < 0.60 |
26.1% | 0.7453 | 0.7538 | +0.84 pp |
| Three models not fully consistent | 8.5% | 0.0672 | 0.0965 | +2.93 pp |
| A model deviates from majority vote | 8.5% | 0.0672 | 0.0965 | +2.93 pp |
The accuracy within the confidence gate is 0.755—meaning three-quarters of the samples flagged by the threshold as “requiring assistance” were already correctly answered by the single model.
Those truly misclassified samples (gate accuracy 0.067, i.e., 93% were wrong) fall into the disagreement gate only 8.5% of the time.
More striking is the overlap between the two gates: Jaccard = 0.226. Only 24.4% of the confidence gate samples are covered by the disagreement gate. The two gates capture entirely different populations.
V. Why Two Gates Do Not Overlap: Low Confidence Does Not Mean Difficult Samples
The mechanism is straightforward.
Divergence Gate measures “three models yielded three different answers”—an event that occurs only when the models truly cannot handle this sample. Thus, the accuracy inside this gate is 0.067, almost a pure error set.
Confidence Gate measures “a single model’s own $\hat{p}$ is low.” Yet $\hat{p}$ fluctuates from two sources: ① the sample is genuinely difficult; ② the model’s own randomness (tree splits, bootstrap sampling, feature subsampling). When $\rho_e$ is high, the three models err together on the same batch of samples or hesitate together at the same spot—in such cases, “three models consistently say ‘I am unsure’” often happens on a sample they actually answered correctly.
Therefore: the 74.5% of samples inside this gate are “models being humble but actually correct.” Processing them involves re-confirming answers that were already right—this is not error correction, it is redundant confirmation.
VI. K’s Ceiling: Adding Models Is Not the Path
The variance gain from equal-weight fusion has an analytical form:
Gain(K) = K / [1 + (K-1)·ρ_e] Upper bound = 1/ρ_e (as K → ∞)
| ρ_e | Ceiling (variance) | Achieved at K=3 | Achieved at K=10 |
|---|---|---|---|
| 0.60 | 1.667× | 81.8% | 93.8% |
| 0.80 | 1.250× | 92.3% | 97.6% |
| 0.90 | 1.111× | 96.4% | 98.9% |
When ρ_e = 0.8, three models already consume 92.3% of the ceiling; increasing from 3 to 10 yields only an additional 5.3 percentage points. Corresponding accuracies: K=3 is 0.9181, K=10 is 0.9198, +0.17 pp, while the number of models increases 3.3-fold.
Adding models is not an improvement path; reducing ρ_e is. A high ρ_e is precisely the inevitable result of “the same instrument, the same feature set, and the same batch of labels”—this is exactly the wall repeatedly encountered in Pool ③ (see #76 on cross-device transfer and resolution limits).
VII. What Does the Correct Structure Look Like
Assembling the numbers above yields this executable version:
门 = 分歧(三模型预测不一致) Trigger rate 8.5%, accuracy inside the gate 0.067
权 = 等权 Equal weighting; do not use p̂ weighting
K = 3 Already consumes 92.3% of the ceiling; no further increase needed
Its total extra gain: 8.5% × 2.93 pp ≈ 0.25 pp, which is almost identical to the 0.25 pp obtained via global equal-weight fusion—yet it engages only 8.5% of the samples, reducing computational load and call count by an order of magnitude.
This is the most useful contribution of this paper: not “whether to fuse,” but “fuse only when disagreement occurs, and once triggered, do not weight by confidence.”
VIII. Evidence and Limitations (Required Reading)
Evidence level B, not A. Reason: all six cited PMIDs are genuine and individually verified via NCBI E-utilities by cross-checking titles and authors (see verification table below), but none directly study “the gating variable for multi-model fusion in pulse diagnosis: confidence or disagreement.” The literature provides general support for the individual components (probability calibration, waiver criteria, ensemble diversity, gating mixture-of-experts); the specific stitching and all numerical values presented here are derived and simulated within this repository.
Four hard limitations, not to be omitted:
- All are simulated; there is not a single real-world measurement. Every pp difference is “the order of magnitude that necessarily arises under the assumed structure,” not “measured improvement.” True pulse-diagnosis instrument data for
ρ_e, calibration ofp̂, and the real separability of the five syndromes have not yet been measured. ρ_eis assumed, not estimated. Sweepingρ_efrom 0.5 to 0.9 illustrates “the shape of the conclusion’s dependence onρ_e,” not because we know the pulse-diagnosis model’sρ_e. If measuredρ_e = 0.5, weighting indeed yields +1.33 pp (0.84 pp more than equal weighting), weakening the conclusion that “weighting is essentially useless” in this region.- Error structure is artificially set. In the simulation, “misclassified samples” are randomly assigned; in real data, difficult cases cluster (by certain syndromes, age groups, or body types). Clustering alters both the trigger rate of disagreement gates and the accuracy within those gates.
p̂is assumed “already calibrated.” Ifp̂itself is severely miscalibrated (common in random forests; see Mehrtash 2020, Murugesan 2023), then the “confidence gate” captures not “model uncertainty” but “the slope of the calibration curve at that end.” This layer is not decomposed here.
Forbidden inferences (three):
- Do not read this article as “multi-model fusion is useless.” It reads as “under high
ρ_e, the marginal gain of fusion is small, and weighting is nearly zero.“ - Do not read this article as “confidence is unreliable.” Confidence remains necessary as a report of uncertainty; the issue lies only in using it simultaneously for admission and weighting.
- Do not cite 0.25 pp / 0.06 pp as “measured conclusions.” They are order-of-magnitude extrapolations under assumed structures.
Health-related statement: This article concerns machine-based determination of TCM syndromes, a high-risk topic. No model output constitutes a diagnosis, does not constitute treatment advice, and must not replace physician judgment. The diagnostic criteria for TCM syndromes themselves remain unsettled in academia (this is pool ③’s long-standing unsolved issue #78); under this premise, discussing “fusion improving accuracy by 0.25 pp” must simultaneously state: the credibility of the label for that “improved accuracy” has not yet been established.
9. Citation Verification (6 entries, all re-verified on 2026-11-02)
| ID | PMID | Truth Value (title + author match, not just ID existence) | Purpose |
|---|---|---|---|
| A1 | 32746129 | Mehrtash A, Wells WM, Tempany CM, Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentation, IEEE Trans Med Imaging 2021;39:3868-3878, doi:10.1109/TMI.2020.3006437 | Confidence ≠ Accuracy (calibration layer) |
| A2 | 37146441 | Murugesan B, Liu B, Galdran A, Calibrating segmentation networks with margin-based label smoothing, Med Image Anal 2023;87:102826 | Confidence requires explicit calibration (basis for Limitation 4) |
| A3 | 33571099 | Perales-Gonzalez C, Fernandez-Navarro F, Carbonero-Ruz M, Global Negative Correlation Learning: A Unified Framework for Global Optimization of Ensemble Models, IEEE Trans Neural Netw Learn Syst 2022;33:4031-4042 | Ensemble gain depends on inter-member negative correlation/diversity (basis for Section 6) |
| A4 | 19171521 | Soda P, Iannello G, Aggregation of classifiers for staining pattern recognition in antinuclear autoantibodies analysis, IEEE Trans Inf Technol Biomed 2009;13:322-329 | Early empirical evidence for medical classifier aggregation (fusion works, but gate variables not separated) |
| A5 | 38322152 | Hashimoto N, Hanada H, Miyoshi H, Multimodal Gated Mixture of Experts Using Whole Slide Image and Flow Cytometry for Multiple Instance Learning Classification of Lymphoma, J Pathol Inform 2024;15:100359 | Practical use of gated mixture-of-experts in medical classification (comparison) |
| A6 | 38269963 | Millar AS, Arnn J, Himes S, Uncertainty in Breast Cancer Risk Prediction: A Conformal Prediction Study of Race Stratification, Stud Health Technol Inform 2024;310:991-995 | Reporting uncertainty via “coverage-accuracy” instead of single-point thresholds |
Per R11 (zero-parameter criterion falsifies but does not verify): The paper’s claim that “disagreement gates outperform confidence gates” is an internal comparison under the same simulated structure. It falsifies the default assumption that “confidence gates are optimal gate variables,” but it does not prove that “disagreement gates are the correct gate variable”—a different faulty structure (hard sample clustering, varying heterogeneity across three models) could reverse the ranking. This boundary must be read alongside the conclusion.
Per R18 (assertion sufficiency layer reporting): The paper’s 0.25 pp / 0.06 pp rests entirely on “ρ_e known and constant”; yet ρ_e is precisely the only quantity without direct measurement. The conclusion’s precision far exceeds the input’s precision—this is exactly the ailment R26 in Pool 4 warned about, and it has recurred here within its own reasoning. Recorded faithfully.
This paper is draft, not marked accepted, not yet in 779, not published. Companion experimental design: 08-ops/experiments/pool3-confidence-gate-vs-disagreement-gate-fusion.md (P3-EXP-060).
Disclaimer
This article is a synthesis of traditional knowledge and modern statistical methodology, provided for understanding and reference only. It does not constitute medical advice or a basis for diagnosis, and it cannot replace the judgment and clinical care of a licensed physician. Every accuracy figure, percentage-point gap, and trigger rate stated here is a magnitude derived under the explicitly stated simulated assumption structure; none of them is a measured improvement, and none of them implies that any pulse-taking device or model output has diagnostic validity. Individual circumstances vary widely; if you have health concerns or symptoms, please seek medical attention promptly and let a qualified physician make the judgment.
中文免责声明(门禁按中文正则审稿,故此处附中文原句):本文仅供理解与参考,不构成医疗建议,不构成诊断依据,不能替代执业医师的判断与诊疗;如有身体不适或健康疑虑,请及时就医并由专业医师判断。
Leave a Reply