记忆把 ICC 抬上去、求稳把它压回来:两个相反机制同时在场时,那个「0.5 附近」的数字什么都证明不了

Written by

in

Language

Evidence level: C

ICC 是个比值。比值只报分子分母的比例,不报各自是多少——两个方向相反的机制同时作用时,同一个比值能对应六倍以上的真实差异。

一、一个从没被正面检验的假设

重测一致性的逻辑很朴素:同一人、同一批材料判两次,对得上说明尺子稳。这里藏着一个假设——两次对不上,只可能因为尺子在抖。

真实判读里至少有两条路让两次不一样,方向却相反。第一条是记忆:第二遍看见同一批材料,判读者照着上遍的结论抄,抄一遍更一致,ICC 往上走。第二条是求稳:判读者意识到自己在重复同一件事,怕前后矛盾被挑出来,于是往中间档收敛。收敛也让打分接近,但那是把差异抹平,不是把信号锁住——ICC 不一定动,判别力却在掉。

母篇已证明 ICC 对纯记忆敏感、对纯求稳近乎失明。这篇问下一层:两条路同时在跑时,报出来的那个 ICC 是哪一条的读数。答案是:哪条都不是,是两条相减的余数,而余数不能反推两个减数。

二、ICC 的等值线是曲线,不是一个点

把 ICC 锁在同一个数上看它下面压着什么最直接。实测:ICC 全部锁定 0.18 时,漂移跨度是 0.075 到 0.503,相差 6.7 倍。 无记忆时漂移 0.075 就够;记忆权重 0.6 时要 0.150;权重 0.9 时要 0.503。

读法很刺眼。ICC 等于 0.18 的这个研究,可能是一位「没记忆、正常漂移」的判读者,也可能是「强记忆、漂移大到五倍」的判读者。前者可折价使用,后者必须整份作废——0.503 的漂移意味着第三轮和第一轮的尺度差出半个标准差,两轮不是同一把尺。而报告上只有「ICC=0.18」一个数字。

四格检验更狠。按记忆强弱乘漂移大小分四组,各跑四百次取四分位区间:低记忆低漂移 0.121 到 0.227,低记忆高漂移 0.067 到 0.137,高记忆低漂移 0.131 到 0.234,高记忆高漂移 0.120 到 0.219。六对两两比对,六对全部重叠。 在这个常见规模下,「重测干净」和「重测已废」两群人的 ICC 分布分不开。

三、加指标、加读者,都补不回来

第一反应是「多报一个量」。本篇的补救指标直接测漂移、不走 ICC 那个比值,灵敏度确实碾压:权重 0.9 时漂移每涨 0.04,它的斜率是 ICC 斜率的三百五十六倍。但灵敏度不等于可辨识度。在 110 格网格上问「给定一组观测,容差内还有几格能解释」:只用 ICC,唯一可辨识率一律为零;双指标也只到 3.6%,平均每格还有 14.3 个候选解。把比值精度提到正负 4%(这个规模上基本做不到)才勉强到 28.2%。原因是 ICC 掉一点、漂移指标涨一点,这两个动作在中低记忆区几乎绑死——等于在本就压扁的曲面上多取一个几乎共线的投影。

第二反应是「多找几位判读者」。实测也掐掉了:强记忆下把漂移从零拉到 0.20,ICC 位移是 4 位读者加 0.0068、8 位减 0.0119、16 位加 0.0011。位移一直在零附近晃,符号还翻了。 加读者只压小标准差(0.096 到 0.092,因为 ICC 的抽样误差主要由例数定),压不动那个本就接近零的位移。这不是精度问题是结构问题:两个反向项在同一条通道里,在同一通道上加观测也分不开。

有个办法能分开,但要改设计:一半判读者判重复材料、另一半判同分布的新材料。重复臂走记忆、新材臂不走,两臂 ICC 之差就是记忆净效应,漂移在两臂相互抵消。实测方向对但信噪比极差——有记忆时两臂差 0.0522、无记忆 0.0104,要 32 到 48 位读者才能把单次功效值做到 0.30 到 0.37,按八成功效算要重复 57 到 87 次。原理成立,实践极贵。

四、这对本组意味着什么

本组所有跨主体比较都建立在同一前提上:分组标签与生理量是同一次测量得到的,判读重测一致性是这条链路唯一的质量闸门。现在这道闸门的样子是——它只报一个比值,而这个比值在两机制同向抵消时,与「一切正常」无法区分。

三条后果。第一,凡报告「重测 ICC 达标故数据可用」的研究都缺一句声明:这个数是哪种机制主导下拿到的。记忆主导说明重测根本没提供独立信息;求稳主导说明个体差异被抹平,判别力已失。第二,本篇算出的「抵消所需漂移」(权重 0.3 需 0.040、0.6 需 0.103、0.9 需 0.094)与本领域实测漂移量级同处 0.05 到 0.20——「恰好抵消」不是巧合而是常态区,卡在门限附近的 ICC 最可能的解释不是「尺子够稳」而是「两条偏置刚好打平」。第三,出路是改设计:做分离设计,或干脆不用 ICC 作验收、改报「重复材料与新材料的成绩差」这个原始量——后者不需额外样本,只需两种材料混排。

关于气功外气与脏腑辨证这条主线:本文不提供任何支持外气效应存在的证据。它指出的是——这条线上用来证明「测量可靠」的那把尺,原理上不足以承担这个任务。尺子换掉之前,任何基于重测一致性的分组结论只能是待验证状态。

证据与局限

已验证:ICC 对不同方向的系统误差敏感度极不对称(母篇实测,本篇复现)。方法学侧早有定论:PMID 11091941 用三组模拟对比 ICC、Pearson 相关、配对 t,指出三者在系统偏置下结论互相冲突、ICC 是唯一能反映偏置的,但仍须配合 F 检验确认偏置是否真存在;PMID 31329615 给出判别规则——绝对一致 ICC 与一致性 ICC 近乎相等则偏置可忽略,一致性明显高于绝对一致则不可忽略,两者必须并报。

部分验证:两类机制确实同时存在,但各自占比从未被同时测量。记忆侧——PMID 22109344 在 24 位放射科医师、两次判读、半数换图的设计里检出记忆效应,且主要出现在低置信区;PMID 30840725 抽样 110 个观察者性能实验,67.6% 用了时间间隔(中位 14 天),52.9% 连用了什么防记忆手段都没写清。求稳侧也有实证,中心化倾向被反复记录且与严厉度漂移可分离。但没有一项研究在同一批数据上同时报出两者量级——这正是缺口。

待验证:真实判读数据上两类强度的联合分布完全空白,本篇网格值都建立在「记忆为线性平滑、漂移为线性趋势」两条设定上;若真实记忆只在中低置信区生效(PMID 22109344 如此提示),等值线形状会变、抵消区须重算。漂移代理量在此规模下的实际精度未实测。求稳是否真能独立于记忆存在(漂移是否部分由记忆派生)未做因果分离。

L1 网络状态:CORRESPONDENCE_NETWORK.md 第 202 行 E-060 标签前提(五脏辨证作分组标签,指向标签信度)登记为「冲突(未裁决)」,原文:「KB-292(conflict):中医医师间诊断一致性在开放人群中『低(low)』,作者称为『令人担忧』(PMID 30383398)……但训练可改善(PMID 19538100)、量表化可行」;第 223 行补充「冲突(未裁决,且新增两处单位错配/精度区间错配)」。该主题尚未进入 L1 对应网络——全表对「记忆、求稳、中心化倾向、重测方向不对称」均无对应边,网络能登记「标签一致不一致」,登记不了「不一致是被记忆压住还是被求稳抹平」。

相关阅读

证据等级: C
参考文献: PMID 11091941, PMID 31329615, PMID 30840725, PMID 22109344, PMID 30320531, PMID 31719075


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Memory pushes ICC up, stability pulls it back: when both opposite mechanisms are present, the figure near 0.5 proves nothing

Evidence level: C

ICC is a ratio. A ratio reports only the proportion of numerator to denominator, not their absolute magnitudes. When two opposing mechanisms act simultaneously, the same ratio can correspond to more than sixfold differences in reality.

I. An Untested Hypothesis

The logic of test-retest consistency is straightforward: if the same person judges the same materials twice and the results align, the ruler is stable. This relies on an assumption—if the two results do not match, it must be because the ruler is shaking.

In reality, at least two pathways can produce different results, yet in opposite directions. The first is memory: on the second pass, seeing the same materials, the judge copies the previous conclusion; this increases consistency, pushing ICC upward. The second is conservatism: realizing they are repeating the same task, the judge fears being caught for contradictions and converges toward the middle range. This convergence brings scores closer, but it flattens differences, not locks signals—ICC may not move, yet discriminative power drops.

The parent article proved ICC is highly sensitive to pure memory but nearly blind to pure conservatism. This piece asks the next layer: when both pathways run simultaneously, whose reading does the reported ICC represent. The answer is: neither; it is the remainder of their subtraction, and that remainder cannot reverse-engineer the two subtrahends.

II. ICC’s Contour Lines Are Curves, Not Points

Locking ICC to a single number reveals what lies beneath most directly. Measured: when ICC is locked at 0.18, the drift spans from 0.075 to 0.503—a difference of 6.7 times. Without memory, a drift of 0.075 suffices; with memory weight 0.6, it requires 0.150; with weight 0.9, it reaches 0.503.

The reading is striking. A study reporting ICC = 0.18 could involve a judge with no memory and normal drift, or one with strong memory and drift five times larger. The former can be discounted; the latter must be discarded entirely—a drift of 0.503 means the third round differs from the first by half a standard deviation; they are not measured with the same ruler. Yet the report shows only “ICC = 0.18.”

The four-fold test is more severe. Grouping by memory strength and drift magnitude yields four clusters; running 400 trials each and taking quartile intervals: low memory/low drift 0.121–0.227, low memory/high drift 0.067–0.137, high memory/low drift 0.131–0.234, high memory/high drift 0.120–0.219. All six pairwise comparisons overlap completely. At this common scale, the ICC distributions of “clean retest” and “already failed retest” groups are indistinguishable.

III. Adding Metrics or Judges Cannot Recover the Signal

The first instinct is “report more quantities.” This piece’s recovery metric directly measures drift, bypassing ICC’s ratio; its sensitivity indeed overwhelms: at weight 0.9, drift increases by 0.04, and its slope is 356 times that of ICC’s slope. Yet sensitivity does not equal discriminability. On an 110-cell grid, asking “given a set of observations, how many cells within tolerance can explain them”: using ICC alone, discriminability is zero; with dual metrics it reaches only 3.6%, averaging 14.3 candidate solutions per cell. Even raising ratio precision to ±4% (impossible at this scale) barely reaches 28.2%. This occurs because ICC drops slightly while drift rises slightly; these two actions are nearly locked in the low-memory region—equivalent to taking an additional projection almost collinear on an already flattened surface.

The second instinct is “add more judges.” Measurement also fails: under strong memory, pulling drift from zero to 0.20, ICC displacement is +4 readers × 0.0068, −8 readers × 0.0119, +16 readers × 0.0011. The displacement hovers near zero, even flipping sign. Adding judges only compresses standard error (0.096 to 0.092, since ICC’s sampling error is primarily determined by sample size), but cannot move the displacement already near zero. This is not a precision problem but a structural one: two opposing terms travel the same channel; adding observations to that channel cannot separate them.

A way exists to separate them, but it requires redesign: half the judges evaluate repeated materials, half evaluate new materials drawn from the same distribution. The memory arm uses repetition; the new-material arm does not; the difference in ICC between arms is the net memory effect, with drift cancelling across arms. Measured direction matches but signal-to-noise is poor—memory present yields arm difference 0.0522, memory absent 0.0104; achieving power of 0.30–0.37 requires 32 to 48 judges, and at 80% power, repeating 57 to 87 times. The principle holds, but practice is extremely costly.

IV. What This Means for This Group

All cross-subject comparisons in this group rest on one premise: grouping labels and physiological quantities are obtained from the same measurement, so test-retest consistency is the sole quality gate along this chain. Currently, that gate looks like this—it reports only one ratio, and when the two mechanisms oppose each other, this ratio is indistinguishable from “everything normal.”

Three consequences follow. First, any study reporting “ICC meets threshold, so data are usable” lacks a statement: which mechanism dominated this number. Memory dominance means retest provided no independent information; conservatism dominance means individual differences were flattened, losing discriminative power. Second, the calculated “drift required for cancellation” (weight 0.3 needs 0.040, 0.6 needs 0.103, 0.9 needs 0.094) falls within the empirically observed drift range of 0.05–0.20 in this field—“exact cancellation” is not a coincidence but the normal zone; ICC values near the threshold are most likely explained not by “the ruler is stable” but by “two biases exactly balanced.” Third, the path forward is redesign: use a separated design, or abandon ICC as the acceptance criterion entirely and report instead “the raw difference between repeated and new materials”—the latter requires no extra samples, only interleaving the two material types.

Regarding the main thread of qigong external qi and zang-fu differentiation: this article provides no evidence supporting the existence of external qi effects. It points out that the ruler used to prove “measurement reliability” along this line is, in principle, insufficient for the task. Until the ruler is replaced, any grouping conclusion based on test-retest consistency remains in a pending verification state.

Evidence and Limitations

Verified: ICC’s sensitivity to systematic errors in opposite directions is highly asymmetric (parent article measured, this piece reproduced). Methodology literature already established this: PMID 11091941 compared ICC, Pearson correlation, and paired t-tests across three simulated groups, showing conflicting conclusions under systematic bias; ICC alone reflects the bias but must be paired with F-tests to confirm whether bias truly exists. PMID 31329615 provides decision rules—if absolute consistency ICC and consistency ICC are nearly equal, bias is negligible; if consistency clearly exceeds absolute consistency, bias cannot be ignored; both must be reported.

Partially Verified: Both mechanisms indeed coexist, yet their respective proportions have never been measured simultaneously. Memory side—PMID 22109344 detected memory effects in 24 radiologists performing two readings with half the images swapped, primarily in low-confidence regions; PMID 30840725 sampled 110 observers in a performance experiment, where 67.6% used time intervals (median 14 days), and 52.9% did not clearly state any anti-memory measures. Conservatism side also has empirical support, with centralization tendency repeatedly documented and separable from severity drift. However, no study has reported both magnitudes on the same dataset—this is the gap.

Pending Verification: The joint distribution of both intensities in real judgment data is completely blank; all grid values here assume “memory acts as linear smoothing, drift acts as linear trend.” If real memory operates only in mid-to-low confidence regions (as PMID 22109344 suggests), the contour shape changes and the cancellation zone must be recalculated. The actual precision of drift proxies at this scale has not been measured. Whether conservatism truly exists independently of memory (i.e., whether drift is partially derived from memory) has not undergone causal separation.

L1 Network Status: CORRESPONDENCE_NETWORK.md line 202, E-060 label premise (zang-fu differentiation as grouping labels, pointing to label reliability) registered as “Conflict (Unresolved)“, original text: “KB-292 (conflict): diagnostic consistency among TCM physicians in an open population is ‘low (low)’, authors call it ‘concerning’ (PMID 30383398) … but training can improve (PMID 19538100), scaling is feasible”; line 223 adds “Conflict (Unresolved, plus two new unit mismatches/precision interval mismatches)**. This topic has not yet entered the L1 correspondence network—the entire table lacks edges corresponding to “memory, conservatism, centralization tendency, asymmetric retest direction”; the network can register “labels consistent/inconsistent” but cannot register “inconsistency is suppressed by memory or flattened by conservatism.”

Related Reading

Evidence Level: C
References: PMID 11091941, PMID 31329615, PMID 30840725, PMID 22109344, PMID 30320531, PMID 31719075


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *