求稳是记忆的下游还是独立现象:一个三臂设计,裁决 ICC 抵消公式该不该作废

Written by

in

Language

Evidence level: C

如果「第二次判得更稳」只是因为「记得第一次判了什么」,那么把记忆和求稳当成两个独立机制来算抵消点,整条公式就要作废重写。

正文

同一批脉象录音,请同一位判读者隔两周再判一遍。上一篇文章(#1428)把两次判读之间的变化拆成两个「反向机制」:记忆把第二次往第一次的答案上拉(变稳),求稳压力——为了避免前后矛盾被挑出来——把第二次往中间收(也变稳)。两个机制方向相同,于是一个反直觉的推论出现了:要让两次判读「看起来独立」,必须主动加入漂移来抵消,而且抵消点可以算出来(记忆权重 0.3 时需要 0.040 的漂移,0.6 时需要 0.103,0.9 时反而降回 0.094)。

但这条计算从头到尾建立在一个从未检验过的因果假设上:记忆和求稳是两个独立的东西。

真实情形很可能是单向派生:判读者先记得上一遍的答案,然后为了避免「你怎么跟自己说的不一样」被挑出来,才主动往中间收。此时「求稳」根本不是并存现象,而是记忆的下游——两个「机制」其实是同一个机制在两条统计量上的投影。如果这样,那套「两个反向机制算抵消点」的公式就整条作废:你没法用两个不独立的量去做矢量抵消。

文献里早有蛛丝马迹。放射科的重复判读研究证实了「记忆效应」真实存在,而且强度随置信度分层——判读者对越有把握的影像,第二次越倾向重复原判断(PMID 22109344)。这提示「再认强度」可能正是记忆通往求稳的中介:记得越牢,自我修正越猛。另一头,认知测验的重复测试研究发现练习效应与信度下降可以同时出现(PMID 30320531)——「记得」和「表现变差」并存,说明两者不是互补关系,更不像两个独立参数。还有一项队列研究(PMID 31719075)发现「谁在判」比「隔多久判」对一致性影响更大——报告者效应盖过时段效应,这与「求稳源于自我一致性压力」的猜想方向一致。更直接的证据来自测量学:一致性倾向(consistency tendency)——被试倾向让后面的作答与前面保持一致——本身就是一个被 RCT 检验过的方法效应(PMID 26866774),它存在,但它的驱动力是不是「记得」,没有裁决。

怎么裁决?一个三臂设计就够了。随机分三组做同一批重判:

  • A 臂(基线):不提示,直接重判;
  • B 臂(告知):明确告诉判读者「这是你上次判过的同一批」;
  • C 臂(许可):同样告知,但补一句「允许改变主意」。

逻辑很简单:如果求稳是记忆的下游,那么 B 臂的漂移应显著大于 A 臂(被提醒记得,修正压力就放大),而 C 臂应回落到 A 臂水平(一纸许可拆掉了「前后矛盾=丢脸」的代价)。同时逐例记录置信度,检验漂移量是否与再认强度成正比——如果是,派生路径的中介变量就抓到了。

三种结果,三条路:

  1. B > A 且 C 回落 → 求稳是记忆的下游,两者不可分解,#1428 的抵消公式须改写为单一机制的净效应,「两个反向机制」框架禁用;
  2. 三臂漂移无显著差异 → 求稳独立于记忆,原框架成立,抵消点可以继续当设计依据;
  3. C 反而比 B 漂得更厉害 → 「许可改变」本身就诱发了新的不稳定性,这是第三种机制,模型须扩成三参数。

为什么这件事值得专门做一轮?因为它牵动的不止一篇文章。如果判据落地是第 1 种结果,那么此前所有用「抵消点」当设计参数的计算——包括按记忆权重选漂移量、按权重比排实验优先级——全部失去前提,须改用单机制净效应重算;而 ICC 作为重测信度的主估计量,其「可接受门限」也要跟着重定,因为门限隐含的误差结构变了。反过来,如果是第 2 种结果,抵消点框架保留,后续实验设计可以直接引用现有数字。也就是说,一轮三臂实验(成本:一句告知语 + 分组随机化)决定的是一整族下游计算作废还是保留——这是测量学里少见的低成本高杠杆裁决。此外,逐例的置信度记录还有一个附带收益:无论哪种结果,「漂移量 × 再认强度」的回归斜率本身就是一个新的可观测量,可以直接进下一轮的门控模型(承接 #1470 的置信度门控假设)——一个实验同时喂两条模型线。

证据与局限

已验证:重复判读中的记忆效应真实存在且按置信度分层(PMID 22109344);一致性倾向作为方法效应存在(PMID 26866774);重复测试中练习效应与信度下降可并存(PMID 30320531)。

部分验证:报告者效应大于时段效应(PMID 31719075,队列研究非实验设计);记忆与求稳的派生关系只有间接旁证,无直接检验。

待验证:三臂设计的全部判据——B/A 漂移差、C 臂回落、漂移量与再认强度的正比关系、「许可改变」是否构成第三机制。在判据落地前,本文所有推演都只是候选解释,不应作为设计依据。

相关阅读

证据等级: C
L1 网络状态:该主题尚未进入 L1 对应网络——L1 中无「记忆效应 × 求稳压力 × ICC 抵消」对应边;最接近的是 E-060 标签信度边(conflict:中医医师间诊断一致性「low」,PMID 30383398),属分组标签信度问题,与本文「判读者重判时的记忆-求稳派生关系」不是同一条边。
参考文献: PMID 22109344, PMID 26866774, PMID 30320531, PMID 31719075

证据等级:A=有PubMed直接支撑,B=科学类比/间接证据,C=传统文化共识/初步探索


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Is Stability a Downstream or Independent Phenomenon of Memory: A Three-Arm Design to Decide Whether the ICC Offset Formula Should Be Abolished

Evidence level: C

If “being judged more stably the second time” is merely because “one remembers what was judged the first time,” then treating memory and stability-seeking as two independent mechanisms to calculate the cancellation point would render the entire formula void, requiring a rewrite.

Body

Using the same set of pulse recordings, the same adjudicator should re-evaluate them after two weeks. The previous article (#1428) decomposed the changes between the two evaluations into two “reverse mechanisms”: memory pulls the second judgment toward the first answer (increasing stability), and stability-seeking pressure—to avoid being flagged for inconsistency—pulls the second judgment toward the middle (also increasing stability). Since both mechanisms act in the same direction, a counterintuitive inference arises: to make the two evaluations “appear independent,” one must actively introduce drift to cancel them out, and this cancellation point can be calculated (requiring 0.040 drift when memory weight is 0.3, 0.103 when 0.6, and dropping back to 0.094 when 0.9).

However, this calculation rests entirely on a causal hypothesis never yet tested: that memory and stability-seeking are two independent things.

The real situation is likely unidirectional derivation: the adjudicator first remembers the previous answer, and then, to avoid being flagged for contradicting themselves, actively pulls toward the middle. In this case, “stability-seeking” is not a coexisting phenomenon but rather the downstream effect of memory—the two “mechanisms” are actually projections of the same mechanism onto two different statistics. If this is true, the formula for “calculating the cancellation point via two reverse mechanisms” is entirely void: one cannot perform vector cancellation using two non-independent quantities.

Literature already contains clues. Studies on repeated adjudication in radiology confirm that the “memory effect” is real and intensifies with confidence stratification—adjudicators are more inclined to repeat the original judgment for images they feel more confident about (PMID 22109344). This suggests that “recognition intensity” may be the mediator through which memory leads to stability-seeking: the stronger the memory, the stronger the self-correction. On the other end, studies on repeated testing in cognitive assessments found that practice effects and reliability decline can occur simultaneously (PMID 30320531)—”remembering” and “performance worsening” coexist, indicating they are not complementary but rather not two independent parameters. Furthermore, a cohort study (PMID 31719075) found that “who adjudicates” has a greater impact on consistency than “how long the gap is”—the reporter effect outweighs the time-of-interval effect, which aligns with the hypothesis that stability-seeking stems from self-consistency pressure. More direct evidence comes from psychometrics: consistency tendency (consistency tendency)—the tendency of subjects to make later responses consistent with earlier ones—is itself a method effect verified by RCT (PMID 26866774); it exists, but whether its driver is “remembering” remains undecided.

How to adjudicate? A three-arm design suffices. Randomly assign three groups for the same batch of re-adjudication:

  • Arm A (Baseline): No prompt, direct re-adjudication;
  • Arm B (Informed): Explicitly tell the adjudicator “this is the same batch you judged before”;
  • Arm C (Permission): Same as Arm B, but add “you are permitted to change your mind.”

The logic is simple: if stability-seeking is the downstream effect of memory, then Arm B’s drift should be significantly greater than Arm A’s (being reminded of the memory amplifies correction pressure), while Arm C should revert to Arm A’s level (a paper of permission removes the cost of “contradicting oneself = losing face”). Meanwhile, record confidence level case-by-case to test whether drift magnitude is proportional to recognition intensity—if so, the mediator of the derivation path is caught.

Three outcomes, three paths:

  1. B > A and C falls back → Stability-seeking is the downstream effect of memory; the two cannot be decomposed, so the cancellation formula in #1428 must be rewritten as the net effect of a single mechanism, and the “two reverse mechanisms” framework is forbidden;
  2. No significant difference in drift among the three arms → Stability-seeking is independent of memory; the original framework holds, and the cancellation point can continue to serve as the design basis;
  3. C drifts even more than B → “Permission to change” itself induces a new instability, constituting a third mechanism, so the model must expand into three parameters.

Why is this worth doing as a dedicated round? Because it affects not just one article. If the adjudication lands on Outcome 1, then all prior calculations using “cancellation point” as a design parameter—including selecting drift magnitude based on memory weight and ranking experimental priority based on weight ratios—lose their premise and must be recalculated using the net effect of a single mechanism; moreover, ICC, as the primary estimator of test-retest reliability, must have its “acceptable threshold” redefined, because the implied error structure has changed. Conversely, if Outcome 2 holds, the cancellation point framework is retained, and subsequent experimental designs can directly cite existing numbers. Thus, one round of three-arm experiment (cost: one prompt sentence + randomization) decides whether an entire family of downstream calculations is voided or preserved—a rare low-cost, high-leverage adjudication in psychometrics. Additionally, recording confidence level case-by-case yields an ancillary benefit: regardless of the outcome, the regression slope of “drift magnitude × recognition intensity” itself becomes a new observable quantity that can directly feed into the next round’s gating model (continuing #1470’s confidence-gated hypothesis)—one experiment feeding two model lines.

Evidence and Limitations

Verified: Memory effect in repeated adjudication is real and stratified by confidence (PMID 22109344); consistency tendency exists as a method effect (PMID 26866774); practice effects and reliability decline can co-occur in repeated testing (PMID 30320531).

Partially Verified: Reporter effect exceeds time-of-interval effect (PMID 31719075, cohort study not experimental design); the derivation relationship between memory and stability-seeking has only indirect corroboration, no direct test.

To Be Verified: All criteria of the three-arm design—B/A drift difference, Arm C fall-back, proportionality between drift magnitude and recognition intensity, whether “permission to change” constitutes a third mechanism. Until these criteria are established, all deductions in this article remain candidate explanations and should not serve as design basis.

Related Reading

Evidence Level: C
L1 Network Status: This topic has not yet entered the L1 corresponding network—the L1 lacks the “memory effect × stability-seeking pressure × ICC cancellation” edge; the closest is the E-060 label reliability edge (conflict: diagnostic consistency among TCM physicians is “low”, PMID 30383398), which pertains to group-label reliability issues and is not the same edge as this article’s “memory-stability-seeking derivation relationship in adjudicator re-adjudication”.
References: PMID 22109344, PMID 26866774, PMID 30320531, PMID 31719075

Evidence Level: A = direct PubMed support, B = scientific analogy/indirect evidence, C = traditional consensus/preliminary exploration


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *