Evidence level: C
重校准能压住多少漂移,不取决于校准多勤,取决于漂移按什么规律长出来 —— 而这件事,看两次数据永远看不出来。
一、这个处方是怎么来的
真人判读的位置漂移是五个百分点报警线的一点五到三点八倍。判前校准压不住判读过程中的漂移,那就退一步,隔一段时间重校准一次。这问题被问过但没答清:原因不在校准动作够不够标准,而在它落在什么形态上——同一条措施遇到不同形态,效果不是差一点,是差一个层级。
二、两时点分不开:不是测不到,是解不唯一
设严厉度随时间走成三段之和:每轮固定偏移 c、每轮随机抖动 s、单次判读的瞬时噪声 τ。两次判读只给一个增量,方差要同时承担三件事。数矩条件,两时点只有 1 个增量、1 个可算方差,未知数 3 个,冗余负 2。落到数字:十轮后观测到 0.167 个标准差的位移,可行解是一整条曲线 —— 纯游走步长 0.0528 且零趋势,或零游走且每轮 0.0167 的趋势,中间每档都成立。常引用的「步长 0.05 时约十一轮漂回报警线」,十一是纯游走假设下的解,换成纯趋势是每轮 0.015。
三、三时点就够,但靠的不是看曲线
加一个时点,增量变 2 个,可算的协方差元素变 3 个,冗余刚好归零。关键是分辨形态靠的不是「走势图像直线还是像毛刺」,而是相邻两段增量的协方差符号。趋势加瞬时噪声时,相邻增量共用同一个噪声项,协方差等于 τ 的平方取负;纯游走时各走各的,协方差为零。模拟每格四千次:15 人时 87.6% 与 88.3%,30 人时 95.3% 与 96.0%,60 人时双双超过 99%。代价是约一半抽样会给出负的方差分量,必须用约束估计,不能把点估计当结论。
四、实测把几种形态都碰上了,而且互相打架
几条实证摆一起,谁也没压下谁。五次同版本十二站 OSCE、228 个评分机会里只有 1 个显示显著漂移,且先被评的考生反而占便宜,与「越判越松」正相反(PMID 30955444)。另一次单场 OSCE 里时段与评分显著正相关,系数 0.88(95% 置信区间 0.38 到 1.38,P=0.001),与站点难度有交互,指向疲劳(PMID 19769648)。第三份是 8 名评分者对同一批视频判四轮、间隔至少一周,总分在 3.0 到 35.7 之间摆,第四轮显著抬高(PMID 26837086)。样本最大那份 458 名教师两年,漂移在最初几天极大并持续近两年,评分者没收敛到共同严厉度、彼此变异反而增大(PMID 29795823)—— 这条跳出趋势与游走的老框子:发散型既拦不住也不会自己稳定。
五、量级差在地板,不在降幅
把「间隔减半」当可做的实验,两种形态的降幅是 50.0% 与 29.3%,只差 1.7 倍,说差一个数量级是夸大。差一个量级的是可达下限:趋势型随校准加密趋近于零,每例都校准后残留 0.0152,是报警线的 9%;游走型无论校准多密都卡在步长本身,步长 0.05、0.10、0.15 时残留分别是报警线的 30%、60%、90%。趋势型的问题是校准够不够勤,游走型的问题是校准根本改不了它。两者并存时降幅落在 30% 到 32%,靠降幅分不出来,所以协方差符号那条检验不能省。
六、怎么测、怎么写进规范
最低设计:固定锚定材料、至少六名评分者、至少六个均匀间隔时点、顺序随机。先算三个量:相邻增量的协方差、间隔减半前后的偏移比、拟合优度(六时点冗余十二)。判据:协方差显著为负且降幅近 50%,写「间隔不超过 T 则偏移不超过 cT」;协方差为零且降幅落在 29% 附近,写「校准只重置零点、漂移按根号 T 重累积」并明写残留地板等于步长;两者并存则两参数并报。
证据与局限
已验证:三时点起趋势型与游走型在矩条件上可分,分离靠相邻增量的协方差符号而非曲线形状;模拟在 30 人以上给出九成以上判别率。校准频率对两类形态的可达下限不同,是代数结论,不依赖数据。
部分验证:实测证据互相冲突。「不到百分之一显著漂移」与「时段系数 0.88 显著」并存,说明形态可能因人因场景而异,不是领域共性;
待验证:几种形态在真实判读数据里各占多少,没有任何研究报过。六时点以上的纵向序列在中文医学判读研究里几乎不存在,本判据只能作设计规范。
L1 网络状态
L1 网络状态:
E-060 标签前提原文记为「五脏辨证(作为分组标签)— 前提 — 标签信度 …… 冲突(未裁决)」,该边只裁决「标签整体信度低不低、训练能不能改善」。对「漂移按趋势累积还是按游走扩散」,CORRESPONDENCE_NETWORK.md 与 EDGE_TABLE_science-yixue.md 全表检索「游走」「趋势」「累积」「疲劳」「时点」「马尔可夫」「状态空间」「纵向」均 0 命中。该主题尚未进入 L1 对应网络,故证据等级封顶 C,缺口已登记至 science-yixue-l1-gaps.md。
相关阅读
证据等级: C
参考文献: PMID 30955444, PMID 19769648, PMID 26837086, PMID 29795823, PMID 36284065, PMID 37283589, PMID 29881127, PMID 28587597
免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。
Does Regular Recalibration Work: Two Timepoints Cannot Distinguish \”Gradually Looser\” from \”Chaotic Fluctuations,\” Yet Their Lower Bounds Differ by an Order of Magnitude
Evidence level: C
Recalibration suppresses drift only to the extent dictated by the underlying growth pattern of the drift, not merely by how frequently it is performed. This distinction cannot be discerned from two data points alone.
I. Origin of This Prescription
The observed positional drift among real raters is 1.5 to 3.8 times the five-percent alarm threshold. Since pre-assessment calibration fails to suppress drift occurring during the assessment process, we must step back and consider periodic recalibration. This issue has been asked but not fully answered: the cause lies not in whether the calibration action is standard enough, but in what morphological pattern it falls upon—the same measure encounters different forms, and the effect differs not slightly, but by an entire order of magnitude.
II. Two Timepoints Are Insufficient: Not Unmeasurable, But Non-Unique Solutions
Let severity evolve over time as the sum of three components: fixed offset $c$ per round, random jitter $s$ per round, and instantaneous noise $\tau$ per single judgment. Two assessments provide only one increment; the variance must simultaneously account for three unknowns. Under moment conditions, two timepoints yield 1 increment and 1 calculable variance, yet 3 unknowns, resulting in a redundancy of -2. Numerically: after ten rounds, an observed displacement of 0.167 standard deviations yields a feasible solution as an entire curve—pure random walk step size 0.0528 with zero trend, or zero random walk with a trend of 0.0167 per round; both hold true for intermediate intervals. The commonly cited “step size 0.05 returns to the alarm line after about eleven rounds” is solved under the pure random walk assumption; switching to pure trend yields 0.015 per round.
III. Three Timepoints Suffice, But Not by Observing the Curve
Adding a third timepoint increases increments to 2 and calculable covariance elements to 3, making redundancy exactly zero. Crucially, distinguishing the pattern does not rely on whether the trend image looks straight or spiky, but on the sign of the covariance between adjacent increments. When trend plus instantaneous noise is present, adjacent increments share the same noise term, so covariance equals $-\tau^2$; under pure random walk, each moves independently, so covariance is zero. Simulations with 4,000 trials per cell: at 15 raters, discrimination rates are 87.6% vs. 88.3%; at 30 raters, 95.3% vs. 96.0%; at 60 raters, both exceed 99%. The cost is that about half of sampled cases yield negative variance components, requiring constrained estimation rather than treating point estimates as conclusions.
IV. Real-World Evidence Encounters Multiple Patterns That Conflict
Several empirical studies coexist, none suppressing the others. In five OSCE sessions with twelve stations and 228 scoring opportunities, only 1 showed significant drift—and the first-assessed candidates actually gained advantage, contradicting “loosening over time” (PMID 30955444). In another single OSCE session, time interval and score were significantly positively correlated (coefficient 0.88; 95% CI 0.38 to 1.38, $P=0.001$), interacting with station difficulty, pointing to fatigue (PMID 19769648). A third study had 8 raters assess the same video set over four rounds with at least one week between, total scores ranging from 3.0 to 35.7, with the fourth round significantly elevated (PMID 26837086). The largest sample, 458 teachers over two years, showed drift extremely high initially and persisting for nearly two years; raters failed to converge on common severity, and mutual variation increased instead (PMID 29795823)—this breaks the old framework of trend vs. random walk: divergent patterns neither stabilize nor self-correct.
V. The Difference Lies in the Floor, Not the Reduction Rate
Treating “halving the interval” as an experiment: the reduction rates for the two patterns are 50.0% and 29.3%, differing only by 1.7 times—claiming an order-of-magnitude difference is exaggerated. The true order-of-magnitude gap lies in the achievable lower bound: trend-type drift approaches zero with denser calibration, leaving 0.0152 after full recalibration—9% of the alarm line; random-walk-type drift remains stuck at its step size regardless of calibration density—residuals are 30%, 60%, and 90% of the alarm line at step sizes 0.05, 0.10, and 0.15 respectively. For trend-type, the issue is calibration frequency; for random-walk-type, the issue is that calibration cannot alter it at all. When both coexist, reduction falls between 30% and 32%, making it impossible to distinguish by reduction rate alone, so the covariance-sign test cannot be omitted.
VI. How to Measure and Write into Standards
Minimum design: fixed anchor material, at least six raters, at least six evenly spaced timepoints, random order. First compute three quantities: covariance of adjacent increments, offset ratio before and after halving the interval, goodness-of-fit (six timepoints yield twelve redundancies). Criteria: if covariance is significantly negative and reduction nears 50%, write “offset ≤ cT when interval ≤ T”; if covariance is zero and reduction nears 29%, write “calibration only resets the zero point, drift re-accumulates as $\sqrt{T}$” and explicitly state residual floor equals step size; if both coexist, report both parameters.
Evidence and Limitations
Verified: Starting from three timepoints, trend-type and random-walk-type can be distinguished under moment conditions, relying on the sign of covariance between adjacent increments rather than curve shape; simulations with 30+ raters yield over 90% discrimination rate. Calibration frequency affects the achievable lower bound differently for each pattern—an algebraic conclusion independent of data.
Partially Verified: Empirical evidence conflicts. “Less than 1% significant drift” coexists with “time-interval coefficient 0.88 significantly positive,” suggesting patterns may vary by person and context, not as domain-wide commonalities.
Pending Verification: No study has reported the proportion of each pattern among real assessment data. Longitudinal sequences beyond six timepoints are virtually absent in Chinese medical assessment research; thus this criterion serves only as a design specification.
L1 Network Status
L1 Network Status:
E-060 Label Premiseoriginal text recorded as “Five-Zang differentiation (as grouping label) — premise — label reliability … conflict (unresolved).” This edge only resolves “whether overall label reliability is low or not, and whether training can improve it.” Regarding “whether drift accumulates via trend or spreads via random walk,” CORRESPONDENCE_NETWORK.md and EDGE_TABLE_science-yixue.md searched all tables for “random walk,” “trend,” “accumulate,” “fatigue,” “timepoint,” “Markov,” “state space,” “longitudinal”—zero hits. This topic has not yet entered the L1 corresponding network, so evidence level capped at C; gap registered to science-yixue-l1-gaps.md.
Related Reading
- How much does the rater’s position actually drift: that critical threshold differs by several orders of magnitude from real-world measurement
- Do two raters drift together or separately: this correlation coefficient cannot be measured from two-person data
- Why measurement consistency always fails to calibrate properly
Evidence Level: C
References: PMID 30955444, PMID 19769648, PMID 26837086, PMID 29795823, PMID 36284065, PMID 37283589, PMID 29881127, PMID 28587597
Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.
Leave a Reply