偏科比偏得多更伤人:残差是常数还是一截阶梯,取决于偏倚散不散、而不取决于偏得多大

Written by

in

Language

Evidence level: C

上一篇说「校正之后剩下的偏差,精确等于资深者自己的偏倚」。那句话还有个前提被藏起来了:这口偏倚得是一个常数。一旦它随病例亚型上下浮动,你减掉的就不是一个数,而是一个平均——剩下的东西从一口平底锅变成一截台阶。

一、先把「残差是常数」这句话拆开

两位判读者看同一批病例:资深者 A 读出「真值 + a」,新人 B 读出「真值 + b」。把 B 整体减去两人的平均差,剩下的是 a。这是代数,没有争议。

问题在于 a 被当成了跨病例不变的常数。这个假定在判读研究里几乎站不住——42306452 号研究用多面 Rasch 的差异性评分者功能分析 69 位评分者对 3875 份申请的判读,发现「是否与申请者同性别、同族群背景」会改变同一位评分者的严厉度,偏移量在 0.46 到 1.74 logit 之间;35754620 号研究进一步把这个框架扩成「严厉度与居中倾向同时偏科」的双通道模型,并证明双通道偏科会实质损害测量质量。换言之,一位评分者不是「整体偏严三分」,而是「对这一类偏严、对那一类偏宽」。

若 a 随亚型 k 浮动、b 不随,则校正后的残差是 a_k,不是一个数。它的均方值等于「平均偏倚的平方加上亚型间方差」。前半截随样本量下降,后半截不降——你多测多少例都压不掉它。

二、开关不是偏得多大,而是偏得多散

把「亚型间方差占偏倚总方差的比例」当判据,会撞上一个尴尬:平均偏倚趋于零时这个比例必然趋于百分之百,于是「偏科最严重」的判断恰好落在「校正等于白校正」的最良性情形上。判据用错了。

换成无量纲的比值——亚型间标准差除以平均偏倚的绝对值——界线立刻干净:这个比值小于三分之一,离散只占总方差一成以下,单常数近似可用;到三分之二,离散占到三成,「校正后残差为常数」这句话必须改成「按亚型分段」;比值超过一,均方残差已经一半以上来自离散,减一个统一数已经没有意义。

这条换算和偏倚的绝对大小无关,只和「散不散」有关。

三、同一份数据里,这个比例已经悬殊到十几倍

42306452 号研究把两类偏倚都报了出来:跨组平均的严厉度偏移只有负 0.12 与负 0.07 logit,而分群偏移是 0.46 与 1.74 logit。前者是后者的百分之七到十五。

照上面的换算,比值落在七到十五之间,离散占比超过百分之九十八。这不是边缘超标,是单常数近似彻底失效——连一个能统一减掉的数都拿不出来。该研究还给了另一个方向的证据:超过一半的个体评分者在性别维度上呈现可观的偏科,三成左右在族群维度上如此。也就是说这不是少数人的毛病,而是多数人都有、只是方向各自不同——平均起来互相抵消,看起来「整体没偏」。

「整体偏小」最危险的地方就在这里:它由一堆方向相反的大偏移抵消而成,剩下的那个小数字最不具代表性。

四、阶梯看得见吗:假台阶比真台阶更容易出现

假设每个亚型只有三十例、单次判读噪声八个百分点。即使真实偏科为零,仅仅因为抽样,实测到的亚型间方差期望值就有四点三平方百分点。此时「假台阶」占到百分之百。

真实离散要多大才压得住这个地板?标准差一,假台阶八成;二,五成;三,三成;四点六,一成七;八,才降到百分之六。要让假台阶压到一成以下,每个亚型得有一百一十到一千一百例,取决于真实离散是一到八。

齐性检验的处境同样难看。三个亚型各三十例、真偏科为负二、零、正二时,检出率只有两成二;要到各一百二十例才六成九。真偏科翻到三,三十例时四成四、一百二十例时九成七。37810544 号研究在模拟里也撞到同一堵墙:稀疏设计下差异性评分者功能的对比估计幅度系统性低于设定真值,甚至「明明注入了偏科,与评分者交互的方差成分也不一定能读出来」。25546697 号研究做量表跨评定者可比性检验时,也是先控住评分者效应才敢谈可比。

所以现在能写的话只有一句:多数判读研究的样本量,对「有没有偏科」这个问题给不出信息;写「未检出差异」是把无信息当成了阴性证据。

五、还有个更隐蔽的:代入平均值会错到五倍

若关心的是「隔多久判错一次」,错误率等于二倍 p 乘一减 p,p 是平均偏倚除以跨场景异质性再取正态分布函数。这个式子是凹的,代入平均值必然系统偏差,而且方向随平均偏倚离零的距离翻转。

算一遍:跨场景异质性三个百分点时,偏倚在二、六、十一、十六之间浮动(均值六点四),逐亚型加权算出的错误率是一成六,代入平均值算出的是三点二——差了五倍,代入法把风险说小了。反过来,偏倚在负四、负一、正三、正四之间(均值负零点九),加权算出三成九,代入算出四成九——这次代入法把风险说大了。

异质性涨到五个百分点,倍数差收到一点四倍;涨到八以上,两种算法几乎同值(一比一)。原因是凹性的曲率被摊平了:异质性大时所有亚型都被推到「接近五成」的天花板,互相抹平。于是有个反讽的结论——跨场景越一致(异质性越小),这套算法越「好用」,也越不准。

证据与局限

已验证:以资深者为准的校正,在偏倚恒定前提下残差精确等于资深者自身偏倚(代数恒等式)。偏科现象在真实判读数据里确实存在且普遍:42306452 号研究中过半评分者在性别维度呈现可观偏科,双通道偏科会损害测量质量(35754620)。稀疏设计会系统性压低偏科的检出灵敏度(37810544)。

部分验证:本文的三档判据(三分之一、三分之二、一倍)来自方差分解的恒等式换算,数学上是精确的;但它们对应的「可用/须分段/失效」边界,目前只是量级判断,尚无实测数据校准。「假台阶」与检验力的具体数字基于单次判读噪声八个百分点、亚型各三十例这组设定,噪声或例数一变,整张表都要重算。

待验证:亚型间偏倚标准差在实际判读任务里到底多大,没有任何一篇文献报过。42306452 给出的是 logit 尺度的分群偏移,不是百分点;两类量纲能否直接换算、换算后比值落在哪一档,都是空白。此外,「偏科是否随时间稳定」也未测——若它本身是随机漂移,那么分段标定同样会被噪声吃掉。

相关阅读

证据等级: C
参考文献: PMID 42306452, PMID 35754620, PMID 37810544, PMID 28328280, PMID 25546697, PMID 33853549, PMID 30383398

L1 网络状态:该主题尚未进入 L1 对应网络。EDGE_TABLE_science-yixue.md 全 63 行中「kappa/信度/一致/方差/误差/偏倚/校正/亚型/分层」全部 0 命中;CORRESPONDENCE_NETWORK.md 中最接近的仍是第 223 行「E-060 标签前提」(五脏辨证作分组标签|前提|标签信度|状态「冲突(未裁决)」)——该边只登记「标签信度够不够用」,未登记「偏倚随亚型变化时残差从常数变阶梯、以及该阶梯能否被现有样本量看见」。已登记至 L1 缺口表。

证据等级说明:A 表示有 PubMed 直接支撑该结论,B 表示科学类比或间接证据,C 表示传统文化共识或初步探索。本文标 C,是因为该边未进入 L1 网络,且核心判据(三档比值)为代数换算而非实测校准。


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

Bias hurts more when it is biased: whether residuals are constant or a step depends on how scattered the bias is, not on how much it is biased.

Evidence level: C

The previous post stated that “the residual error after correction precisely equals the senior rater’s own bias.” That statement had a hidden premise: this bias is a constant. Once it fluctuates with case subtypes, what you subtract is no longer a single number but an average—the remainder transforms from one flat pan into a stepped ladder.

I. First, Deconstruct “Residual Error Is Constant”

Two raters assess the same cases: Senior A reads “True Value + a”, Novice B reads “True Value + b”. Subtracting B’s overall difference from the average leaves a. This is algebra, undisputed.

The problem lies in treating a as a constant across cases. This assumption is nearly untenable in rater studies—Study 42306452 used multi-faceted Rasch differential rater function analysis on 69 raters scoring 3875 applications, finding that “whether the applicant shares gender or ethnic background” alters a single rater’s severity, with offsets ranging from 0.46 to 1.74 logits; Study 35754620 further expanded this framework into a dual-channel model of “severity and centrality bias simultaneously,” proving that dual-channel bias substantially degrades measurement quality. In other words, a rater is not “overall three points stricter” but “stricter for this group, lenient for that.”

If a fluctuates with subtype k while b remains fixed, the corrected residual becomes a_k, not a single number. Its mean square equals “the square of average bias plus variance among subtypes.” The first half decreases with sample size, the second does not—no matter how many cases you add, it cannot be suppressed.

II. The Switch Is Not How Much Bias, But How Scattered

Using “the proportion of variance due to inter-subtype differences” as the criterion hits an awkwardness: when average bias approaches zero, this proportion necessarily approaches 100%, so the judgment of “most severe bias” coincides with the most benign case where “correction equals white correction.” The criterion is misapplied.

Switching to a dimensionless ratio—inter-subtype standard deviation divided by absolute average bias—the boundary becomes clean: this ratio below one-third means dispersion accounts for less than 10% of total variance, single-constant approximation holds; at two-thirds, dispersion reaches 30%, “residual after correction is constant” must change to “segmented by subtype”; exceeding one, more than half of mean square residual stems from dispersion, subtracting a uniform number is meaningless.

This conversion depends solely on “how scattered,” not on the absolute magnitude of bias.

III. Within the Same Data, This Ratio Varies by Over Tenfold

Study 42306452 reported both types of bias: cross-group average severity offset was only -0.12 and -0.07 logits, while subgroup offsets were 0.46 and 1.74 logits—the former is 7% to 15% of the latter.

According to the above conversion, the ratio falls between seven and fifteen, with dispersion accounting for over 98%. This is not marginal exceedance but complete failure of single-constant approximation—no unified number can be subtracted. The study also provided evidence in the opposite direction: over half of individual raters showed significant gender-based bias, about one-third ethnic-based. Thus this is not a minority issue but widespread among most, just with differing directions—averaging cancels them out, appearing “overall unbiased.”

The danger of “overall slightly biased” lies here: it results from cancellation of large opposing shifts, leaving the small residual least representative.

IV. Can We See the Steps? False Steps Are More Likely Than True Ones

Assume each subtype has only 30 cases and single-rater noise is 8 percentage points. Even if true bias is zero, merely due to sampling, the expected inter-subtype variance is 4.3 squared percentage points. At this point, “false steps” account for 100%.

How large must true dispersion be to suppress this floor? Standard deviation of 1 yields 80% false steps; 2, 50%; 3, 30%; 4.6, 17%; 8, down to 6%. To reduce false steps below 10%, each subtype needs 110 to 1,100 cases, depending on true dispersion ranging from 1 to 8.

Homogeneity testing faces similar difficulties. With three subtypes each of 30 cases and true biases of -2, 0, +2, detection rate is only 22%; reaching 69% requires 120 cases each. When true bias doubles to ±3, detection reaches 44% at 30 cases and 97% at 120. Study 37810544 encountered the same wall in simulation: under sparse design, differential rater function comparison estimates systematically fall below true values, even though “bias was injected, the variance component interacting with raters may still not be detectable.” Study 25546697, when testing scale cross-rater comparability, first controlled rater effects before claiming comparability.

Thus, the only statement we can write is: most rater studies lack sufficient sample size to inform “whether bias exists”; declaring “no difference detected” mistakes null information for negative evidence.

V. Another Hidden Issue: Substituting Averages Can Err by Fivefold

If we care about “how often errors occur,” error rate equals 2p(1−p), where p is the average bias divided by cross-scenario heterogeneity, transformed via normal distribution function. This formula is concave; substituting averages inevitably introduces systematic error, with direction reversing based on distance from zero.

Calculating: when cross-scenario heterogeneity is 3 percentage points, bias fluctuates between 2, 6, 11, and 16 (mean 6.4). Weighted calculation by subtype yields error rate of 1.6%, while substituting average gives 3.2%—five times higher, averaging underestimates risk. Conversely, when bias ranges from -4, -1, +3, +4 (mean -0.9), weighted calculation gives 3.9%, substituted gives 4.9%—this time averaging overestimates risk.

When heterogeneity rises to 5 percentage points, the ratio drops to 1.4; exceeding 8, both methods converge (1:1). The reason lies in concavity flattening: high heterogeneity pushes all subtypes toward the “near 50%” ceiling, smoothing each other out. Thus comes an ironic conclusion—the more consistent across scenarios (lower heterogeneity), the more “useful” yet inaccurate this algorithm becomes.

Evidence and Limitations

Verified: Correction based on senior raters, under constant bias assumption, yields residual error precisely equal to the senior rater’s own bias (algebraic identity). Subtype bias indeed exists and is widespread in real rater data: Study 42306452 found over half of raters exhibited significant gender-based bias; dual-channel bias degrades measurement quality (35754620). Sparse design systematically reduces detection sensitivity of subtype bias (37810544).

Partially Verified: The three-tier criteria (one-third, two-thirds, one) derive from variance decomposition algebraic conversion, mathematically exact; however, the boundaries for “usable/segmented/failing” remain magnitude estimates without empirical calibration. Specific numbers for “false steps” and test power rely on the setting of 8 percentage point single-rater noise and 30 cases per subtype; any change in noise or case count requires recalculation of the entire table.

To Be Verified: No literature reports the actual standard deviation of inter-subtype bias in real rater tasks. Study 42306452 provides logit-scale subgroup offsets, not percentage points; whether these units can be directly converted and which tier the resulting ratio falls into remains unknown. Furthermore, “whether bias stabilizes over time” has not been tested—if it itself drifts randomly, segmentation calibration would also be consumed by noise.

Further Reading

Evidence Level: C
References: PMID 42306452, PMID 35754620, PMID 37810544, PMID 28328280, PMID 25546697, PMID 33853549, PMID 30383398

L1 Network Status: This topic has not yet entered the L1 corresponding network. In EDGE_TABLE_science-yixue.md (63 lines total), all terms “kappa/reliability/consistency/variance/error/bias/correction/subtype/layering” have zero hits; the closest in CORRESPONDENCE_NETWORK.md is line 223 “E-060 label premise” (organ differentiation as grouping labels | premise | label reliability | status “conflict (unresolved)”)—this edge only records “whether label reliability suffices,” not “when bias varies by subtype, residual shifts from constant to stepped, and whether existing sample size can detect this step.” Registered in L1 gap table.

Evidence Level Explanation: A indicates direct PubMed support for the conclusion; B denotes scientific analogy or indirect evidence; C represents traditional consensus or preliminary exploration. This article is marked C because the edge has not entered the L1 network, and the core criterion (three-tier ratio) stems from algebraic conversion rather than empirical calibration.


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *