Evidence level: C
同一读者在同一个会话内把同一例判读两遍,这两遍并不是两次独立观察;会话内相关性越高,有效自由度越接近「例数」而不是「例数×遍数」,样本量表必须按折减系数修订才算数。
正文
气功外气研究中,脉象/得气类判读常采用「同一位读者、同一会话内、对同一批例子重复判读多遍」的设计,然后按「例数 × 遍数」申报自由度,希望用翻倍的 df 换取更窄的置信区间和更小的样本量下限。前一轮 #1556 就按「df≈例数×构型」的粗口径反推过所需例数。这个口径有一个隐藏前提:同一读者在同一会话内读同一例的两遍,是两次互相独立的测量。但真实判读流程里,两遍之间隔着的时间只有几秒到几分钟,读者的注意状态、判读习惯、对前一判读的记忆几乎完全共享——这两遍高度相关。
统计学对此有一个现成的量化工具,即设计效应(design effect):当组内观测相关为 ρ、每组重复 r 遍时,有效样本量等于名义样本量除以 (1 + (r – 1)ρ)。把这个公式套到自由度上,折减系数就是它的倒数。按三遍重复(r=3)算:会话内相关 ρ=0.1 时折减到 0.83,ρ=0.3 时折减到 0.63,ρ=0.5 时只剩 0.50,ρ=0.7 时只剩 0.42。backlog 里预估「实际 df 可能只有名义的 60%-80%」,对应 ρ 落在 0.1 到 0.3 之间,属于完全合理的区间——问题不是会不会折减,而是折减后样本量表还作不作数。
我们用蒙特卡洛仿真把两套口径的置信区间覆盖率比了一遍:30 例、每例 3 遍、检验群体均值,重复 4 万次。结果非常清楚。按名义口径(df = 例数 × 遍数)构造的 95% 置信区间,在 ρ=0 时覆盖率是 0.951,一切正常;一旦会话内相关升到 0.3,覆盖率掉到 0.876;0.5 时掉到 0.832;0.7 时只剩 0.791。翻译成人话:如果你把三遍当三次独立观察,声称 95% 的把握,实际只有 80% 左右——每一次「达标」的结论都更可能是运气。而换用保守口径,只按每例的均值、以 df=例数-1 构造区间,覆盖率在所有 ρ 水平都稳定在 0.948 到 0.951 之间,一分不多一分不少。这个结果的实践含义很硬:与其去精确标定折减系数,不如直接从「例数」口径起步,覆盖率天然有保证,ρ 拍不准也伤不到结论。
那折减系数到底要不要标定?要,但目的变了。仿真给出的裁决是:ρ≤0.1(折减≥0.83)时名义口径勉强可用但已偏薄,不建议依赖;ρ 落在 0.1 到 0.5 之间时,直接采用例数口径最稳,样本量表按「有效 df≈例数」重估;真正危险的场景是 ρ 在个体之间不稳定——文献已经有证据表明这一点。压力痛阈测量研究用线性混合模型分解方差分量后发现,同一测量者在会话内重复的读数之间存在不可忽略的相关(inter-session-repetition ICC 0.73,明显低于人们习惯报告的 inter-session ICC 0.88)(PMID 33767329)——重复次数越多,相关越藏不住。贝叶斯框架下的研究更进一步指出,个体内的方差并非同质,个体层面的 ICC 可能相差六倍,传统单一 ICC 掩盖了这种个体差异(PMID 34816384)。这意味着折减系数不是一个大锅饭常数:新手读者、熟手读者、同一读者的不同状态,折减可能不同。backlog 预设的第三种分支「折减随读者经验漂移,则 df 申报必须附带经验档位」因此不是过度设计,而是被现有信度文献支持的必要动作。
落到可执行层面,标定协议与 #1556 的框架一致:≥20 例、同一读者同会话内每例读 3 遍、隔周再读 3 遍,用混合模型把会话内、会话间、读者间三个方差分量拆开,算出有效 df 与名义 df 之比。判据分三档:比值≥0.85,粗口径可用,样本量表不动;比值落在 0.6 到 0.85 且跨批稳定,样本量表按折减系数统一上调、例数下限按 1/折减放大;比值随读者经验显著漂移,df 申报必须带经验档位,并写进方法学一节供跨研究比较。需要提醒的是「≥0.85 就不修表」这一档别急着当绿灯:仿真的 0.83 折减档(ρ=0.1)覆盖已经到 0.927,离名义 0.95 有差距。更稳妥的做法是无论标定结果如何,新研究的申报 df 一律从例数口径起步,把「翻倍」当作红利而不是底数。
这里还给样本量规划领域一个直接的验证支点:信度研究样本量规划确有成熟精度框架(PMID 24338600,2014),且样本量对重测信度估计有实质影响(PMID 40119099,2025)。把这两个方法与上述方差分量分解接上,就可以回答「到底要多少人、多少遍,才能把折减系数标定到能用的精度」——这正是本主题的下一个可测问题。
证据与局限
已验证: 设计效应公式给出折减系数的闭式解;蒙特卡洛仿真(4 万次重复)显示名义口径覆盖率在 ρ≥0.3 时跌破 0.90,例数口径全程稳定在 0.95 附近。
部分验证: 重复读数相关性与个体方差异质性有信度研究文献支撑(PMID 33767329 / 34816384),但对象是压力痛阈与认知任务,不是脉象/得气判读本身。
待验证: 气功外气判读场景下的会话内相关实测标定尚未进行;「折减系数跨人群可迁移」与「随读者经验漂移」两个竞争假设还没有本领域数据裁决。
相关阅读
L1 网络状态:该主题(会话内相关对有效自由度的折减)在 CORRESPONDENCE_NETWORK / EDGE_TABLE 中无对应边;最近邻条目 E-061 仅涉深呼吸 HRV 稳定性(静息 ICC 0.50-0.83、频域差于时间域),可作「读数可靠性随构型漂移」的类比旁证,但非本命题的直接证据。该边尚未进入 L1 对应网络,本文证据等级封顶 C。
证据等级: C
参考文献: PMID 33767329, PMID 34816384, PMID 24338600, PMID 40119099
免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。
How much does within-session correlation consume effective degrees of freedom: doubling or halving df when reading the same critique twice?
Evidence level: C
When the same reader judges the same set of cases twice within a single session, these two readings are not independent observations. The higher the intra-session correlation, the closer the effective degrees of freedom (df) approach the raw number of cases rather than “cases × repetitions.” Consequently, sample size scales must be revised using a reduction factor to remain valid.
Body
In Qi功 external Qi research, pulse diagnosis / “getting Qi” type judgments often employ a design where “the same reader, within the same session, repeatedly judges the same batch of cases multiple times,” then declares degrees of freedom as “cases × repetitions.” This approach hopes to double the df to achieve narrower confidence intervals and lower sample size thresholds. Previous entry #1556 already back-calculated required case numbers using this coarse definition of “df ≈ cases × configuration.” This definition carries a hidden assumption: that two readings of the same case by the same reader within the same session represent two mutually independent measurements. However, in real judgment workflows, the time gap between readings is only a few seconds to minutes; the reader’s attentional state, judgment habits, and memory of the previous judgment are almost entirely shared—making these two readings highly correlated.
Statistics offers a ready quantification tool for this: the design effect. When intra-group observations correlate at ρ and each case is repeated r times, the effective sample size equals the nominal sample size divided by (1 + (r – 1)ρ). Applying this formula to degrees of freedom, the reduction factor is its reciprocal. Calculating for three repetitions (r=3): with intra-session correlation ρ=0.1, the reduction drops to 0.83; at ρ=0.3, it becomes 0.63; at ρ=0.5, only 0.50 remains; and at ρ=0.7, just 0.42. The backlog estimated that “actual df may be only 60%-80% of the nominal value,” corresponding to ρ falling between 0.1 and 0.3—a fully reasonable range. The issue is not whether reduction occurs, but whether the revised sample size scale still holds water.
Monte Carlo simulations compared confidence interval coverage under both scales: 30 cases, each read 3 times, testing population means, repeated 40,000 times. The results are clear. Constructing 95% confidence intervals using the nominal scale (df = cases × repetitions) yields coverage of 0.951 when ρ=0—everything works as expected. Once intra-session correlation rises to 0.3, coverage drops to 0.876; at 0.5 it falls to 0.832; and at 0.7 it plummets to only 0.791. In plain terms: if you treat three readings as three independent observations and claim 95% confidence, the actual coverage is only around 80%—every “successful” conclusion is more likely due to chance. Switching to the conservative scale, which uses only the mean per case and constructs intervals with df = cases – 1, stabilizes coverage between 0.948 and 0.951 across all ρ levels—no more, no less. The practical implication is hard: Rather than precisely calibrating the reduction factor, start directly from the “cases” scale; coverage is naturally may support, and inaccurate ρ estimates won’t harm conclusions.
So does the reduction factor need calibration? Yes, but its purpose shifts. The simulation verdict states: when ρ ≤ 0.1 (reduction ≥ 0.83), the nominal scale is barely usable but already too thin; do not rely on it. When ρ falls between 0.1 and 0.5, directly adopting the case scale is most stable; re-estimate sample size scales using “effective df ≈ cases.” The truly dangerous scenario is when ρ varies unstably across individuals—literature already provides evidence for this. Pressure pain threshold studies decomposed variance components using linear mixed models and found non-negligible correlation between repeated readings by the same measurer within a session (inter-session-repetition ICC 0.73, significantly lower than the commonly reported inter-session ICC of 0.88) (PMID 33767329)—the more repetitions, the harder to hide correlation. Bayesian framework research further indicates that within-individual variance is not homogeneous; individual-level ICCs may differ by up to sixfold, with traditional single ICCs masking such individual differences (PMID 34816384). This means the reduction factor is not a one-size-fits-all constant: novice readers, experienced readers, and different states of the same reader may experience different reductions. The backlog’s third branch—”reduction shifts with reader experience, so df declaration must include experience tiers”—is therefore not over-designed but supported by existing reliability literature.
At the actionable level, the calibration protocol aligns with #1556’s framework: ≥20 cases, each read 3 times by the same reader within the same session, then re-read 3 times weekly apart. Use mixed models to decompose variance components into intra-session, inter-session, and inter-reader parts, calculating the ratio of effective df to nominal df. Criteria fall into three tiers:
– Ratio ≥ 0.85: coarse scale usable; sample size scales remain unchanged.
– Ratio between 0.6 and 0.85 with stability across batches: sample size scales uniformly scaled up by the reduction factor; case number thresholds multiplied by 1/reduction.
– Ratio significantly shifts with reader experience: df declaration must include experience tiers, written into the methodology section for cross-study comparison.
Caution: do not rush to treat “≥0.85 = no adjustment” as a green light. The simulated 0.83 reduction tier (ρ=0.1) already yields coverage of 0.927, falling short of the nominal 0.95. A safer approach is to always start new study df declarations from the case scale, treating “doubling” as a bonus rather than the baseline.
This also provides direct validation for sample size planning in reliability research: established precision frameworks exist (PMID 24338600, 2014), and sample size substantially affects reliability estimation via retest (PMID 40119099, 2025). Connecting these methods with the above variance decomposition answers “how many people and how many repetitions are needed to calibrate the reduction factor to usable precision”—which is the next measurable question of this topic.
Evidence and Limitations
Verified: The design effect formula yields a closed-form solution for the reduction factor; Monte Carlo simulations (40,000 repetitions) show nominal-scale coverage drops below 0.90 when ρ ≥ 0.3, while the case-scale remains stable near 0.95 throughout.
Partially Verified: Reliability literature supports correlations between repeated readings and heterogeneity in individual variance (PMID 33767329 / PMID 34816384), but these studies focused on pressure pain thresholds and cognitive tasks, not pulse diagnosis / “getting Qi” judgments themselves.
Pending Verification: Actual calibration of intra-session correlation in Qi功 external Qi judgment scenarios has not yet been conducted; competing hypotheses—”reduction factor is transferable across populations” vs. “reduction shifts with reader experience”—lack domain-specific data to adjudicate them.
Related Reading
- The Bottom Card of Degrees of Freedom: Compressing df from 200 to 20, How Does the Mid-Range Window Narrow?
- Point Robustness Can’t Save the Interval: How to Configure the Order-Preserving Inflation Factor?
- Tri-Axis Usable Domain: How to Navigate the m-Axis Window Boundary?
- Research Pool 1: Resonance Consciousness Field
L1 Network Status: This topic (intra-session correlation’s reduction of effective degrees of freedom) has no corresponding edge in the CORRESPONDENCE_NETWORK / EDGE_TABLE; nearest neighbor entry E-061 only involves breathing HRV stability (resting ICC 0.50–0.83, frequency domain worse than time domain), serving as an analog side evidence for “reading reliability drifting with configuration,” but not direct evidence for this proposition. This edge has not yet entered the L1 correspondence network; thus, this topic’s evidence level caps at C.
Evidence Level: C
References: PMID 33767329, PMID 34816384, PMID 24338600, PMID 40119099
Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.
Leave a Reply