Evidence level: C
分半稳不稳定,先要问清「一半」是什么的一半;单位一换,系数就不在同一个坐标系里了。
一、问题是怎么欠下来的
上一轮只确认了分半口径会决定 Jaccard 数值,没说变多少。而「差 0.03」与「差 0.20」后果完全不同:前者只是记法不统一,后者意味着过去按不同口径报的稳定性数字放在一起比就是错的。丹田数据每人多次重复测量,两种切法都合法、都不缺数据——所以这个差必须量出来。
二、分半系数从来不是「同一个量的两种算法」
Green 在 2003 年拆掉了那个默认:时间间隔会引入瞬态误差(心情、状态、昼夜漂移),一旦存在,alpha 就是信度的高估;他为此推出 test-retest alpha,并指出「test-retest 分半系数」是所有可能的跨时间分半系数的均值(PMID 12741675)。跨时间分半得到的是被重新定义的量,把瞬态误差算进了分母——不是原系数的另一种算法。按次切与按人切,从一开始就不在估同一个东西。
三、按次切会把「同一个人」拆到两边
同一个人的第一次进左半、第二次进右半,这两次本就高度相似,而这个相似来自他这个人、不来自筛选规则。这是伪重复:同一个体被当成两个独立观测单位。Becker 指出,测量误差一旦相关,信度估计被系统性抬高;他给的对策正是把等价半构造在两批不同测量场合上,但警告构造不当时失真方向可以反转、幅度在单维性不足时相当大(PMID 11783569)。所以按次切的偏高不是「略微」,偏差方向可以两头跑。
四、概化理论把这件事讲清楚了
概化理论把总方差拆成人、场合、条目及其交互,拆开之后信度就不是一个数。2026 年一项用该框架评估贝克抑郁与绝望量表的研究给出量化:个体差异变化的信度(Rc)与人内变异的信度(Rcn)是两个独立系数,方差分解显示前者占 15%、后者占 17%–19%(PMID 41801754)。这提供了一条读法——按人切大致问「换一批人,规则还成立吗」,按次切大致问「换一次测量,还复现吗」。两个都是真问题,只是不同的问题。
五、差值会跟着人内相关放大,还有第三层
若虚高机制确是人内相关被当成规则证据,则两套切法的差值应随 ICC_person 单调放大,差值本身就成了诊断量。还有一层容易漏的:密集纵向数据是「每人每天多次」的三层结构(次嵌套于天、天嵌套于人),常规做法只当两层。模拟显示层次数设错会造出虚假结论——方差被膨胀、自回归估计被扭曲,且存在自相关时「天层方差是否为零」的检验本身不可靠(PMID 27378986)。丹田数据若一天测多次,按次切恰好就是把这个三层压成两层。
六、但按次切不能一概判错
若研究问题本就是「单次测量之间能否复现」,按次切是对的,删掉它反而删掉要测的东西。真正的问题不是哪种切法正确,而是报数字时不写清单位。可操作顺序:先写清要回答「换人」还是「换次」,再选单位;报数时单位与切刀数一起写;跨研究比较只在同单位同刀数之间进行。另有一个不可比来源:即便同为按人切,ICC 也有十种形式,必须报型号(PMID 27330520)。
七、换问法:四个动作,四条判据
动作:同一批数据并行跑两套切法,各报 Jaccard、超额稳定性与入选频率;同时估 ICC_person;做差值对 ICC_person 的回归;用分位数下界而非最优切点报下界(最优分半在小样本下显著高估信度,PMID 24306557)。另有脑电研究直接示范了「换个单位当 item 会低估信度」(PMID 19055503)。
判据:按次切高出按人切 >0.15 ⇒ 判为虚高,既往按次切结论一律不可采信;差 <0.05 ⇒ 单位不影响结论,统一按人切以简化;差值随 ICC_person 单调放大 ⇒ 该差可作人内相关代理读法,须逐数据集校正后再比;按次切稳定性更高而两者选对率相同 ⇒ 指标被口径污染,只能同口径内比。
证据与局限
已验证: 跨时间分半引入瞬态误差、得到的是被重新定义的量(PMID 12741675);测量误差相关抬高信度、等价半构造不当可使失真反向(PMID 11783569);概化理论下「个体差异变化」与「人内变异」是两个独立系数(PMID 41801754);密集纵向数据层次数设错造成方差膨胀与估计误导(PMID 27378986);最优分半小样本下显著高估信度(PMID 24306557);ICC 十种形式不报型号则数值不可比(PMID 27330520);把分段当 item 会低估信度(PMID 19055503)。
部分验证: 上述结论均出自心理测量、脑电与临床量表场景。把单位从条目换成受试者或测量次数,机制上同构,但没有文献直接在「参数入选集合的 Jaccard」上验证过差量级——属类比迁移。
待验证: ① 丹田参数上两套切法的实际差值从未测过,0.05 与 0.15 两条线是从信度文献平移来的、未对真值标定;② 差值随 ICC_person 单调放大只是推演,无实测曲线;③ 切四份、切八份时差值如何变化未知;④ 按次切虚高部分能否用 ICC_person 精确扣回,取决于人内相关是否稳定;⑤ 本篇证据薄弱,主论点属可测假设,不宜当已确认机制引用。
相关阅读
证据等级: C
参考文献: PMID 12741675, PMID 11783569, PMID 41801754, PMID 27378986, PMID 24306557, PMID 27330520, PMID 19055503
L1 网络状态:该主题尚未进入 L1 对应网络——CORRESPONDENCE_NETWORK.md节点表按易学/中医侧、物理侧、生理/体验侧三类域分派(原文「| 节点 | 各域的概念/量(五行、五脏、频率、颜色…) | 按域分派(见下表) |」),三类域均无「分半单位 / 人内相关 / 方差来源 / 信度系数」这类测量学节点;边表止于 E-050(「六十甲子纳音 | 对应 | 60 个频率」,层级 L1、状态 open,现代证据栏原文「尚无任何可测来源」),无任何以测量单位为源或目标的边。EDGE_TABLE_science-yixue.md为概念反抽统计,仅列概念计数与最高证据级,无 L1/L2/L3 层级与 active/open/conflict 状态判定,故本条边状态为缺。
免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。
Cut by person or cut by frequency: the same \”split coefficient\” might actually be measuring two different things
Evidence level: C
Whether the split-half reliability is stable depends first on defining what constitutes “half.” Changing the unit shifts the coefficient out of the same coordinate system.
I. How the Problem Accumulates
The previous round confirmed that split-half methodology determines the Jaccard value but did not specify the magnitude of change. A difference of “0.03” versus “0.20” yields entirely different consequences: the former suggests inconsistent notation, while the latter implies that comparing stability figures reported under different methodologies is fundamentally erroneous. Dantian data allow for repeated measurements per individual; both splitting methods are valid and do not compromise data availability. Therefore, this discrepancy must be quantified.
II. The Split-Half Coefficient Is Never “Two Algorithms for the Same Quantity”
Green dismantled this default in 2003 by noting that time intervals introduce transient errors (mood, state fluctuation, circadian drift). If such errors exist, alpha constitutes an overestimation of reliability. He proposed the test-retest alpha and indicated that the “split-half coefficient across time” represents the mean of all possible cross-temporal split-half coefficients (PMID 12741675). The cross-temporal split yields a redefined quantity where transient errors are incorporated into the denominator—it is not merely an alternative algorithm for the original coefficient. Split-by-item and split-by-individual have never estimated the same underlying construct from the outset.
III. Split-by-Item Fragments “The Same Individual” Across Splits
In split-by-item, an individual’s first measurement enters the left half and the second enters the right half. These two measurements are inherently highly similar due to the individual themselves, not the selection rules. This constitutes pseudo-replication: treating the same subject as two independent observational units. Becker noted that when measurement errors are correlated, reliability estimates are systematically inflated; his remedy involves constructing equivalent halves across two distinct measurement occasions, yet he warned that improper construction can reverse the direction of distortion and amplify magnitude when unidimensionality is insufficient (PMID 11783569). Thus, the inflation in split-by-item is not merely “slight”; the bias direction can swing either way.
IV. Generalizability Theory Clarifies the Matter
Generalizability theory decomposes total variance into persons, occasions, items, and their interactions. Once decomposed, reliability is not a single number. A 2026 study applying this framework to the Beck Depression and Hopelessness Scales provided quantification: reliability for individual-difference change ($R_c$) and reliability for within-person variance ($R_{cn}$) are two independent coefficients. Variance decomposition showed the former accounts for 15% and the latter for 17%–19% (PMID 41801754). This offers a reading perspective: split-by-item roughly asks, “Does the rule hold with a new batch of people?” while split-by-item roughly asks, “Is it reproducible with a new measurement occasion?” Both are valid questions, but they address different constructs.
V. The Difference Amplifies with Within-Subject Correlation and Adds a Third Layer
If the inflation mechanism relies on within-subject correlation being treated as rule-based evidence, the difference between the two splitting methods should monotonically increase with $ICC_{person}$, making the difference itself a diagnostic metric. There is another layer often overlooked: dense longitudinal data possess a three-level structure (items nested within days, days nested within persons), yet standard practice often treats it as two levels. Simulation shows that mis-specifying the number of levels creates false conclusions—variance is inflated, autoregressive estimates are distorted, and when autocorrelation exists, the test for whether “day-level variance is zero” itself becomes unreliable (PMID 27378986). If Dantian data are collected multiple times daily, split-by-item effectively compresses this three-level structure into two.
VI. But Split-by-Item Is Not Universally Wrong
If the research question is inherently “can replication occur between single measurements,” split-by-item is correct; removing it deletes the very thing to be measured. The core issue is not which splitting method is correct, but whether units are explicitly stated when reporting numbers. A practical sequence: first clarify whether one is answering “changing people” or “changing occasions,” then select the unit; report numbers alongside the unit and the number of cuts; cross-study comparisons should only occur within identical units and cut counts. Another source of non-comparability exists: even with split-by-individual, there are ten forms of ICC, and the model type must be reported (PMID 27330520).
VII. Rephrasing the Question: Four Actions, Four Criteria
Actions: Run both splitting methods on the same dataset in parallel, reporting Jaccard values, excess stability, and inclusion frequencies; simultaneously estimate $ICC_{person}$; perform regression of the difference against $ICC_{person}$; report lower bounds using percentile cutoffs rather than optimal split points (optimal splitting significantly overestimates reliability in small samples, PMID 24306557). Additionally, EEG studies directly demonstrate that “changing the unit to an item can underestimate reliability” (PMID 19055503).
Criteria: If split-by-item exceeds split-by-individual by >0.15 ⇒ classify as inflated; all prior conclusions based on split-by-item are unacceptably invalid. If difference <0.05 ⇒ units do not affect conclusions; standardize to split-by-individual for simplicity. If the difference monotonically amplifies with $ICC_{person}$ ⇒ treat this difference as a proxy read for within-subject correlation, requiring calibration per dataset before comparison. If split-by-item shows higher stability while selection accuracy remains identical ⇒ the metric is contaminated by definition; comparison should only occur within the same definition.
Evidence and Limitations
Verified: Cross-temporal splitting introduces transient errors yielding a redefined quantity (PMID 12741675); correlated measurement errors inflate reliability, and improper equivalent half construction can reverse distortion direction (PMID 11783569); under Generalizability Theory, “individual-difference change” and “within-person variance” are independent coefficients (PMID 41801754); mis-specifying levels in dense longitudinal data causes variance inflation and estimation bias (PMID 27378986); optimal splitting significantly overestimates reliability in small samples (PMID 24306557); failure to report ICC model type renders values incomparable (PMID 27330520); treating segments as items underestimates reliability (PMID 19055503).
Partially Verified: The above conclusions derive from psychometrics, EEG, and clinical scale contexts. Mechanistically isomorphic when switching units from items to subjects or measurement counts, but no literature directly validates the magnitude of differences on “Jaccard values within parameter selection sets”—this relies on analogical transfer.
To Be Verified: ① The actual difference between the two splitting methods on Dantian parameters has never been measured; the 0.05 and 0.15 thresholds are translated from reliability literature without true value calibration; ② The monotonic amplification of difference with $ICC_{person}$ is a deduction without empirical curves; ③ How differences change when splitting into four or eight parts remains unknown; ④ Whether the inflated portion in split-by-item can be precisely recovered via $ICC_{person}$ depends on the stability of within-subject correlation; ⑤ Evidence in this paper is weak; main arguments constitute testable hypotheses and should not be cited as confirmed mechanisms.
Related Reading
- Threshold Stability for Granting Parameters Entry: Does the Set Filtered by “SNR ≥ 2” Change with Half the Population?
- Two Thresholds for Excess Stability Are Derived via Analogy; True Values Have Never Been Measured
- Will the Three Verdict Criteria Lines Conflict? Do Not Use Kappa to Judge
- Environment-Life Frequency Interface
Evidence Level: C
References: PMID 12741675, PMID 11783569, PMID 41801754, PMID 27378986, PMID 24306557, PMID 27330520, PMID 19055503
L1 Network Status: This topic has not yet entered the L1 corresponding network—theCORRESPONDENCE_NETWORK.mdnode table assigns nodes to Yijing/TCM, Physics, and Physiological/Experiential domains (original text: “| Node | Concepts/Quantities per Domain (Five Phases, Five Organs, Frequencies, Colors…) | Domain Assignment (see table below) |”), but none of the three domains contain measurement nodes such as “split-half units,” “within-subject correlation,” “variance sources,” or “reliability coefficients.” The edge table terminates at E-050 (“Six Heavenly Stems and Earthly Branchs Na-Yin | Corresponds | 60 Frequencies,” Level L1, Status open; modern evidence column originally states “No measurable sources at all“). There are no edges with measurement units as source or target.EDGE_TABLE_science-yixue.mdis a conceptual back-extraction statistic listing only concept counts and highest evidence levels, lacking L1/L2/L3 hierarchies and active/open/conflict status determinations; therefore, the status of this edge is missing.
Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.
Leave a Reply