「7/12」这句话什么都没说:方向投票的检验力下限,与 12 格设计在数学上够不够格

Written by

in

Language

Evidence level: C

一个连「随机」和「高度一致」都分不开的区间,被拿来当三角验证的判据,等于掷骰子。

一、本篇不查假设,只查尺子

三模态同向这个假设本身有没有依据,上一篇查过——同一批早产儿数据里,相位角 60.6° 对 12.5° 分得极开,胸廓贡献比却 25.5% 对 36.3%、p=0.11 毫无差异(PMID 9387956)。那是问”三个模态会不会真同向”。

本篇问下一层:假定它们真同向,你手上这套 3 中心 × 4 模态 = 12 格的投票法,有没有本事把它认出来。 两件事必须分开。假设可以千真万确,而检验它的设计烂到永远说不出话。方法学界把这点叫检验力——它不改变真值,只改变你能不能看见真值。而方向投票最容易漏算它,因为它看起来只是在数数。

二、12 格不是 12 票,门槛在 10/12

先算最基础的一笔。若真值是同向率 50%,12 格出 7 个同向纯属噪声。双侧精确二项检验下:7/12 的 p=0.77,8/12 的 p=0.39,9/12 的 p=0.15,要到 10/12 才第一次跌破 0.05(p=0.039)。

故 12 格的最低门槛是 83%,不是直觉里的”过半就行”。这条线随格数变且不单调:10 格要 9/10,20 格要 15/20(75%),30 格要 21/30(70%)。格数越少,门槛比例越离谱——6 格和 8 格都要全票。因为二项分布在小 n 下方差极大,12 次抛硬币出 8 次正面毫不稀奇;可一旦把”8 次正面”翻译成”三分之二的器官同向变”,话就变重了,分布并没变。

三、7/12 的真实含义:一个宽到无用的区间

比 p 值更该看区间。7/12 点估计 58.3%,Clopper-Pearson 95% 区间是 [0.277, 0.848],宽 0.572。含义要说得直白:真值可能是 28%(基本随机),也可能是 85%(高度一致),数据都兼容。

一个连”随机”和”高度一致”都分不开的区间,拿来当三角验证的判据,等于掷骰子。四种常见读法全不成立:读”失败”——排除不了 85%;读”部分成功”——兼容 28%;读”趋势”——趋势需方向性先验,投票法没有;读”补几格就好”——需要的是四倍以上格数,见第五节。

四、三重共线:12 个格子里有几个是独立的

12 格本身不独立,至少三重打折。

模态之间:%AB、φ、X5、CoV 测的是同一批人同一套呼吸,共享受试者、共享时段、共享”他今天状态如何”。三项水平模型的理由正是这类依赖效应量(PMID 23055166);当四个独立证据用,等于一份数据抄四遍。

中心之内:每个中心只有一批人。设计效应 1+(m−1)×ICC,m=4 时 ICC 取 0.3 得 1.9、取 0.5 得 2.5——12 格折成 6.3 格、4.8 格。折到 6 格后门槛不是 10/12,是 6/6 全票。

方向之内:若真实同向率只有 0.7(已算不错),12 格达 10/12 的概率 25.3%;有效格折到 6.3 掉到 11.8%。八成情况下,真存在的同向信号被判”失败”。

五、反过来一样糟:12/12 也只支持 73.5%

假阳性那侧同样不能放心。12 格全同向看似无可挑剔,但全同向的 95% 区间下界只有 0.735(=0.025^(1/12))。你想说”高度一致”,数据只支持”至少 73.5% 同向”,且不含方向外的任何效应量信息。

压到 0.90 下界需 65 格,0.927 需 49 格。3×4=12 与 49 差四倍——不是”多做一个中心”能填的坑,是设计量级不对。同样的账别人算过:Many Labs 2 常被引作”地点不影响可复现性”,事后功效模拟却发现它查文化异质性的检验力本就不够,所以”没查到”不等于”不存在”(PMID 39379734)。

六、这个坑不是我们独有的

100 篇公共卫生系统综述里,60 篇用了非 meta 合成,其中 54 篇用投票计数——只有 3 篇按方向投,36 篇按统计显著性投,15 篇没说清(PMID 36758885)。

按显著性投更糟:它把”样本够不够”混进”效应在不在”。按方向投也不安全——平票概率不确定时,符号检验在 64 种设计条件里 46 种(71.9%)功效低于 80%,10 种低于 70%(PMID 20974291)。平票就是投不出方向的格子,多到能掏空设计。再加一层:小样本效应量系统性偏大(PMID 23302257),而方向投票给每项研究同等权重,等于把最不可靠的抬到和可靠的一样高。

七、判据三格与做法

第一格——设计不够格,结论作废。 若实测 ICC ≥ 0.3 或模态间相关 ≥ 0.5,有效格折到 6-7 格,12 格设计在任何真实同向率下功效均低于 30%——”7/12 判失败””12/12 判通过”都不得写入结论,只能报”未检出”并附有效格数与功效。

第二格——够格但改口径。 若 ICC < 0.2 且相关 < 0.3、有效格 ≥ 9,可保留 12 格,但报告须三件齐备:门槛写清(10/12)、区间报出(含宽度)、平票单列(不并入任一侧)。缺一项即视为不完整。

第三格——扩到够为止。 要坚持”三角验证通过”,按 p=0.7 达 80% 功效需 49 格、90% 需 65 格。做不到就明写”本研究不具备判定能力”,改报逐模态方向加各自区间,不做跨模态合并。

做法:先用 ≥40 人同批数据估模态间相关矩阵与中心内 ICC,折出有效格,再按折后格数重算门槛与功效,最后落判。明确自认:”ICC 0.3″”相关 0.5″”功效 30%”三个数取自通用惯例、无出处,须由本队列实测反解替换。

证据与局限

已验证:12 格双侧精确二项检验的门槛是 10/12(p=0.039),7/12 的 p=0.77、区间 [0.277, 0.848] 宽 0.572,全同向下界 0.735——均为本次自算,公式与 Clopper-Pearson 法可复算;早产儿与足月儿对照中相位角 60.6° 对 12.5°(p<0.0001)、胸廓贡献比 25.5% 对 36.3%(p=0.11)确为同一批数据(PMID 9387956);依赖效应量须用三项水平模型处理(PMID 23055166);100 篇系统综述中 54 篇用投票计数、仅 3 篇按方向投(PMID 36758885);平票概率不确定时符号检验 71.9% 的设计条件功效低于 80%(PMID 20974291);小样本研究效应量系统性偏大(PMID 23302257);Many Labs 2 查文化异质性的检验力本就不足(PMID 39379734)。

部分验证:上述方法学证据全部来自其他学科(心理学复现、重症 meta 分析、公共卫生综述),无一在气功三模态场景落地;设计效应公式本身是标准式,但 m=4、ICC=0.3-0.5 这两个取值是代入假设,不是实测。

待验证:本方案三模态(%AB/φ/X5/CoV)的模态间相关矩阵与中心内 ICC 实测值——它直接决定有效格是 12 还是 5;平票(方向判不出)的真实发生率,以及该不该并入任一侧;把格数从 12 扩到 49 或 65 在经费与中心数上是否可行;门槛 83% 与”有效格 6-7″之间的判据线在实际数据上会不会出现中间态。

相关阅读

L1 网络状态:该主题尚未进入 L1 对应网络。CORRESPONDENCE_NETWORK 节点表三域登记的全是「信号名」(相位 / 节律、呼吸率 / 呼吸模式、气感报告),无「研究设计 / 检验力 / 样本单位 / 多中心」任何字段;逐词 grep「方向 / 一致性 / 检验力 / 功效 / 样本 / 多中心 / 中心 / 模态 / 投票 / 假阳性」除结构说明里的零星文字外全部 0 命中;边表止于 E-050,状态 open,现代证据栏为「尚无任何可测来源」。故本文证据等级封顶 C。
证据等级: C
参考文献: PMID 9387956, PMID 23055166, PMID 36758885, PMID 20974291, PMID 23302257, PMID 39379734


免责说明:本文属传统知识与科学文献的整理、对照与研究设计讨论,仅供理解与参考,不构成医疗建议,不能替代专业诊断与治疗。文中涉及的效应量、频率区间与暴露结论多为研究报告层面的推断,个体情况差异很大;如有身体不适或健康疑虑,请就医并由专业医师判断。

7/12 Says Nothing: The Lower Bound of Power for Directional Voting and Whether the 12-Grid Design is Mathematically Qualified

Evidence level: C

An interval that cannot distinguish between “random” and “highly consistent” is used as the criterion for triangulation; this is equivalent to rolling dice.

I. This Paper Does Not Test Hypotheses, It Tests the Ruler

Whether the hypothesis of three-modal concordance has any basis was examined in the previous paper—the phase angle 60.6° versus 12.5° is extremely divergent, while the thoracic contribution ratio 25.5% versus 36.3% shows no difference (p=0.11) in the same cohort of preterm infants (PMID 9387956). That addressed whether “the three modalities truly move in the same direction.”

This paper asks the next level: Assuming they do move in the same direction, does your current 3-center × 4-modalities = 12-grid voting method have the power to detect it. Two things must be separated. The hypothesis can be true, while the design to test it is so poor it cannot speak. Methodologists call this power—it does not change the truth, only whether you can see the truth. Directional voting most easily overlooks this because it appears to be merely counting.

II. 12 Grids Are Not 12 Votes; the Threshold Is 10/12

First, the most basic calculation. If the true concordance rate is 50%, getting 7 out of 12 concordant is pure noise. Under two-sided exact binomial testing: 7/12 yields p=0.77, 8/12 yields p=0.39, 9/12 yields p=0.15, reaching 10/12 is the first time it drops below 0.05 (p=0.039).

Thus the minimum threshold for 12 grids is 83%, not the intuitive “more than half.” This line varies with grid count and is non-monotonic: 10 grids require 9/10, 20 grids require 15/20 (75%), 30 grids require 21/30 (70%). Fewer grids make the threshold proportion absurd—6 grids and 8 grids both require unanimous votes. Because binomial distribution variance is huge for small n, getting 8 heads in 12 coin tosses is not remarkable; but translating “8 heads” into “two-thirds of organs moving concordantly” changes the weight, while the distribution itself remains unchanged.

III. The True Meaning of 7/12: An Interval Too Wide to Be Useful

More than the p-value, one should look at the interval. The point estimate for 7/12 is 58.3%, but the Clopper-Pearson 95% interval is [0.277, 0.848], width 0.572. The meaning must be stated plainly: the true value could be 28% (basically random) or 85% (highly consistent); the data are compatible with both.

An interval that cannot separate “random” from “highly consistent” used as the criterion for triangulation is equivalent to rolling dice. All four common readings fail: reading “failure”—cannot exclude 85%; reading “partial success”—compatible with 28%; reading “trend”—trends require directional priors, which voting lacks; reading “add a few grids”—requires four times more grids, see Section V.

IV. Triple Collinearity: How Many of the 12 Grids Are Independent

The 12 grids themselves are not independent; at least three layers of discount apply.

Between modalities: %AB, φ, X5, CoV measure the same people breathing the same way, sharing subjects, sharing time periods, sharing “how he felt today.” The rationale for three-level models is precisely such dependency effect sizes (PMID 23055166); when four independent evidences are used, it equals copying one dataset four times.

Within centers: Each center has only one batch of people. Design effect is 1+(m−1)×ICC; with m=4, ICC=0.3 gives 1.9, ICC=0.5 gives 2.5—12 grids fold to 6.3 grids, 4.8 grids. Folding to 6 grids makes the threshold not 10/12, but 6/6 unanimous.

Within directions: If the true concordance rate is only 0.7 (already quite good), the probability of reaching 10/12 in 12 grids is 25.3%; effective grids fold to 6.3 drops this to 11.8%. In eight cases, the true concordant signal is judged “failed.”

V. Conversely, 12/12 Also Only Supports 73.5%

The false-positive side is equally unworthy of trust. All 12 grids concordant appears flawless, but the lower bound of the 95% interval for all-concordant is only 0.735 (=0.025^(1/12)). To claim “highly consistent,” the data only support “at least 73.5% concordant,” and contain no information about effects outside the direction.

Reaching a lower bound of 0.90 requires 65 grids, 0.927 requires 49 grids.3×4=12 differs from 49 by four times—not something filled by “adding one more center,” but a mismatch in design scale. Others have calculated this: Many Labs 2 is often cited as “location does not affect replicability,” but post-hoc power simulation found its ability to detect cultural heterogeneity has insufficient power, so “not detected” does not mean “does not exist” (PMID 39379734).

VI. This Pit Is Not Unique to Us

Among 100 public health systematic reviews, 60 used non-meta synthesis, of which 54 used vote counting—only 3 voted by direction, 36 by statistical significance, 15 did not clarify (PMID 36758885).

Voting by significance is worse: it mixes “sample size sufficient” into “effect present.” Voting by direction is also unsafe—when tie probability is uncertain, the sign test has power below 80% in 46 of 64 design conditions (71.9%), and below 70% in 10 conditions (PMID 20974291). A tie means no grid can determine direction, enough to empty the design. Add another layer: small-sample effect sizes are systematically inflated (PMID 23302257), while directional voting gives equal weight to each study, elevating the least reliable to the same level as the most reliable.

VII. Criteria for Three Grids and Procedures

First grid—design insufficient, conclusion void. If measured ICC ≥ 0.3 or inter-modal correlation ≥ 0.5, effective grids fold to 6–7; the 12-grid design has power below 30% under any true concordance rate—”7/12 judged failed,” “12/12 judged passed” cannot be written in conclusions, only report “not detected” with effective grid count and power.

Second grid—sufficient but adjust criteria. If ICC < 0.2 and correlation < 0.3, effective grids ≥ 9, keep 12 grids but reporting must include three items: threshold clearly stated (10/12), interval reported (with width), ties listed separately (not merged to either side). Missing any item renders it incomplete.

Third grid—expand until sufficient. To maintain “triangulation passed,” achieving 80% power at p=0.7 requires 49 grids, 90% requires 65 grids. If not possible, clearly state “this study lacks adjudication capacity,” report directional addition per modality with respective intervals, without cross-modal merging.

Procedure: First estimate inter-modal correlation matrix and within-center ICC using ≥40 subjects from the same batch, fold to effective grids, then recalculate threshold and power based on folded grids, finally render judgment. Explicitly acknowledge: “ICC 0.3,” “correlation 0.5,” “power 30%” are three numbers taken from general convention without source, must be replaced by empirical measurement from this cohort.

Evidence and Limitations

Verified: The threshold for 12-grid two-sided exact binomial test is 10/12 (p=0.039), 7/12 yields p=0.77, interval [0.277, 0.848] width 0.572, all-concordant lower bound 0.735—all self-calculated here, formulas and Clopper-Pearson method can be re-verified; phase angle 60.6° versus 12.5° (p<0.0001), thoracic contribution ratio 25.5% versus 36.3% (p=0.11) are indeed from the same dataset of preterm versus term infants (PMID 9387956); dependency effect size must be handled via three-level model (PMID 23055166); among 100 systematic reviews, 54 used vote counting, only 3 by direction (PMID 36758885); when tie probability is uncertain, sign test power falls below 80% in 71.9% of design conditions (PMID 20974291); small-sample studies show systematic inflation of effect sizes (PMID 23302257); Many Labs 2 has insufficient power to detect cultural heterogeneity (PMID 39379734).

Partially verified: All methodological evidence comes from other disciplines (psychology replication, intensive care meta-analysis, public health reviews); none has been implemented in the Qigong three-modal scenario; the design effect formula itself is standard, but m=4, ICC=0.3–0.5 are assumed values, not measured.

To be verified: The inter-modal correlation matrix and within-center ICC for this three-modal scheme (%AB/φ/X5/Cov)—this directly determines whether effective grids are 12 or 5; the true incidence of ties (direction cannot be judged), and whether they should merge to either side; feasibility of expanding grids from 12 to 49 or 65 given budget and center count; whether the threshold line between 83% and “effective grids 6–7” appears as an intermediate state in actual data.

Related Reading

L1 Network Status: This topic has not entered the corresponding L1 network. The CORRESPONDENCE_NETWORK node table registers only “signal names” (phase/rhythm, breathing rate/breathing pattern, qi sensation report) across three domains; there are no fields for “research design/power/sample unit/multi-center.” Grep-ing terms like “direction/consistency/power/effect/sample/multi-center/center/modality/vote/false positive” yields zero hits except scattered text in structural descriptions; edge table stops at E-050, status open, modern evidence column reads “no measurable source yet.” Hence this paper’s evidence level caps at C.
Evidence Level: C
References: PMID 9387956, PMID 23055166, PMID 36758885, PMID 20974291, PMID 23302257, PMID 39379734


Disclaimer: This article compiles traditional knowledge and scientific literature for comparison and research-design discussion only. It is not medical advice and cannot replace professional diagnosis or treatment. Effect sizes, frequency ranges and exposure conclusions cited here are largely inferences at the research-report level, and individual circumstances vary widely. If you have any discomfort or health concerns, please consult a physician.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *