p値・有意差対策

JAMA Psychiatry 2024の論文より

ネットワークメタアナリシスや要素ネットワークメタアナリシスの結果を可視化するときに、Kilim plotなどを使用しますが、その際にいわゆる統計学的有意差 (p<0.05) にとらわれないようにしています。ただ、統計学的有意差かどうかに気をつけるよう査読コメントがつけられることがあり、その時のレスポンスを備忘録がてら共有します。

なお、仮説検定とp値に関しては佐藤俊太朗先生のブログ記事もご参照のこと。

RESPONSE

We appreciate the opportunity to clarify this point. In our paper we tried to emphasize and focus on estimated effects and their corresponding precision, and to avoid significance testing based on an arbitrary threshold for p-value. This approach has been endorsed by American Statistical Association [1], many prominent researchers [2], and current textbooks on epidemiologic methods [3]. Please note that using statistical significance is particularly problematic in network meta-analysis, as all associated problems are exacerbated by multiple testing issues [4].

[1] Wasserstein RL, Lazar NA.The ASA statement on p-values: context,process, and purpose. Am Stat. 2016;70:129-133. doi:10.1080/00031305.2016.11541086.

[2] Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance, Nature, https://www.nature.com/articles/d41586-019-00857-9

[3] Lash TL, VanderWeele TJ, Haneuse S, et al. Modern Epidemiology.4th ed. Lippincott Williams & Wilkins; 2021. https://www.acpjournals.org/doi/10.7326/M23-2430

[4] Efthimiou O, White I. The dark side of the force: Multiplicity issues in network meta-analysis and how to address them https://doi.org/10.1002/jrsm.1377


投稿日

最終更新日

投稿日カテゴリー:

投稿者: