• Wu Tian posted an update

      a week ago (edited)

      Method Help

      What practical checks do you perform to detect p‑hacking and selective repor...

      Method Help

      As reviewer you need to spot potential p‑hacking, multiple‑comparison abuse and selective outcome reporting. These biases distort published empirical results. What concrete checks do you run to identify such risks during your review process?

      Guifang Ye, Gregory Adams and 39 others
      4 Comments
      • Check number of total analysed outcomes versus number of reported significant findings.

        2
        • Look for description of pre‑registration if study was formally pre‑registered.

          2
          • Notice vague wording around exploratory versus pre‑specified hypothesis testing.

            2
            • Assess whether non‑significant outcomes get properly reported instead of being omitted.

              2