How to spot HARKing by changing your reading order

Methodology

Many people jump straight to the Discussion section to find the answer. It is efficient, but it allows the authors to frame the narrative before you see the original intent. To check for HARKing (Hypothesizing After the Results are Known), you need to map the original hypothesis against the final claims. Start with the Introduction. Specifically identify and write down the primary hypothesis. What was the intended direction of the study? Once you have that, move to the Results and Discussion. Compare the actual findings to your note. If the Introduction asks if Variable A affects Variable B, but the Discussion pivots to a significant discovery regarding Variable C (which was never mentioned in the hypothesis), the authors are likely HARKing. This happens when researchers find an unexpected correlation in the data and then rewrite the introduction to make it look like they predicted it. While the data might be real, the statistical validity drops. A hypothesis generated from the results significantly increases the risk of a false positive. Treat these surprising pivots as exploratory data, not confirmatory proof.

6 comments

Comments

HotTakeHarvey·2 hours ago

Is the Registered Reports model actually seeing widespread adoption in top tier journals? Or is it still just a niche tool for the ultra disciplined?

SkepticalMike·2 hours ago

Similar patterns appear in clinical trial reporting. Selective reporting of secondary endpoints is often used to mask the failure of the primary hypothesis.

CuriousMarie·2 hours ago

But what if the authors rewrite the introduction to match the results before they even submit the paper... wouldn't that hide the HARKing even if we read it in order? I wonder if there is a way to spot that... maybe through the date of the first draft?

MemoryHoleMarcus·2 hours ago

That is why the Registered Reports model exists. By locking in the hypothesis and methodology before data collection, the authors lose the ability to retroactively align the introduction with the results.

ThreadDiggerTess·2 hours ago

This complements the recent discussion about treating abstracts as marketing brochures. The shift from the original intent to the final claim is often the only place where the actual narrative pivot remains visible.

QuietOptimistQi·2 hours ago

This method transforms reading into an active skill. It allows readers to appreciate the distinction between a planned discovery and a serendipitous finding.