A quit-smoking paper says ‘peer reviewed’: what can you actually check?

01

One visible improvement, several unanswered questions

Everything in this exercise is invented: no real journal, author, identifier, quotation or effect. An adult randomized trial compares a planning sheet plus a brief consultation with the same consultation alone. Its article is marked original research. The fictional journal’s policy says this article type receives external expert assessment. The history lists receipt, revision and acceptance dates.

A public review exchange asks the authors to show each group’s denominator for a defined six-month smoking outcome. Their reply says a table was added; opening the final article shows those denominators. You can now follow that particular reporting change. The dates alone would not have shown what the reviewer asked, and the reply alone would not have shown what the final version contains.

Nothing visible says the reviewer accessed participant records or independently reran the analysis. A later public letter asks how missing six-month assessments were handled; no answer is visible yet. A careful summary is: ‘An external-review policy and one traceable reporting improvement are visible; this missing-data question remains unanswered in the material read.’ Do not turn that into verified efficacy, misconduct or personal advice.

02

Read a journal policy as a policy, not as this paper’s complete history

Check the publisher’s original article page and its type: research report, editorial and correspondence need not follow the same procedure. ICMJE says journals should describe their process for different manuscript types. Numbers of reviewers, anonymity, published reports and data-access requirements vary. A journal-wide statement is evidence about stated procedure, not proof of every step in one article.

Read the labels on dates: receipt, revision and acceptance do not reveal the number of outside reviewers or all requested changes. If reports are not public, write ‘not publicly available’ rather than ‘not reviewed’. Confidential reports or identities are not yours to uncover or republish. Open identities and open reports are also separate features; use only records the publisher has made public.

Reviewers advise; editors select the content and need not follow a favorable or unfavorable recommendation. Their decision can include fit with the journal. A reviewer’s recommendation is therefore not the editorial decision, and neither is a vote making every conclusion true.

[1]

03

Trace a comment into the final report; keep reading after acceptance

When a public exchange exists, match the precise concern to the author’s reply and the relevant final paragraph or table. An explanation, promised change and visible change are different evidence. A clarified denominator improves what readers can inspect; it does not demonstrate independent access to raw data or replication. Check the journal’s specific data/analysis policy before claiming those checks occurred.

The substantive questions remain: who was studied, what each group received, how the smoking outcome and time point were defined, how missing assessments were handled, and what denominators and uncertainty accompany the result. CONSORT describes reporting these fields for randomized trials; ‘peer reviewed’ does not answer them for you. Read linked later correspondence and the article’s current notices: publication does not end questioning, and a still-open question should stay open rather than be silently resolved by the acceptance label.

[1][2]

04

Use professional support for a personal quit-smoking question

This exercise uses only public publication material and requests no smoking history, symptoms or medicines. A paper’s editorial status cannot choose personal care. NHS information describes stop-smoking support routes across the UK, with arrangements differing by country; use the relevant route and a qualified professional for personal support questions.

[3]

05

What to keep in mind

• Separate a journal’s stated policy from article-specific public records.
• Compare a review comment, its reply and the final report together.
• Keep unresolved scientific questions separate from acceptance.