Systematic review or a newer quit-smoking trial: read them together

01

Two new papers, only one matching question

Everything in this exercise is invented: no actual review, trial, product or result. A review published in September 2026 searched through December 2025. It sought randomized trials in adults of optional messages added to a leaflet, compared with the same leaflet alone, measuring a defined six-month abstinence outcome.

Two papers published in June 2026 both say ‘digital quit support’. One uses that contrast and outcome. The other adds telephone calls and measures confidence about quitting at four weeks. The shared label does not make the second paper a test of the review's six-month question.

The matching paper is a potential addition, not a ready-made replacement: full eligibility, methods and results still need assessment. Both papers fall outside the stated search period. Nothing here establishes that messages work or that the review's conclusion would change. A fair note is: ‘The review did not search these later papers; one appears relevant to its question, while the other measures a different package and outcome.’

02

Open the methods, then the contributing trials

Find the last search date for each database or other source, not just the date above the abstract. PRISMA asks reviews to report these dates, eligibility criteria and how studies were grouped for synthesis. A publication date does not make the underlying search current. A ‘living’ review still needs a visible update and search status.

Use the included-study table to locate the trial behind a claim. Its report can clarify what each arm received, how abstinence was defined and when it was measured. Compare those details with the review's actual synthesis group, rather than a broad category such as digital support. Explainable diversity can fit a wider question; studies need not be identical.

Also read exclusions, risk-of-bias judgments and the rationale for synthesis. A missing detail stays unknown; an excluded trial is not automatically suppressed. Reporting a PRISMA checklist makes methods easier to inspect but does not certify that the search, included studies or conclusions are sound.

[1][2][3]

03

Why ‘three positive papers versus two negative’ is not the answer

A meta-analysis combines effect estimates with statistical weights and a model; it does not give each paper one vote. Two studies can estimate the same difference while only one crosses a statistical-significance threshold because their uncertainty differs. Calling the other ‘no effect’ and counting votes throws away that information.

A forest-plot square's weight is its statistical contribution, not a quality award. Read effect estimates and intervals alongside bias assessments, the contributing comparisons and sensitivity analyses. A narrow combined interval can coexist with biased inputs; a random-effects model does not make different outcomes interchangeable or explain why results differ.

A systematic review can be useful without a pooled number. It should explain its alternative synthesis and display the available results. That differs from selecting a few attractive examples or tallying statistically significant findings. You need not recalculate the analysis to see whether its question and inputs support its wording.

[3][4]

04

The next step for a personal question

These public documents help you frame a question; they do not select your treatment or predict your result. NHS information describes UK routes through local stop-smoking services and health professionals, not universal access in every English-speaking country. Discuss personal options with a qualified local professional. No smoking history or health details need to be entered into this reading exercise.

[5]

05

What to keep in mind

• Match the question before comparing conclusions.
• Separate the search date from the publication date.
• Read synthesis methods, not a tally of significant papers.

06

Common questions