Skip to main content

Risk of Bias Assessment Template for Systematic Reviews

— Gatsbi

Risk-of-bias assessment examines how study methods may distort a result used in a review. Choose the tool and version for the design and question: RoB 2 for randomized intervention trials, ROBINS-I for non-randomized intervention effects, and QUADAS tools for diagnostic accuracy. QUADAS-3 is now the Bristol team’s recommended version. Keep each judgment tied to its evidence and to the result or estimate being assessed.

Use the working tables below to record the result being assessed, the chosen tool and version, source support, reviewer judgments and resolution of disagreement. They help organize the work but do not replace the official questions, decision rules or guidance for that tool.

Why Risk of Bias Assessment Matters in Systematic Reviews

Risk of bias is about systematic error in a study result, not about whether authors wrote the paper clearly, and not about random error or imprecision. A study can be precise but biased, or imprecise but methodologically sound. Cochrane distinguishes bias from both imprecision and external validity, and PRISMA separates reporting of study risk of bias from reporting bias due to missing results in a synthesis. 

That distinction matters because modern RoB tools are designed to assess the result being used in the review, not merely a study “as a whole.” RoB 2 explicitly focuses on a specific result from a randomized trial. ROBINS-I does the same for a specific result from a non-randomized intervention study, and QUADAS-3 now moves diagnostic accuracy appraisal toward estimate-level assessment as well. This result-level orientation is one of the biggest practical shifts in contemporary evidence synthesis, because one outcome or timepoint from the same study may be at low risk of bias while another is not. 

For intervention reviews, risk-of-bias assessment is a core part of the methods described in the Cochrane Handbook. PRISMA 2020 asks authors to report the assessment methods and findings; completing that reporting task does not validate the judgments. GRADE considers risk of bias when assessing certainty for an outcome across the body of evidence.

The assessment should help explain limitations in the included results and inform the planned synthesis. For example, a team may restrict an analysis, compare results across risk-of-bias groups or run a sensitivity analysis. Explain the rationale and report the consequences rather than assuming that a completed template prevents biased conclusions.

Which Risk of Bias Tool Should You Use

Match the tool to both the study design and the question. Then record the exact version, variant and effect of interest. The working tables here follow RoB 2 for individually randomized parallel-group trials, ROBINS-I (2016) and QUADAS-2. These structures are not interchangeable with newer versions or with tools for reviews, missing evidence or prediction models.

Concise comparison table

Tools have different scopes and version-specific rules
ToolBest use caseStructure or scopeDecision processOutput
RoB 2 (22 August 2019)Individually randomized parallel-group trialsRandomization; deviations; missing outcome data; outcome measurement; reported result selectionFull signaling questions and algorithmsLow risk / Some concerns / High risk
RoB 2 cluster variantCluster-randomized trialsIncludes cluster-specific identification and recruitment issuesUse the official cluster tool, revised 18 March 2021Low risk / Some concerns / High risk
RoB 2 crossover variantCrossover randomized trials within the tool’s scopeIncludes crossover-specific issues such as period and carryover effectsUse the official crossover tool, revised 18 March 2021Low risk / Some concerns / High risk
ROBINS-I (2016)Non-randomized intervention studies using this versionSeven domains, including deviations from intended interventionsSignaling questions and judgment guidance; not the V2 algorithmsLow / Moderate / Serious / Critical / No information
ROBINS-I V2 (November 2025 draft)Follow-up cohort studies within the draft’s scopeSix domains with revised questions and orderingDraft algorithms; consult the exact release and its guidanceVersion-specific proposed judgments; still subject to change
QUADAS-2Projects whose documented methods use this earlier versionPatient selection; index test; reference standard; flow and timing. Applicability for the first threeTailored questions and domain judgmentsLow / High / Unclear for each relevant judgment
QUADAS-3 (v1.2 checked 18 October 2026)Current recommended QUADAS tool for test accuracy reviewsEstimate-level assessment, ideal test accuracy trial and revised domainsUse the current official tool and guidanceDomain judgments plus a formal overall assessment
ROB-MEMissing evidence in a synthesis with meta-analysisMissing studies and missing results relevant to the synthesisStructured assessment distinct from individual-result appraisalRisk of bias due to missing evidence
ROBISRisk of bias in systematic reviewsReview-level assessment of the review processStructured phases and questionsReview-level risk of bias
PROBAST familyPrediction-model development or evaluationPROBAST-2019 uses participants, predictors, outcome and analysis domains; PROBAST+AI updates and extends that toolConsult the selected version’s official guidanceVersion-specific quality, risk-of-bias and applicability assessments
Newcastle–Ottawa ScaleCohort and case-control appraisal where this scale is specifiedSelection, comparability and exposure/outcomeStar-based item assessmentStars; not interchangeable with RoB 2 or ROBINS-I judgments

Tool sources: RoB 2 and its variants, ROBINS-I (2016), ROBINS-I V2 draft, QUADAS-2, QUADAS-3, ROB-ME, ROBIS, PROBAST and Newcastle–Ottawa Scale. Version information was checked on 18 October 2026.

For a non-randomized intervention review, choose and document the ROBINS-I version before starting. The official site still labels the November 2025 V2 release as a draft; its six-domain structure is not the seven-domain 2016 table below. For a new diagnostic accuracy review, consult QUADAS-3. If an existing protocol uses QUADAS-2, explain that choice and do not silently relabel its assessments.

Downloadable and Printable Risk of Bias Assessment Template

Two simplified CSV record sheets remain available: the RCT sheet follows the five-domain RoB 2 structure of 22 August 2019 for individually randomized parallel-group trials, and the NRSI sheet follows the seven-domain ROBINS-I (2016) structure. Enter the exact version and result identifier before using them. Their prompts are reminders, not the complete official questions or an automated assessment.

For diagnostic accuracy assessments, use the official QUADAS-3 tool and guidance for a new project, or the official QUADAS-2 materials where that version is specified in the protocol. The earlier mixed-version DTA download and combined workbook have been withdrawn from this page because their QUADAS-2 fields were also labeled as QUADAS-3.

The embedded working tables below preserve the distinction between evidence notes and completed judgments. Their fictional fragments illustrate what to record; they do not contain enough source evidence to establish domain or overall judgments. Complete the official assessment and retain it alongside these summary records.

Master fields to include in every template

Master fields for a traceable assessment
FieldWhat to enter
Review IDReview name or registration identifier
Study and report IDsUnique study identifier and each supporting report, registry or supplement
Study designDesign features needed to select the tool and variant
Result identifierOutcome, time point, comparison, analysis population, effect measure and result location
Tool and versionExact name, release date/version, design variant and effect of interest
Reviewer 1 and reviewer 2Separate initial responses and judgments, with dates
Supporting evidenceQuotation or evidence note with page, table, registry field or correspondence date
Domain judgmentThe selected tool’s category, kept separate from the supporting prose
Disagreement and resolutionOriginal decisions, unresolved issue, resolution and person responsible
Overall judgment or summaryUse the selected tool’s overall rules; label a narrative summary separately
NotesMissing information, author contact, assumptions and links to the full official assessment

Template for randomized controlled trials

RoB 2 has five mandatory domains for individually randomized parallel-group trials. Its full signaling questions feed algorithms proposing domain judgments of Low risk, Some concerns or High risk. Apply the overall rules as well: several domains with Some concerns can justify High risk overall when they substantially lower confidence in the result. Document reasons for any override of an algorithm proposal. A short evidence fragment cannot determine the judgment by itself.

Fictional RoB 2 record: judgments intentionally uncompleted
SectionWorking fieldIllustrative entry, not an assessment
Study detailsReview IDDiabetes-SR-2026
Study detailsStudy ID / citationFictional case A
Study detailsOutcome / timepointHbA1c at 24 weeks
Study detailsEffect of interestEffect of assignment to intervention
Domain 1Bias arising from the randomization processTo assess with the full official tool
Domain 1 supportIllustrative evidence fragment; add source locationAllocation sequence computer-generated; central allocation concealment
Domain 2Bias due to deviations from intended interventionsTo assess with the full official tool
Domain 2 supportIllustrative evidence fragment; add source locationParticipants unblinded; limited evidence of differential co-interventions
Domain 3Bias due to missing outcome dataTo assess with the full official tool
Domain 3 supportIllustrative evidence fragment; add source location11% attrition; reasons partially balanced but outcome related to dropout plausible
Domain 4Bias in measurement of the outcomeTo assess with the full official tool
Domain 4 supportIllustrative evidence fragment; add source locationLab-based HbA1c measured identically across groups
Domain 5Bias in selection of the reported resultTo assess with the full official tool
Domain 5 supportIllustrative evidence fragment; add source locationNo publicly accessible SAP; multiple timepoints mentioned
OverallOverall RoB 2 judgmentTo assess with the full official tool
OverallLikely direction of biasTo assess where supported

Enter the exact result and effect of interest, then complete the full official RoB 2 tool. Transfer the judgment and its supporting source location into the record. For cluster or crossover trials, use the corresponding official variant instead of adding a homemade question to the parallel-group worksheet.

ROBINS-I (2016) working table

This seven-domain table follows ROBINS-I (2016). Define the target trial, causal contrast, important confounders and relevant co-interventions before assessment, using methodological and subject expertise. The V2 draft changes the domains and questions; this table does not implement it.

Fictional ROBINS-I (2016) record: judgments intentionally uncompleted
SectionWorking fieldIllustrative entry, not an assessment
Study detailsReview IDAsthma-SR-2026
Study detailsStudy ID / citationFictional case B
Study detailsTarget trial specificationAdults with uncontrolled asthma initiating biologic A vs biologic B
Study detailsOutcome / timepoint / estimateExacerbations at 12 months; adjusted HR
Pre-interventionBias due to confoundingTo assess with ROBINS-I (2016) guidance
SupportIllustrative evidence fragment; add source locationDisease severity and eosinophil count incompletely adjusted
Pre-interventionBias in selection of participants into the studyTo assess with ROBINS-I (2016) guidance
SupportIllustrative evidence fragment; add source locationNew-user design used, but index date capture imperfect
At interventionBias in classification of interventionsTo assess with ROBINS-I (2016) guidance
SupportIllustrative evidence fragment; add source locationPharmacy and prescribing records concordant
Post-interventionBias due to deviations from intended interventionsTo assess with ROBINS-I (2016) guidance
SupportIllustrative evidence fragment; add source locationDifferential add-on therapy possible after start of follow-up
Post-interventionBias due to missing dataTo assess with ROBINS-I (2016) guidance
SupportIllustrative evidence fragment; add source locationOutcome capture via claims database near-complete
Post-interventionBias in measurement of outcomesTo assess with ROBINS-I (2016) guidance
SupportIllustrative evidence fragment; add source locationHospitalized exacerbation objectively recorded
Post-interventionBias in selection of the reported resultTo assess with ROBINS-I (2016) guidance
SupportIllustrative evidence fragment; add source locationMultiple adjustment sets reported; analysis plan unavailable
OverallOverall ROBINS-I judgmentTo assess with ROBINS-I (2016) guidance

Start with the result and target trial, then use the 2016 guidance to assess confounding, selection, intervention classification, deviations, missing data, outcome measurement and reported-result selection. Its categories are Low, Moderate, Serious, Critical and No information. A Critical assessment indicates that the result is too problematic to provide useful evidence for synthesis under that guidance; retain the assessment and explain how it affects the planned analysis. Do not generate that judgment from an isolated example note.

QUADAS-2 working table for reviews using that version

The table below follows QUADAS-2 and is intended for projects whose documented methods use that version. QUADAS-3 is the current version recommended by the Bristol QUADAS team; its official page listed v1.2 when checked on 18 October 2026. For a new review, consult its official tool and guidance. Changing a heading does not convert a QUADAS-2 assessment into QUADAS-3.

Fictional QUADAS-2 record: judgments intentionally uncompleted
SectionWorking fieldIllustrative entry, not an assessment
Study detailsReview IDSepsis-DTA-2026
Study detailsStudy ID / citationFictional case C
Study detailsIndex testPlasma biomarker X
Study detailsReference standardClinical diagnosis by adjudication committee
Study detailsAccuracy estimate assessedSensitivity and specificity at prespecified threshold
Risk of biasPatient selectionTo assess: Low / High / Unclear
SupportIllustrative evidence fragment; add source locationCase-control sampling with exclusions of indeterminate cases
Risk of biasIndex testTo assess: Low / High / Unclear
SupportIllustrative evidence fragment; add source locationThreshold prespecified before analysis
Risk of biasReference standardTo assess: Low / High / Unclear
SupportIllustrative evidence fragment; add source locationAdjudication may have partial awareness of biomarker data
Risk of biasFlow and timingTo assess: Low / High / Unclear
SupportIllustrative evidence fragment; add source locationNot all participants received the same reference standard; delayed verification
ApplicabilityPatient selection applicabilityTo assess: Low / High / Unclear
ApplicabilityIndex test applicabilityTo assess: Low / High / Unclear
ApplicabilityReference standard applicabilityTo assess: Low / High / Unclear
SummaryNarrative summary of domain findingsComplete after assessment; not a formal QUADAS-3 overall judgment

QUADAS-2 assesses risk of bias in patient selection, index test, reference standard, and flow and timing, with applicability assessed for the first three domains. Its judgment labels are Low, High and Unclear; Some concerns belongs to a different tool’s vocabulary. Tailor the official questions and guidance to the review before appraisal. Keep any prose summary distinct from QUADAS-3’s formal overall assessment.

How to Apply the Template and Turn It Into Better Evidence Synthesis

Plan the tool, version, relevant results and reviewer process before assessment. In the report, describe the methods actually used, including whether reviewers worked independently and how disagreements were handled. Keep the full assessments accessible so the reported judgments can be traced back to evidence.

For each judgment, retain the result identifier, outcome, time point, tool version, supporting source location, reviewer and resolution of disagreement. Keep a domain judgment separate from a prose summary so the original reasoning remains available after export.

A disciplined RoB workflow

Structured assessment still requires judgment. Apply the selected version’s questions and decision rules, record missing information and explain the reasoning. Where the tool provides algorithm-generated proposals, preserve both the proposal and the reason for any override. Do not assume that ROBINS-I (2016) uses the algorithms introduced in V2.

Common pitfalls to avoid

The most common error is assessing the study in general instead of the specific result used in the review. A second frequent error is mixing up risk of bias with reporting quality, certainty, or applicability. A third is inventing a numeric total score from multiple domains. Official tools are domain-based and designed to preserve the mechanism of bias rather than collapse diverse problems into a single homemade score. For diagnostic reviews, the parallel mistake is to ignore applicability concerns even though QUADAS explicitly separates risk of bias from applicability. 

For the ROBINS-I (2016) workflow shown here, define the target trial, important confounders and co-interventions before reviewing the example fields. Use the different instructions supplied with V2 if that is your selected version. Agreement between reviewers cannot compensate for an undefined causal question.

For cluster and crossover trials, use the appropriate official RoB 2 variant. Identify recruitment timing and other cluster-specific issues, or period and carryover issues, as directed by that tool. Also document how those designs were handled in the analysis; a correct tool label does not resolve a unit-of-analysis problem.

Tips for better inter-rater reliability

Calibrate on a small, varied set of results before the full assessment. Have reviewers work independently, compare their evidence and interpretations, and resolve recurring ambiguities in a written decision guide. Choose enough pilot cases to cover the designs and difficulties in the review; there is no universal required number.

Follow the selected tool’s response options and branching instructions. When reviewers disagree, check whether they used the same result, source passage and version before debating the final category. Preserve the original responses as well as the resolved judgment.

Good reliability also depends on a clean evidence trail. Store the quotation, registry entry, protocol excerpt, supplement, or author correspondence that supports each judgment. That is consistent with Cochrane’s insistence on “support for judgment” and it makes arbitration faster, more transparent, and much easier to defend during peer review. 

How to incorporate RoB into GRADE and meta-analysis

RoB should directly influence synthesis, not sit in an appendix. Cochrane Chapter 7 recommends several strategies when risks of bias vary across studies: restrict the primary analysis to low-risk studies; stratify or subgroup analyses by overall RoB or specific domains; present all studies but explicitly account for RoB in certainty judgments; or, less commonly, use statistical bias adjustment methods. Cochrane does not currently recommend formal weighting schemes that mechanically assign study weights based on RoB categories, because those methods are not sufficiently developed for routine review use. 

Prespecify how risk-of-bias judgments affect the main analysis and sensitivity analyses, using the applicable methods guidance. A restriction, stratified analysis or sensitivity analysis may be appropriate, but an all-studies analysis followed by a low-risk subset is not a universal default. Explain which results enter each analysis. A non-significant difference between risk-of-bias groups does not demonstrate absence of bias.

Carry the result-level judgments and their reasons into the synthesis plan and certainty assessment. A risk-of-bias label alone does not determine a universal numerical downgrade or an analysis weight. Explain how the limitations affect the particular outcome and use the selected framework’s guidance for the body of evidence. Cochrane Chapter 14 describes the connection to GRADE.

Assess missing evidence at the synthesis level as well. Individual-result tools do not replace an assessment of results or studies missing from the synthesis. ROB-ME addresses that separate question for systematic reviews with meta-analysis.

A plot can help readers connect judgments to the results being synthesized. robvis produces traffic-light and bar plots for supported risk-of-bias formats. Verify the expected tool version and category labels before import. A plot displays the judgments supplied to it; it does not validate them.

When the assessed results enter an analysis, use a meta-analysis data and reproducibility check to retain their identity, settings and inclusion decisions.

Conclusion

The useful output is a traceable assessment for the result being used. Select the right tool and version, complete its official questions, and retain the source evidence and reviewer decisions.

Use the working tables to carry those decisions into reporting, synthesis and certainty assessment without losing their identifiers or reasons. Keep uncertainty explicit and leave judgments uncompleted until the evidence and assessment support them.

References

Higgins JPT, Savović J, Page MJ, Elbers RG, Sterne JAC. Cochrane Handbook Chapter 8: Assessing risk of bias in a randomized trial. Current Cochrane Handbook guidance on RoB 2. 

Sterne JAC and colleagues. Cochrane Handbook Chapter 25, including ROBINS-I (2016) guidance. See the separate official original version and V2 draft release for version-specific materials.

Whiting PF, Rutjes AWS, Westwood ME, et al. QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies. Annals of Internal Medicine. 2011. 

Whiting PF, Tomlinson E, Rutjes AWS, et al. QUADAS-3: A Revised Tool for the Quality Assessment of Diagnostic Test Accuracy Studies. Annals of Internal Medicine. 2026. 

Page MJ, McKenzie JE, Bossuyt PM, et al. PRISMA 2020 statement and checklist resources. 

Cochrane Handbook Chapter 14: Completing Summary of Findings tables and grading the certainty of the evidence. 

Cochrane Handbook Chapter 7: Considering bias and conflicts of interest among included studies. Guidance on incorporating RoB into analyses. 

Cochrane Chapter 23 and riskofbias.info resources for cluster-randomized and crossover RoB 2 variants. 

ROB-ME resources from Cochrane Bias. 

McGuinness LA, Higgins JPT. robvis: risk-of-bias visualization tool and package.