Part 1: Module 2 - The Systematic Review Lifecycle
This module introduces trainees to the fundamental principles and practices of evidence-informed decision-making (EIDM) and knowledge translation in health and policy contexts. It explores the concepts of evidence and evidence hierarchies, highlighting their role in supporting effective decision-making and policy development. The module also examines knowledge translation strategies and the development of policy briefs as tools for communicating research evidence to stakeholders. Trainees will gain an understanding of the differences between traditional and systematic reviews, the various types of systematic reviews, and the key methodological steps involved in conducting them. In addition, the module equips trainees with the knowledge to identify the resources, tools, and skills required to plan and undertake high-quality systematic reviews.
Part 1: Module 2 - The Systematic Review Lifecycle
Module 2 — The Systematic Review Lifecycle
Chapter 2.1 — The 12-Stage Systematic Review Lifecycle: From Question to Publication
Learning Objectives
By the end of this chapter, you will be able to:
- Describe the twelve sequential stages of a systematic review lifecycle.
- Explain what happens at each stage and why it matters.
- Recognize common decision points and their consequences for the integrity of the review.
- Map the lifecycle onto the PRISMA 2020 reporting structure.
- Anticipate the iterative nature of real-world review conduct, in which some stages may overlap or loop back.
🧠 Concept
1. Why the Lifecycle Matters
A systematic review is not a single act — it is a structured project with multiple stages, each requiring deliberate methodological choices. Understanding the full lifecycle helps reviewers:
- Plan resources — time, personnel, and budget are distributed across the stages.
- Anticipate pitfalls — most methodological errors occur when a stage is treated as a formality rather than a decision point.
- Document decisions — the review's credibility rests on transparency about what was done and why.
- Report accurately — PRISMA 2020 mirrors the lifecycle; conducting each stage properly produces the material you need to report.
The lifecycle below is presented as sequential — but in practice, most reviews loop back. A scoping search may reveal the question needs refining; peer review of the search strategy may reveal missing synonyms; pilot screening may require new inclusion criteria. The lifecycle is best understood as a spiral of refinement rather than a linear pipeline.
2. The Twelve Stages
| # | Stage | Core Activity | PRISMA Item(s) |
|---|---|---|---|
| 1 | Question Formulation | Define a focused, answerable review question using frameworks such as PICO, PECO, PICo, or SPIDER. | 3, 4 |
| 2 | Protocol Development | Write a detailed protocol pre-specifying methods for every subsequent stage. | 5, 24a |
| 3 | Protocol Registration | Register the protocol in a publicly accessible registry (PROSPERO, OSF, Cochrane). | 24a |
| 4 | Search Strategy Design | Identify concepts, synonyms, controlled vocabulary, and boolean operators; peer-review the strategy. | 6, 7 |
| 5 | Search Execution and Record Import | Run the search across databases and registers; export records; import into reference software. | 6, 7, 16a |
| 6 | Deduplication and Study Pool Preparation | Remove duplicates; build the master pool of unique records. | 16a |
| 7 | Title and Abstract Screening | Dual independent screening against pre-specified eligibility criteria. | 8, 16a |
| 8 | Full-Text Retrieval and Screening | Obtain and screen full texts; log exclusion reasons. | 8, 16b |
| 9 | Critical Appraisal / Risk of Bias | Assess methodological quality of each included study using validated tools (RoB 2, ROBINS-I, QUADAS-2, JBI checklists). | 11, 18 |
| 10 | Data Extraction | Systematically extract data from included studies using piloted forms. | 9, 10 |
| 11 | Synthesis and Analysis | Combine results quantitatively (meta-analysis) or qualitatively (narrative synthesis); assess heterogeneity, publication bias, and certainty. | 13, 14, 20, 21 |
| 12 | Reporting, Dissemination, and Update | Draft the manuscript following PRISMA; submit for peer review; plan for updates or a living review. | 22–27 |
3. Stage 1 — Question Formulation
The review begins with a question — and a bad question produces a bad review, no matter how well everything else is done. Question formulation translates a broad area of uncertainty into a structured, answerable inquiry. Frameworks such as PICO (Population, Intervention, Comparator, Outcome) force specificity. A well-formulated question determines the search strategy, the eligibility criteria, the data extraction fields, and the synthesis method.
4. Stage 2 — Protocol Development
The protocol is the review's blueprint. It documents, in advance, everything the reviewer intends to do: eligibility criteria, search sources, screening procedure, extraction form, appraisal tool, synthesis method, and how biases will be assessed. The protocol's purpose is to prevent post-hoc decisions — choices made after seeing the results are vulnerable to bias. A pre-specified protocol makes the review's conclusions defensible.
5. Stage 3 — Protocol Registration
Registering the protocol in a public registry provides a timestamped record of the reviewer's intentions. The main registries are:
- PROSPERO — for health-related reviews.
- OSF Registries — for cross-disciplinary reviews.
- Cochrane Library — for Cochrane reviews.
- Research Registry — for a range of review types.
Registration reduces selective reporting and enables others to detect changes between protocol and publication.
6. Stage 4 — Search Strategy Design
The search is the review's input pipeline. A poorly designed search either misses relevant studies (low sensitivity) or retrieves an unmanageable volume (low precision). The strategy must be: comprehensive, transparent, reproducible, and peer-reviewed (PRESS guideline).
7. Stage 5 — Search Execution and Record Import
Databases are searched according to their own syntax; results are exported in standard formats (RIS, NBIB, CSV) and imported into reference management software — or directly into RevProHub. The date of each search, database, and platform must be recorded.
8. Stage 6 — Deduplication and Study Pool Preparation
Records identified from multiple sources inevitably overlap. Automated deduplication handles straightforward matches; ambiguous cases require manual review. The output is a master pool of unique records that becomes the study-selection starting point.
9. Stage 7 — Title and Abstract Screening
Every unique record is screened against the eligibility criteria using only the title and abstract. Screening is performed by at least two reviewers independently; disagreements are resolved by consensus or arbitration.
10. Stage 8 — Full-Text Retrieval and Screening
Records retained after title/abstract screening are retrieved in full text and screened again against the eligibility criteria. Exclusions are documented with reasons, feeding into the PRISMA flow diagram.
11. Stage 9 — Critical Appraisal / Risk of Bias
Each included study is assessed for methodological quality and risk of bias using a validated tool appropriate to the study design. The appraisal informs the sensitivity analyses and the certainty of evidence.
12. Stage 10 — Data Extraction
Systematic extraction of study characteristics, participants, interventions, comparators, outcomes, effect estimates, and risk-of-bias assessments. Extraction is performed using piloted, structured forms, ideally by two reviewers independently.
13. Stage 11 — Synthesis and Analysis
Where studies are sufficiently homogeneous, results are combined statistically (meta-analysis). Where not, narrative synthesis is used (SWiM reporting guideline). Key analyses include:
- Pooled effect estimates with confidence intervals.
- Assessment of heterogeneity (I², τ², prediction intervals).
- Subgroup and sensitivity analyses.
- Assessment of publication bias (funnel plot, Egger's test).
- Certainty of evidence assessment (GRADE).
14. Stage 12 — Reporting, Dissemination, and Update
The final stage produces the deliverable: a PRISMA-compliant manuscript, policy brief, or evidence summary. Dissemination should target both academic and non-academic audiences. Increasingly, reviewers also plan for updates — including living reviews that continuously incorporate new evidence.
15. The Iterative Reality
While the twelve stages are presented sequentially, real-world reviews loop:
- A scoping search during stage 1 may reveal the question is too broad.
- Peer review of the search (stage 4) may reveal missing synonyms, requiring a re-run.
- Pilot screening (early stage 7) may reveal ambiguous eligibility criteria, requiring protocol amendment.
- Data extraction (stage 10) may uncover unexpected variables needing additional extraction fields.
- Synthesis (stage 11) may reveal insufficient homogeneity, requiring a pivot to narrative synthesis.
Every one of these loops must be documented and justified — transparency about deviation is more important than rigid adherence to the original plan.
Worked Example — A Realistic Timeline
A team of three researchers conducted a systematic review of community health worker-led interventions for hypertension in low- and middle-income countries. Their actual stage timelines were:
| Stage | Time Spent | Notes |
|---|---|---|
| 1. Question formulation | 2 weeks | 2 workshops to reach consensus on PICO |
| 2. Protocol development | 3 weeks | 3 revisions after internal review |
| 3. Protocol registration | 1 week | PROSPERO submission and amendments |
| 4. Search strategy design | 3 weeks | Peer-reviewed via PRESS framework |
| 5. Search execution | 2 weeks | 6 databases + 2 registers + grey literature |
| 6. Deduplication | 1 week | 4,813 records → 3,102 unique |
| 7. Title/abstract screening | 4 weeks | Dual screening, 87% initial agreement |
| 8. Full-text screening | 4 weeks | 312 full texts reviewed, 41 included |
| 9. Risk of bias | 3 weeks | RoB 2 for trials, ROBINS-I for cohorts |
| 10. Data extraction | 4 weeks | Piloted on 5 studies first |
| 11. Synthesis | 4 weeks | Meta-analysis + subgroup by setting |
| 12. Reporting | 6 weeks | Manuscript + policy brief + PRISMA |
| Total | ~37 weeks | Coordinated across 3 reviewers |
This timeline illustrates a common finding: screening, extraction, and synthesis consume the largest share of the project — often more than 50%. Reviews that underestimate this burden typically fail to finish.
Knowledge Check: Exercise
Multiple Choice
-
Which stage of the systematic review lifecycle comes immediately after protocol registration?
- Data extraction
- Search strategy design
- Title/abstract screening
- Reporting
-
The purpose of registering a protocol in PROSPERO is to:
- Publish the review automatically
- Provide a timestamped record of pre-specified methods
- Obtain ethics approval
- Replace the need for a full manuscript
-
Which of the following is NOT a typical reason a review loops back to an earlier stage?
- Scoping search reveals the question is too broad
- Peer review of the search reveals missing synonyms
- Pilot screening reveals ambiguous criteria
- Peer reviewers request that the manuscript be formatted differently
-
Sensitivity analyses and assessment of publication bias occur during:
- Stage 4 — Search strategy
- Stage 7 — Title/abstract screening
- Stage 11 — Synthesis and analysis
- Stage 12 — Reporting
-
Which two stages typically consume the largest share of a review's time?
- Question formulation and protocol development
- Screening and synthesis
- Registration and reporting
- Deduplication and search execution
Applied Scenario
A novice review team completes a systematic review in 20 weeks. During synthesis, they realize their inclusion criteria were too narrow — many studies that would have fit were excluded during screening. They consider redoing stages 7 and 8.
Question: Should the team redo screening? What would this require them to do, methodologically and administratively?
Suggested Answer
Yes, in most cases the team should redo the affected stages, because a review's credibility depends on all eligible studies being included. However, the decision requires care:
- Amend the protocol first. Broaden the eligibility criteria with an explicit rationale and a date stamp.
- Document the change. PRISMA 2020 requires reporting of deviations from the registered protocol.
- Re-screen all records — not just those previously excluded — because broadening criteria may change decisions at any point.
- Re-extract data for any newly included studies.
- Repeat the appraisal using the same tools and process.
- Re-run synthesis with the expanded study pool.
Alternatively, if the criteria really were too narrow, the team could publish the current review as scoped, and plan a follow-up review. But this risks a fragmented evidence base and is generally not recommended.
The lesson: investing more time in question formulation and pilot screening upfront prevents expensive backtracking later.
🔗 Cross-References
Prerequisite chapters:
- Chapter 1.4 — Traditional Reviews vs Systematic Reviews
- Chapter 1.6 — The PRISMA 2020 Framework
Follow-up chapters:
- Chapter 2.2 — Roles and Responsibilities in a Review Team
- Chapter 2.3 — Time, Resources, and Cost Considerations
- Chapter 3.1 — From Uncertainty to Answerable Question
- Chapter 4.1 — Why a Protocol Is Essential
Related RevProHub articles:
📚 References and Further Reading
- Higgins JPT, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 6.4. Cochrane; 2023.
- Institute of Medicine. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: National Academies Press; 2011.
- Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.
- Munn Z, Peters MDJ, Stern C, et al. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):143.
- Booth A, Sutton A, Papaioannou D. Systematic Approaches to a Successful Literature Review. 3rd ed. London: SAGE; 2021.
- Chandler J, Cumpston M, Li T, Page MJ, Welch VA, eds. Cochrane Handbook for Systematic Reviews of Interventions. Chichester: Wiley; 2019.
Chapter 2.2 — Roles and Responsibilities in a Review Team
Learning Objectives
By the end of this chapter, you will be able to:
- Identify the typical roles required to conduct a systematic review.
- Describe the responsibilities and required competencies for each role.
- Explain the optimal team size and composition for different review types.
- Recognize common failure modes in review team dynamics.
- Plan a team structure using collaboration tools such as RevProHub.
🧠 Concept
1. Why Team Composition Matters
A systematic review is a complex multi-stage project. Few individuals possess all the skills required for every stage — search expertise, methodological rigor, statistical analysis, content expertise, and scientific writing. Well-composed teams complete reviews faster, produce higher-quality outputs, and are more resilient to personnel turnover.
The most successful reviews are conducted by teams with clearly defined roles, agreed-upon workflows, and shared accountability. Conversely, reviews with unclear roles — especially those led by a single reviewer attempting to do everything — are more prone to errors, delays, and bias.
2. Core Team Roles
| Role | Primary Responsibilities | Key Competencies |
|---|---|---|
| Lead Reviewer / Principal Investigator | Overall responsibility for the review; secures funding; oversees protocol development; arbitrates disagreements; ensures timelines and quality. | Systematic review methodology; leadership; project management; content knowledge. |
| Methodologist | Advises on methodological choices; ensures compliance with standards (Cochrane, JBI, PRISMA); reviews protocol and analyses for rigor. | SR methodology; risk of bias; synthesis methods; GRADE. |
| Information Specialist / Librarian | Designs and peer-reviews search strategies; executes searches; documents search methodology; manages record imports and deduplication. | Database-specific syntax; MeSH/Emtree; PRESS framework; reference management. |
| Content Expert / Topic Specialist | Provides clinical or subject-matter guidance; refines eligibility criteria; interprets findings; ensures applicability to target population. | Deep domain knowledge; familiarity with relevant literature; clinical or policy context. |
| Screener(s) | Independently screens titles/abstracts and full texts against eligibility criteria; logs decisions; participates in conflict resolution. | Attention to detail; consistent application of criteria; time management. |
| Data Extractor(s) | Extracts study data using piloted forms; verifies accuracy; contributes to data quality audits. | Precision; familiarity with study designs; understanding of outcome measures. |
| Statistician / Analyst | Plans and conducts meta-analysis; assesses heterogeneity and publication bias; interprets statistical findings. | Biostatistics; meta-analytic models; software proficiency (R, Stata, RevMan, RevProHub). |
| Writer / Editor | Drafts and edits the protocol and manuscript; ensures PRISMA compliance; manages references. | Scientific writing; familiarity with reporting standards; reference software. |
| Project Coordinator | Manages schedules, meetings, communications, and deliverables; tracks progress; liaises with stakeholders. | Project management; communication; coordination tools. |
3. Team Size and Composition by Review Type
| Review Type | Minimum Team | Ideal Team |
|---|---|---|
| Small-scale intervention review | 2 reviewers (dual screening & extraction) | 3–4: 2 reviewers + methodologist + content expert |
| Cochrane-style intervention review | 4 (2 screeners, 1 methodologist, 1 information specialist) | 6–8: full team + statistician + writer |
| Diagnostic accuracy review | 3–4 | 5–6 with statistician experienced in DTA models |
| Qualitative evidence synthesis | 3 (2 reviewers + methodologist) | 4–5 with qualitative research expertise |
| Mixed-methods review | 4 | 6–8 combining quantitative and qualitative expertise |
| Rapid review | 2–3 | 4 with clearly documented methodological shortcuts |
| Umbrella / overview of reviews | 3 | 4–5 with AMSTAR 2 expertise |
4. Role Overlap and Multi-Skilling
In practice, roles often overlap. Common multi-skilled combinations:
- Lead Reviewer = Methodologist — common in experienced research teams.
- Screener = Data Extractor — the same reviewers perform screening and extraction.
- Information Specialist = Project Coordinator — in smaller reviews.
- Content Expert = Writer — when the subject specialist is also the main author.
What cannot be compromised: at least two reviewers must independently screen and extract for the review to meet methodological standards.
5. Governance and Decision-Making
Good review teams have a clear governance structure:
- Weekly or biweekly meetings during active review stages.
- Documented decision log — every methodological decision is recorded with date and rationale.
- Arbitration protocol — how conflicts are resolved (third reviewer, consensus meeting, lead's ruling).
- Amendment process — how protocol changes are proposed, reviewed, and approved.
- Communication channels — usually a combination of in-app chat (RevProHub), email, and scheduled video calls.
6. Common Failure Modes
| Failure Mode | Consequence | Mitigation |
|---|---|---|
| Single reviewer performs all stages | High risk of selection bias; not compliant with PRISMA. | Ensure at least dual screening and dual extraction. |
| No methodologist on team | Methodological errors go undetected; publication rejection. | Include at least one team member with SR methodology training. |
| Information specialist consulted late | Search strategy may be incomplete; requires rework. | Involve the information specialist in protocol development. |
| Unclear arbitration process | Disagreements stall progress; inconsistent decisions. | Document arbitration protocol in the review protocol. |
| Poor communication / unclear ownership | Delays; duplicated work; missed tasks. | Use project management tools (RevProHub) with assigned tasks. |
| No decision log | Loss of audit trail; hard to report deviations. | Maintain a running decision log from day one. |
7. Roles in RevProHub
RevProHub supports role-based access to review projects. Common permissions:
- Project Lead — full access; can create sub-teams, assign tasks, approve decisions.
- Reviewer — screening, extraction, appraisal permissions.
- Contributor — access to specific stages (e.g., search, synthesis) with read/write permissions.
- Observer / Stakeholder — read-only access, useful for advisory board members.
Worked Example — Team Composition for an Ethiopian Cohort Review
A team of researchers at a university in Addis Ababa plans a systematic review on community health worker interventions for hypertension in LMICs. Their team composition:
- Lead Reviewer — a senior epidemiologist with prior Cochrane review experience.
- Methodologist — a biostatistician with GRADE and meta-analysis training.
- Information Specialist — a medical librarian familiar with PubMed, Embase, CINAHL.
- Content Expert — a public health specialist with CHW program experience in Ethiopia.
- Two Screeners/Extractors — MPH graduates trained in systematic review methods.
- Writer — a research fellow responsible for manuscript drafting.
Seven-person team, with each role clearly defined, arbitration by the Lead Reviewer, and weekly 60-minute meetings tracked in RevProHub. This composition reflects best practice for a moderately complex intervention review.
Knowledge Check: Exercise
Multiple Choice
-
Which role is responsible for designing and peer-reviewing the search strategy?
- Lead reviewer
- Content expert
- Information specialist
- Statistician
-
What is the minimum number of independent reviewers needed for screening in a systematic review?
- One
- Two
- Three
- Four
-
Which of the following is NOT a core role in a typical review team?
- Methodologist
- Information specialist
- Statistical software salesperson
- Content expert
-
The purpose of an arbitration protocol is to:
- Replace the lead reviewer's decisions
- Provide a documented process for resolving disagreements
- Eliminate the need for dual screening
- Automate study selection
-
Which failure mode most commonly threatens the validity of a systematic review?
- Too many team members
- Single reviewer performing all stages
- Overuse of reference management software
- Early consultation with an information specialist
Applied Scenario
A small research group wants to conduct a systematic review but has only three members available: one clinician with content expertise, one methodologist, and one MPH student. They have no librarian or statistician. They plan to complete the review in 12 months.
Question: How should they structure their roles to complete the review within the timeline? What gaps might they need to fill, and how?
Suggested Answer
Possible role allocation:
- Clinician — Lead reviewer + content expert.
- Methodologist — Methodologist + statistician (if trained in meta-analysis) + arbitrator.
- MPH Student — Screener + data extractor + writer (with supervision).
All three would share screening and extraction to maintain dual review.
Gaps and how to fill them:
- Librarian — partner with the university library (many offer free support) or train one team member using PRESS resources.
- Statistician — if the methodologist lacks meta-analysis expertise, engage a statistical consultant for the synthesis stage only; or use RevProHub's built-in statistical modules with methodology support.
- Additional reviewer — recruit a fourth collaborator (faculty or another student) to ensure dual independent screening.
The lesson: teams adapt. Structure follows the review's needs, not the other way around — but methodological safeguards (dual screening, methodological oversight, information specialist support) cannot be skipped.
🔗 Cross-References
Prerequisite chapters:
- Chapter 2.1 — The 12-Stage Systematic Review Lifecycle
Follow-up chapters:
- Chapter 2.3 — Time, Resources, and Cost Considerations
- Chapter 4.1 — Why a Protocol Is Essential
- Chapter 8.1 — Screening Principles: Dual Independent Review
- Chapter 11.1 — Extracting Continuous, Dichotomous, and Time-to-Event Data
Related RevProHub articles:
📚 References and Further Reading
- Higgins JPT, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 6.4. Cochrane; 2023. Chapter 1: Starting a review.
- Institute of Medicine. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: National Academies Press; 2011. Standard 2.1: Team Composition.
- Rethlefsen ML, Farrell AM, Osterhaus Trzasko LC, Brigham TJ. Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. J Clin Epidemiol. 2015;68(6):617–626.
- McGowan J, Sampson M, Salzwedel DM, et al. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J Clin Epidemiol. 2016;75:40–46.
- Booth A, Sutton A, Papaioannou D. Systematic Approaches to a Successful Literature Review. 3rd ed. London: SAGE; 2021. Chapter on team building.
- Li T, Higgins JPT, Deeks JJ, eds. Cochrane Handbook, Chapter 5: Collecting data.
Chapter 2.3 — Time, Resources, and Cost Considerations
Learning Objectives
By the end of this chapter, you will be able to:
- Estimate the time required for each stage of a systematic review.
- Identify the resource categories — human, technological, financial, and infrastructural — needed to complete a review.
- Plan and budget a systematic review appropriate to its scope and question.
- Recognize the major drivers of cost and schedule overruns.
- Apply pragmatic strategies for resource-constrained settings, particularly in LMICs.
🧠 Concept
1. Why Resource Planning Matters
Systematic reviews are consistently underestimated. Published studies of review teams find that:
- The median time from project start to publication is 12–24 months for intervention reviews.
- Time to completion is highly correlated with the number of records screened and included.
- Reviews with underestimated time budgets are more likely to be abandoned or published with methodological shortcuts.
- Cost overruns are common and can be substantial — particularly in reviews requiring full-text purchase or translation.
Careful resource planning is essential for credibility: a review that is under-resourced is often a review that is rushed, incomplete, or biased.
2. Time Estimation by Stage
The table below provides indicative ranges. Actual times vary by scope, team experience, and infrastructure.
| Stage | Typical Duration | Key Drivers of Variability |
|---|---|---|
| Question formulation | 1–3 weeks | Stakeholder engagement; availability of scoping searches. |
| Protocol development | 2–6 weeks | Team experience; complexity of PICO; number of outcomes. |
| Protocol registration | 1–3 weeks | Registry turnaround; PROSPERO typically 2–4 weeks. |
| Search strategy design | 2–4 weeks | Number of databases; complexity of concepts; PRESS peer review. |
| Search execution and import | 1–3 weeks | Number of sources; whether grey literature is included. |
| Deduplication | 1 week | Volume of records; quality of export data. |
| Title/abstract screening | 2–8 weeks | Number of records; number of reviewers; screening rate (typically 500–800/day per reviewer). |
| Full-text retrieval and screening | 2–6 weeks | Number of full-texts; library access; translation needs. |
| Risk of bias / appraisal | 1–4 weeks | Tool complexity; number of included studies; number of domains. |
| Data extraction | 2–6 weeks | Form complexity; number of studies; single vs dual extraction. |
| Synthesis | 2–6 weeks | Statistical complexity; heterogeneity; subgroup analyses; GRADE. |
| Manuscript drafting | 4–8 weeks | Writer experience; PRISMA compliance; co-author cycles. |
| Peer review and revision | 8–20 weeks | Journal timelines; number of revision cycles. |
| Total (project start → acceptance) | 12–24 months | Combined effects of scope, team, and journal process. |
3. Resource Categories
Human Resources
- Team members' time (Lead, Methodologist, Information Specialist, Screeners, Extractors, Statistician, Writer).
- External advisors (content experts, biostatisticians, policy stakeholders).
- Training time for team members less experienced with SR methods.
Technological Resources
- Reference management software (Zotero, EndNote, Mendeley).
- Systematic review platform (RevProHub, Covidence, Rayyan, EPPI-Reviewer).
- Statistical software (R, Stata, RevMan, MetaXL).
- Document management and collaboration tools (Google Workspace, MS 365).
- Video conferencing (Zoom, Teams) and messaging tools.
Financial Resources
- Personnel — salaries or time-buyout for team members.
- Database access (Embase, CINAHL, Web of Science, Scopus — often institutional).
- Full-text retrieval (library services, ILL, purchase of paywalled articles).
- Translation services for non-English papers.
- Software licenses.
- Publication fees (open access; typically US$ 1,500–3,500).
- Conference dissemination and policy brief production.
Infrastructural Resources
- Reliable internet connectivity.
- Institutional library access.
- Ethics and governance structures (usually not required for SRs, but often for mixed-methods or primary data collection).
- Institutional review and sign-off processes.
4. Indicative Cost Structure
Costs vary widely depending on setting, but the relative proportions below are typical for an academic intervention review.
| Cost Category | Share of Total (Indicative) |
|---|---|
| Personnel (salaries, time-buyout, stipends) | 50–70% |
| Software and database access | 5–15% |
| Full-text retrieval, translation, and ILL | 5–15% |
| Publication fees | 5–15% |
| Travel, dissemination, policy briefs | 3–10% |
| Contingency | 5–10% |
5. Drivers of Cost and Schedule Overruns
| Driver | Typical Impact |
|---|---|
| Underestimated record volume (very broad search) | Screening takes 2–4× longer than anticipated. |
| Paywalled full-texts requiring purchase or ILL | Weeks of delay; significant cost per article. |
| Non-English studies requiring translation | Translation costs; delays in screening and extraction. |
| Complex statistical synthesis (network, DTA, IPD) | Specialist statistician required; extended timeline. |
| Team turnover or reduced availability | Requires re-training and duplication of work. |
| Multiple peer-review rounds | 4–12 months added between submission and acceptance. |
| Protocol amendments mid-review | Restaging of screening or extraction; potential restart. |
6. Strategies for Resource-Constrained Settings
Many systematic reviews are conducted in settings with limited funding, restricted library access, and few SR-trained personnel. Pragmatic strategies include:
- Narrow the scope. A focused question with fewer studies to screen and extract dramatically reduces time and cost.
- Use rapid review methods. Documented methodological shortcuts (single reviewer for some stages, limited search, date restrictions) are acceptable if transparently reported.
- Leverage open-access databases. PubMed, Cochrane Library, WHO databases, and regional journals are free.
- Use institutional library services. Interlibrary loan, document delivery, and subject librarian expertise are often available at low or no cost.
- Adopt free or low-cost SR platforms. RevProHub, Rayyan (free tier), Covidence (partially free for Cochrane), and EPPI-Reviewer support the entire workflow at minimal cost.
- Collaborate regionally. Multi-country consortia share screening burden, database access, and expert knowledge.
- Train students and early-career researchers. MPH and PhD students can be co-reviewers, gaining experience while contributing to the team.
- Plan for living updates. Living review methodology spreads the updating burden over time, avoiding the "obsolete on publication" problem.
7. Budget Template (Indicative)
A simple template for planning the financial envelope of a moderate-size review (adjust to your setting):
| Item | Basis | Notes |
|---|---|---|
| Lead Reviewer time | X% FTE for Y months | Salary + overheads |
| Methodologist time | X% FTE for Y months | Advisory and analytical input |
| Information Specialist time | X days total | Search design and peer review |
| 2 Screeners / Extractors | X person-months | Largest personnel line item |
| Statistician time | X days total | Synthesis, subgroup analyses |
| Software licenses | Annual | SR platform, reference manager |
| Full-text retrieval | Estimated per article | ILL or purchase |
| Translation | Estimated per paper | If non-English included |
| Open-access publication fee | Flat | Varies by journal |
| Dissemination (policy brief, conference) | Flat | Often overlooked |
| Contingency | 5–10% of total | Buffer for unknowns |
Worked Example — Two Reviews, Two Budgets
Review A — Focused intervention review (Ethiopian university team):
- Question: effectiveness of a specific drug in a specific population.
- Databases: PubMed, Cochrane, Embase (institutional access).
- Records after dedup: ~800.
- Full texts reviewed: ~60; included: 12.
- Team: 3 (2 reviewers + 1 methodologist).
- Estimated total cost: modest personnel time + small software budget.
- Estimated timeline: 6 months.
Review B — Broad scoping intervention review:
- Question: effectiveness of CHW-led interventions across multiple conditions in LMICs.
- Databases: PubMed, Embase, CINAHL, Scopus, Web of Science, WHO, plus grey literature.
- Records after dedup: ~18,000.
- Full texts reviewed: ~600; included: 85.
- Team: 8 (2 screeners, 2 extractors, methodologist, statistician, information specialist, lead).
- Estimated total cost: substantial personnel time, several open-access fees, translation budget.
- Estimated timeline: 18–24 months.
The lesson: scope drives everything. A slightly narrower question can reduce cost and time by 60–80%, while still producing a valuable, publishable review.
Knowledge Check: Exercise
Multiple Choice
-
Which stage typically consumes the largest share of a review's time?
- Question formulation
- Protocol registration
- Screening (title/abstract and full-text)
- Peer review
-
Which cost category is typically the largest in a systematic review budget?
- Software licenses
- Personnel
- Publication fees
- Travel
-
A major driver of schedule overruns is:
- Too few records to screen
- Underestimated record volume due to broad search
- Peer review of the search strategy
- Access to institutional databases
-
Which of the following is NOT a resource-conserving strategy for LMIC teams?
- Narrow the review scope
- Use rapid review methods
- Include all studies regardless of language without translation support
- Collaborate regionally with other teams
-
A modest 5–10% contingency line in a budget primarily guards against:
- Peer reviewer criticism
- Unforeseen costs such as extra full-text purchases or translation
- Journal rejection
- Ethics approval delays
Applied Scenario
A graduate student has 9 months to complete a systematic review as part of their thesis. They have no dedicated funding, no librarian, and access only to PubMed and their institutional library. They also have no statistician on their team.
Question: What pragmatic decisions should they make at each stage of the review to ensure it is completed on time and without compromising methodological integrity?
Suggested Answer
Recommended decisions per stage:
- Question: Choose a narrowly focused intervention review. Avoid complex comparisons or multiple outcomes.
- Protocol: Write and register it in PROSPERO — the process is free and strengthens the thesis.
- Search: Use PubMed + Cochrane + one additional free resource (e.g., Epistemonikos). Peer-review the search strategy via their supervisor or library's remote consultation service.
- Screening: Partner with one other trained student for dual screening; use RevProHub or Rayyan to reduce overhead.
- Full-texts: Use the library's ILL service and open-access repositories (PubMed Central, ResearchGate).
- Appraisal & Extraction: Use design-specific tools (RoB 2 or ROBINS-I). Extract into a structured spreadsheet or RevProHub form.
- Synthesis: If meta-analysis is not feasible, use narrative synthesis following SWiM. If meta-analysis is needed, use RevProHub's built-in statistical modules or free software (RevMan is free for Cochrane; MetaXL is free for Excel). Consult a methodologist by email for targeted advice.
- Reporting: Follow PRISMA 2020 strictly; produce a PRISMA flow diagram; include the checklist as an appendix.
Result: a rigorous, publishable review completed in 9 months using available resources, transparently documented in the thesis.
🔗 Cross-References
Prerequisite chapters:
- Chapter 2.1 — The 12-Stage Systematic Review Lifecycle
- Chapter 2.2 — Roles and Responsibilities in a Review Team
Follow-up chapters:
- Chapter 4.1 — Why a Protocol Is Essential
- Chapter 25.1 — Rapid Review Methods: Shortcuts and Their Trade-offs
- Chapter 24.1 — Concept and Rationale for Living Reviews
Related RevProHub articles:
📚 References and Further Reading
- Allen IE, Olkin I. Estimating time to conduct a meta-analysis from number of citations retrieved. JAMA. 1999;282(7):634–635.
- Borah R, Brown AW, Capers PL, Kaiser KA. Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open. 2017;7(2):e012545.
- Institute of Medicine. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: National Academies Press; 2011. Standard 2.3: Time and Resources.
- Tricco AC, Antony J, Zarin W, et al. A scoping review of rapid review methods. BMC Med. 2015;13:224.
- Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;5:56.
- Elliott JH, Synnot A, Turner T, et al. Living systematic review: 1. Introduction—the why, what, when, and how. J Clin Epidemiol. 2017;91:23–30.
- Oliver S, Dickson K, Bangpan M. Systematic reviews: making them matter in resource-constrained settings. J Dev Eff. 2016;8(1):5–26.