Reporting current research with living systematic literature reviews

Oct 22, 2019

Written by Julie Fricke (Systematic Review Analyst) and Neil Webb (Head of Systematic Review)

Systematic Reviews – The Problem

Although considered the gold standard of quality research, systematic literature reviews (SLRs) are very resource intensive (e.g. long timeline, high budget) [1]. This, in combination with the broader issue that “research outpaces understanding,” SLRs get quickly out-of-date [2]. There is a challenge to create reliable evidence that keeps up with the fast pace of research output. Once an SLR is published, only a small portion of reviews are updated within 2 years of publication [3], and this inability to maintain currency leads to significant inaccuracy.  A 2007 study following up 100 SLRs (including 27 Cochrane Reviews) found that in 15 cases, new evidence warranting a “substantial change” in the conclusions had emerged within 12 months [4].

What are Living Systematic Reviews?

To better connect evidence and practice, living systematic reviews (LSRs) were developed. LSRs are high quality, up-to-date online summaries of health research that are updated as new research becomes available [2]. As described by the Cochrane Collaboration, this means that LSRs:

  1. Are underpinned by continual, active monitoring of the evidence (i.e. monthly searches)
  2. Immediately include any new important evidence (data, studies or information) that is identified
  3. Are supported by up-to-date communication about the status of the review and any new evidence being incorporated
  4. Should additionally include explicit, transparent and predefined decisions on:
    a. How frequently new evidence is sought and screened
    b. When and how new evidence is incorporated into the review

Production of Living Systematic Reviews

LSRs are feasible due to recent technological and data-related innovations, such as online platforms, linked data, and machine learning [5]. Advancements to enhance efficiency and review production, particularly to reduce duplication of effort, include [6]:

  1. Semi-automation to reduce manual development of key SR processes
    a. Database searching and eligibility assessment
    b. Data extraction/collection and risk of bias assessment
    c. Synthesis and reporting
  2. Data repositories
  3. Dynamic, online publication of a living document
    a. Continuous peer and editorial review
    b. Version numbers
    c. Updated authorship
  4. Human “crowds” (e.g. Cochrane Crowd online platform)

These technologies are still being generated, but multiple initiatives and expanding research groups are in place to aid in their development.

Overall, LSRs provide a new and cost saving approach to support the ongoing efforts to produce evidence that is both trustworthy and current [2].  They lend to the development of up-to-date and appropriate guidelines and improve the application of health technologies. Consultancies should consider LSRs as an option for evidence generation.

  1. Petticrew, M., Systematic Reviews in the Social Sciences: A Practical Guide. Counselling and Psychotherapy Research, 2006. 6(4): p. 304-305.
  2. Elliott, J.H., et al., Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. PLoS Med, 2014. 11(2): p. e1001603.
  3. Jadad, A.R., et al., Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. JAMA, 1998. 280(3): p. 278-80.
  4. Shojania, K., Sampson, M, Ansari, MT, Ji, J, Doucette, S, Moher, D, How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis. Annals of Internal Medicine, 2007: p. 224-233.
  5. Elliott, J.H. Exploiting innovations in technology to improve the efficiency of review production. in 20th Cochrane Colloquium. 2012. Auckland.
  6. Thomas, J., et al., Living systematic reviews: 2. Combining human and machine effort. J Clin Epidemiol, 2017. 91: p. 31-37.

More Insights

Conceptual modelling and NICE requirements: a significant change or hill of beans?

Conceptual modelling and NICE requirements: a significant change or hill of beans?

Written by Alec Miners, Head of Health Economics The National Institute for Health and Care Excellence’s (NICE’s) new processes and methods guide includes several important changes to the way submitted economic evaluations should be conducted ... Read more

British Heart Week 2022

British Heart Week 2022

As we approach the end of British Heart Week, we reflect on some of the key stats around heart conditions in the UK and our contribution as a company to help bring cutting-edge treatments to patients with cardiovascular diseases Read more

Patient Participation Groups: A voice for patients for 50 years

Patient Participation Groups: A voice for patients for 50 years

Written by Dom Partridge, Medical Writer 6th to 13th June 2022 is Patient Participation Group (PPG) Awareness Week; aiming to raise the profile of PPGs within primary healthcare. The first Patient Participation Group The first PPG was set up in ... Read more

The Innovative Medicines Fund is now available to fast-track non-cancer medicines recommended with managed access

The Innovative Medicines Fund is now available to fast-track non-cancer medicines recommended with managed access

The Innovative Medicines Fund (IMF) launched this month (June 2022) to support faster access to non-cancer drugs. This process involves NHS England and the National Institute for Health and Care Excellence (NICE) working in partnership with ... Read more