Skip to main content

Progesterone vs. synthetic progestins and the risk of breast cancer: a systematic review and meta-analysis

Abstract

Background

Use of menopausal hormonal therapy (MHT)-containing estrogen and a synthetic progestin is associated with an increased risk of breast cancer. It is unclear if progesterone in combination with estrogen carries a lower risk of breast cancer. Limited data suggest differences between progesterone and progestins on cardiovascular risk factors, including cholesterol and glucose metabolism. Whether this translates to differences in cardiovascular outcomes is uncertain. We conducted a systematic review and meta-analysis to synthesize the existing evidence about the effect of progesterone in comparison to synthetic progestins, each in combination with estrogens, on the risk of breast cancer and cardiovascular events.

Methods

We searched MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and Scopus through 17 May 2016 for studies that enrolled postmenopausal women using progesterone vs. synthetic progestins and reported the outcomes of interest. Study selection and data extraction were performed by two independent reviewers. Meta-analysis was conducted using the random effects model.

Results

We included two cohort studies and one population-based case-control study out of 3410 citations identified by the search. The included studies enrolled 86,881 postmenopausal women with mean age of 59 years and follow-up range from 3 to 20 years. The overall risk of bias of the included cohort studies in the meta-analysis was moderate. There was no data on cardiovascular events. Progesterone was associated with lower breast cancer risk compared to synthetic progestins when each is given in combination with estrogen, relative risk 0.67; 95 % confidence interval 0.55–0.81.

Conclusions

Observational studies suggest that in menopausal women, estrogen and progesterone use may be associated with lower breast cancer risk compared to synthetic progestin.

Peer Review reports

Background

Menopausal hormone therapy (MHT) is highly effective for the treatment of symptoms related to menopause [1]. MHT regimens typically include estrogen and, for women with an intact uterus, a progestin to protect the endometrium from hyperplasia caused by unopposed estrogen. A number of US Food and Drug Administration (FDA)-approved hormone preparations are available for treatment of women with menopausal symptoms [2]. The biochemistry, metabolism, and both beneficial and harmful effects of the various synthetic progestins differ widely from native progesterone and from each other [3].

Micronized progesterone is a bioidentical hormone with a molecular structure identical to that of endogenous progesterone produced by the ovary. Synthetic progestins have a different chemical structure from progesterone. These compounds mimic some of the effects of progesterone but may have different actions on progesterone receptors [4]. Synthetic progestins may be structurally related to progesterone (e.g., medroxyprogesterone acetate (MPA), dydrogesterone) or to testosterone (e.g., levonorgestrel, drospirenone) with differing potency and pharmacokinetics. The physiologic effects of a particular progestin depend not only on these properties but also on receptor binding. In addition to binding to progesterone receptors, these compounds may also have an affinity for androgen, glucocorticoid, and mineralocorticoid receptors [5].

Although some data suggest that MHT increases the risk of breast cancer [6], the risk of breast cancer may differ depending on the type of MHT used. For example, MHT containing conjugated equine estrogens (CEE) and medroxyprogesterone acetate (MPA) has been associated with increased risk of breast cancer compared to CEE alone [7]. Further, breast cancer risk may vary between regimens containing different progestins, with some synthetic progestins exhibiting greater risk than others [8]. The effects of progesterone have been shown to be growth-promoting, neutral, or anti-proliferative in breast cells, whereas in women, synthetic progestins, especially the combination of CEE and MPA, have been found to be growth-promoting [9]. In contrast to progestins, progesterone in combination with estrogen has not been associated with increased breast cancer [8]. Emerging evidence suggests that the progesterone receptor acts as a modulator of estrogen receptor α (ERα) binding and transcription, blocking estrogen-mediated cell proliferation. The presence of progesterone receptors in breast cancer that are positive for ERα is associated with positive clinical outcomes [10].

Progesterone and synthetic progestins also demonstrate varied effects on lipids, coagulation factors, glucose, and insulin and may therefore differentially impact cardiovascular risk, though data are sparse [11].

The PEPI trial previously demonstrated that, when combined with CEE, progesterone, unlike MPA, did not negate the positive effects of CEE on high-density lipoprotein cholesterol (HDL-C) [7]. A recent randomized, double-blind, placebo-controlled trial utilizing 300 mg of progesterone daily showed no adverse changes in endothelial function, blood pressure, weight, or markers of inflammation or coagulation. Although HDL-C was decreased on treatment, the change was not believed to be clinically relevant [12]. We conducted a systematic review and meta-analysis to synthesize the existing evidence about the effect of progesterone compared to synthetic progestins on the risk of breast cancer and cardiovascular disease.

Methods

A predefined protocol was developed by experts from the Endocrine Society to conduct this systematic review. The protocol included explicit criteria for study selection and plans for the data extraction and analysis. We followed the standards set in the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) [13] statement for reporting this review as shown in Additional file 1. This systematic review was submitted for PROSPERO registration but it did not meet registration requirement.

Eligibility criteria

We included comparative/controlled studies that enrolled women aged 45–59 years who were within 10 years of menopause and received MHT. The studies had to compare estrogen with progesterone (crystalline progesterone preparations) with any of the synthetic progestins in combination with estrogen and report outcomes of interest for a follow-up period ≥6 months. The outcomes of interest were the risk of breast cancer and cardiovascular disease. We excluded non-comparative studies, case series, and non-original papers.

Literature search

The search included the electronic databases of MEDLINE, MEDLINE in-process and other non-indexed citations, EMBASE, Cochrane Central Register of Controlled Trials and Cochrane Database of Systematic Reviews, and Scopus. We expanded the search to include all languages, with the latest date of inclusion to be 17 May 2016. The database search was conducted by an experienced Mayo Clinic reference librarian. Controlled vocabulary supplemented with keywords was used to search for comparative studies of progesterone vs. synthetic progestins and risk of breast cancer and cardiac events. A manual search for the included studies’ bibliographies and previous relevant systematic review were also conducted. A detailed search strategy is described in the Additional file 2.

Study selection

Using an online reference management system DistillerSR (Distiller SR, Evidence Partners Incorporated, Ontario, Canada), abstracts and titles that resulted from the electronic search strategy were independently evaluated by two reviewers for potential eligibility, and the full-text versions of all potentially eligible studies were obtained. Two reviewers working independently considered the full-text reports for eligibility. The level of agreement between the two reviewers (k level) was 0.7 and 0.8 for abstract screening and full-text screening, respectively. Disagreements were harmonized by consensus and, if not possible, by consensus through arbitration by a third reviewer.

Data extraction

Using a standardized, piloted, and web-based form (Distiller SR; Evidence Partners Inc.), two reviewers independently extracted data from each study and later reconciled differences, if present. Reviewers determined the methodological quality of studies and collected descriptive, methodological, and outcome data. We extracted the following variables from the studies: study characteristics (study design, inclusion and exclusion criteria), baseline characteristics, and patient demographics, and outcome data.

Risk of bias assessment

We used a modified Newcastle-Ottawa Scale (NOS) [14] to appraise the risk of bias of the observational studies. The quality of evidence was evaluated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) [15] methods.

Data synthesis and statistical analysis

We extracted or calculated the relative risk (RR) of the outcomes of interest with 95 % confidence interval (CI). The I 2 statistic was used to assess heterogeneity of the treatment effect among studies for each outcome. I 2 value >50 % and p value <0.10 of the Cochrane Q test suggested substantial heterogeneity that is due to real differences in study populations, protocols, interventions, and/or outcomes. Publication bias was not assessed due to the small number of the studies included. The statistical analyses using DerSimonian and Laird random effects model were performed with CMA version 2 (Biostat, Englewood, New Jersey).

Results

The initial search resulted in 3410 citations. After screening the abstracts, this was limited to 46 potentially relevant articles. These were reviewed in full text by two authors and eventually two cohort studies and one population-based case-control study were included with 44 being excluded for the reasons shown in Fig. 1. The included studies enrolled 86,881 women with a mean age of 59 years and mean follow-up duration of 5 years. None of the studies evaluated the outcome of cardiovascular disease. The studies included are summarized in Table 1. The overall risk of bias of the included cohort studies was moderate. Samples were somewhat representative in the two studies with no baseline imbalance, and the studies were controlled for the most important factors. Table 2 describes the detailed risk of bias assessment of the two included cohort studies.

Fig. 1
figure 1

Study selection process. The initial search resulted in 3410 citations. After screening the abstracts, this was limited to 46 potentially relevant articles. These were reviewed in full text by two authors and eventually two cohort studies and one population-based case-control study were included with 44 being excluded

Table 1 Description of included studies
Table 3 The effect of progesterone vs. synthetic progestins in combination with estrogen on breast cancer incidence

Meta-analysis

Based on the meta-analysis of the two included cohort studies, progesterone was found to be associated with lower breast cancer risk compared to synthetic progestins in combination with estrogen (RR = 0.67, (95 % CI 0.55–0.81) I 2 = 42 % with p value of <0.0001). The quality of evidence was low due to the observational nature of the study design, and Fig. 2 shows the results. Sensitivity analysis was done to exclude postmenopausal women receiving synthetic progestins other than medroxyprogesterone acetate. The number of breast cancer events in women receiving medroxyprogesterone acetate was 29 in 7035 person-years as reported in the study by Fournier et al. [8]. The sensitivity analysis shows no change in results (RR = 0.67 (95 % CI 0.76–0.81) with p value of <0.0001).

Fig. 2
figure 2

Random effects model of breast cancer risk in postmenopausal women receiving estrogen with progesterone vs. synthetic progestins. This figure shows that progesterone was found to be associated with lower breast cancer compared to synthetic progestins in combination with estrogen

The effect of combined estradiol and progesterone in comparison with estradiol and synthetic progestin on breast cancer incidence showed a RR 0.42 (95 % CI 0.13–1.31) in Espie [16], whereas Fournier [8] showed a RR 0.68 (95 % CI 0.56–0.82) when comparing postmenopausal women who received estrogen and progesterone to those who received estrogen and synthetic progestin as shown in Table 3.

Table 4 The relative risk (95 %) for breast cancer according to the route of administration of estradiol and the type of progestogen used

The study by Espie [16] reported the route of administration of estradiol where 2101 patients (78 %) received transdermal estradiol and 592 (22 %) received oral estradiol. Subgroup analysis was done based on the route of administration, and no differential effect on the risk of breast cancer was apparent between oral and transdermal routes of administration as shown in Table 4.

Table 2 Risk of bias assessment of the included studies

We also identified a population-based case-control study that reported similar results. The study showed no significant increased risk of breast cancer among women treated with progesterone in combination with estrogen, odds ratio (OR) 0.80 (CI 95 % 0.44–1.43). However, there was a non-significantly increased risk of breast cancer among users of estrogen with synthetic progestins, OR 1.57 (95 % CI 0.99–2.49) [17].

Discussion

Based on this systematic review and meta-analysis, progesterone may be associated with lower breast cancer risk compared to synthetic progestins, when each is given in combination with estrogen. No studies have been found reporting on the risk of cardiovascular disease in postmenopausal woman receiving estrogen with progesterone vs. those who are receiving estrogen with synthetic progestins, and no previous systematic reviews have evaluated this question.

Progestin is utilized in MHT regimens for women with an intact uterus to prevent endometrial hyperplasia. Progestins used for MHT regimens can be administered orally, transdermally (patch containing norethisterone/norethindrone), or directly to the endometrium (levonorgestrel intrauterine system). While the levonorgestrel intrauterine system has been shown to be adequate for endometrial protection [18], it is not currently approved by the US FDA for this indication.

The potential role of progestins in increasing breast cancer risk associated with MHT has come under greater scrutiny after the Women’s Health Initiative trial suggested increased risk of breast cancer with continuous use of CEE and MPA for greater than 5 years compared with CEE alone, which showed no increased risk [19]. In fact, CEE alone was associated with a lower risk of breast cancer than placebo after 11 years of observation [20].

Both progesterone and synthetic progestins and the dosing regimen may impact breast cancer risk. In the E3N cohort study, MHT regimens containing estrogen and progesterone or dydrogesterone were not associated with a statistically significant increase in breast cancer risk. All other progestins were associated with an increased risk, with no difference between various progestins [8]. The results of this meta-analysis (which includes the E3N study) are consistent with these findings and show a decreased risk of breast cancer associated with the use of progesterone compared with a progestin (RR = 0.67 (95 % CI 0.76–0.81)).

Progesterone and synthetic progestins may be administered continuously with estrogen or sequentially for 10–14 days per month. Some, but not all, studies comparing these regimens have shown increased risk of breast cancer with continuous dosing compared to sequential dosing [2123]. Randomized clinical trials are needed to clarify these findings.

Clinical implications

Accumulating evidence suggests that important differences in risks and benefits exist between various MHT regimens, making individualization of MHT essential. Women with an intact uterus require the use of progesterone for endometrial protection when using systemic estrogen therapy for the management of menopausal symptoms. While an additional study is needed to confirm these results, data suggest lower risk of breast cancer with progesterone and dydrogesterone and do not support a class effect of progestins on breast cancer risk [24]. More studies are needed to define a potential difference in cardiovascular risk between progesterone and synthetic progestins.

Strengths and limitations

The strength of our review relates to following a predefined protocol, rigorous database search, and duplicate study selection and data extraction. The main limitations are the observational nature of the evidence, which lowers the confidence in the estimates, and the small number of studies included. We were unable to ascertain the presence and impact of publication bias due to the small number of studies. In terms of the individual studies, the major strength of the Fournier study [8] was the inclusion of multiple menopausal hormonal therapies: the regular follow-up implemented in the study. It was the first epidemiological study to provide results indicating that estrogen-progesterone and estrogen-dydrogesterone combinations may be the least harmful MHT in terms of breast cancer risk. However, the results cannot be translated into firm clinical recommendations. The strength of the Espie study [16] was that they studied the previous use of progestins prior to menopause. They found that it had no influence on the risk of breast cancer irrespective of whether or not the women were subsequently exposed to MHT. One limitation of that study was that it was influenced by the common practice in France in which gynecologist avoided prescribing MHT to high-risk women. Lastly, the results of this review are largely influenced by a single large study.

Conclusions

Observational studies suggest that in menopausal women taking estrogen, progesterone use may be associated with lower breast cancer risk compared to synthetic progestin.

Abbreviations

MHT, menopausal hormone therapy; CEE, conjugated equine estrogens; MPA, medroxyprogesterone acetate; HDL-C, high-density lipoprotein cholesterol; CI, confidence interval; RR, relative risk; OR, odds ratio; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-analysis; NOS, Newcastle-Ottawa Scale; GRADE, Grading of Recommendations Assessment, Development and Evaluation

References

  1. National Institutes of Health. National Institutes of Health state-of-the-science conference statement: management of menopause-related symptoms. Ann Intern Med. 2005;142:1003–13.

    Article  Google Scholar 

  2. Files JA, Ko MG, Pruthi S. Bioidentical hormone therapy. Mayo Clin Proc. 2011;86:673–80. quiz 680.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Stanczyk FZ, Hapgood JP, Winer S, Mishell Jr DR. Progestogens used in postmenopausal hormone therapy: differences in their pharmacological properties, intracellular actions, and clinical effects. Endocr Rev. 2013;34:171–208.

    Article  CAS  PubMed  Google Scholar 

  4. Courtin A, Communal L, Vilasco M, Cimino D, Mourra N, de Bortoli M, Taverna D, Faussat AM, Chaouat M, Forgez P, Gompel A. Glucocorticoid receptor activity discriminates between progesterone and medroxyprogesterone acetate effects in breast cells. Breast Cancer Res Treat. 2012;131:49–63.

    Article  CAS  PubMed  Google Scholar 

  5. Lambrinoudaki I. Progestogens in postmenopausal hormone therapy and the risk of breast cancer. Maturitas. 2014;77:311–7.

    Article  CAS  PubMed  Google Scholar 

  6. Sood R, Faubion SS, Kuhle CL, Thielen JM, Shuster LT. Prescribing menopausal hormone therapy: an evidence-based approach. Int J Women's Health. 2014;6:47–57.

    Article  Google Scholar 

  7. Rossouw JE, Anderson GL, Prentice RL, LaCroix AZ, Kooperberg C, Stefanick ML, Jackson RD, Beresford SAA, Howard BV, Johnson KC, Kotchen JM, Ockene J, Writing Group for the Women's Health Initiative I. Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results from the Women’s Health Initiative randomized controlled trial. Jama. 2002;288:321–33.

    Article  CAS  PubMed  Google Scholar 

  8. Fournier A, Berrino F, Clavel-Chapelon F. Unequal risks for breast cancer associated with different hormone replacement therapies: results from the E3N cohort study.[Erratum appears in Breast Cancer Res Treat. 2008 Jan;107(2):307–8]. Breast Cancer Res Treat. 2008;107:103–11.

    Article  CAS  PubMed  Google Scholar 

  9. Santen RJ. Risk of breast cancer with progestins: critical assessment of current data. Steroids. 2003;68:953–64.

    Article  CAS  PubMed  Google Scholar 

  10. Mohammed H, Russell IA, Stark R, Rueda OM, Hickey TE, Tarulli GA, Serandour AA, Birrell SN, Bruna A, Saadi A, Menon S, Hadfield J, Pugh M, Raj GV, Brown GD, D'Santos C, Robinson JL, Silva G, Launchbury R, Perou CM, Stingl J, Caldas C, Tilley WD, Carroll JS. Progesterone receptor modulates ERalpha action in breast cancer. Nature. 2015;523:313–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Hellgren M, Conard J, Norris L, Kluft C. Cardiovascular risk markers during treatment with estradiol and trimegestone or dydrogesterone. Maturitas. 2009;62:287–93.

    Article  CAS  PubMed  Google Scholar 

  12. Prior JC, Elliott TG, Norman E, Stajic V, Hitchcock CL. Progesterone therapy, endothelial function and cardiovascular risk factors: a 3-month randomized, placebo-controlled trial in healthy early postmenopausal women. PLoS One. 2014;9:e84698.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Moher D, Liberati A, Tetzlaff J, Altman DG. Reprint—Preferred Reporting Items for Systematic Reviews and Meta-analyses: the PRISMA statement. Phys Ther. 2009;89:873–80.

    PubMed  Google Scholar 

  14. GA Wells BS, O'Connell D, Peterson J, Welch V, Losos M, Tugwell P. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2012.

    Google Scholar 

  15. Swiglo BA, Murad MH, Schunemann HJ, Kunz R, Vigersky RA, Guyatt GH, Montori VM. A case for clarity, consistency, and helpfulness: state-of-the-art clinical practice guidelines in endocrinology using the grading of recommendations, assessment, development, and evaluation system. J Clin Endocrinol Metab. 2008;93:666–73.

    Article  CAS  PubMed  Google Scholar 

  16. Espie M, Daures J-P, Chevallier T, Mares P, Micheletti M-C, De Reilhac P. Breast cancer incidence and hormone replacement therapy: results from the MISSION study, prospective phase. Gynecol Endocrinol. 2007;23:391–7.

    Article  CAS  PubMed  Google Scholar 

  17. Cordina-Duverger E, Truong T, Anger A, Sanchez M, Arveux P, Kerbrat P, Guenel P. Risk of breast cancer by type of menopausal hormone therapy: a case-control study among post-menopausal women in France. PLoS One. 2013;8:e78016.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Sitruk-Ware R. The levonorgestrel intrauterine system for use in peri- and postmenopausal women. Contraception. 2007;75:S155–160.

    Article  CAS  PubMed  Google Scholar 

  19. Chlebowski RT, Hendrix SL, Langer RD, Stefanick ML, Gass M, Lane D, Rodabough RJ, Gilligan MA, Cyr MG, Thomson CA, Khandekar J, Petrovitch H, McTiernan A, Investigators WHI. Influence of estrogen plus progestin on breast cancer and mammography in healthy postmenopausal women: the Women's Health Initiative Randomized Trial. Jama. 2003;289:3243–53.

    Article  CAS  PubMed  Google Scholar 

  20. Anderson GL, Chlebowski RT, Aragaki AK, Kuller LH, Manson JE, Gass M, Bluhm E, Connelly S, Hubbell FA, Lane D, Martin L, Ockene J, Rohan T, Schenken R, Wactawski-Wende J. Conjugated equine oestrogen and breast cancer incidence and mortality in postmenopausal women with hysterectomy: extended follow-up of the Women’s Health Initiative randomised placebo-controlled trial. Lancet Oncol. 2012;13:476–86.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Lyytinen H, Dyba T, Ylikorkala O, Pukkala E 2009 A case–control study on hormone therapy as a risk factor for breast cancer in Finland. Maturitas Conference: 8th European Congress on Menopause, EMAS London United Kingdom. Conference Start: 20090516 Conference End: 20090520 Sponsor: PANTARHEI BIOSCIENCE, FSDeducation.eu. Conference Publication: (var.pagings). 63:S50

  22. Lyytinen H, Dyba T, Pukkala E, Ylikorkala O. Do the dose or route of administration of norethisterone acetate as a part of hormone therapy play a role in risk of breast cancer: National-wide case-control study from Finland. Int J Cancer. 2010;127(1):185–9.

    Article  CAS  PubMed  Google Scholar 

  23. Lyytinen H, Pukkala E, Ylikorkala O. Breast cancer risk in postmenopausal women using estradiol-progestogen therapy. Obstet Gynecol. 2009;113(1):65–73.

    Article  PubMed  Google Scholar 

  24. Santen RJ. Menopausal hormone therapy and breast cancer. Journal of Steroid Biochemistry and Molecular Biology. 2013;142:52–61.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Michael Gionfriddo was supported by a CTSA Grant Number TL1 TR000137 from the National Center for Advancing Translational Science (NCATS). The contents of this manuscript are solely the responsibility of the authors and do not necessarily represent the official views of the NIH.

Authors’ contributions

NA, QH, MG, and OM participated in the data collection. NA, KM, SF, and MM participated and drafted the manuscript. NA and KM performed the statistical analysis. NA, KM, and MM participated in the analysis and interpretation. SF and MM critically revised the article. SF and MM approved the final revision of the review. All authors approved the final manuscript.

Competing interests

This review was funded by a contract from the Endocrine Society. The Endocrine Society as the funder had no role in literature search, statistical analysis, or the wording of the final report. Michael Gionfriddo was supported by CTSA Grant Number TL1 TR000137 from the National Center for Advancing Translational Science (NCATS). The contents of this manuscript are solely the responsibility of the authors and do not necessarily represent the official views of the NIH.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Noor Asi.

Additional files

Additional file 1:

PRISMA 2009 checklist. We followed the standards set in the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) statement for reporting this review. (PDF 84 kb)

Additional file 2:

Detailed search strategy. We searched MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and Scopus through August 2013 (updated search through 17 May 2016 yielded 457 additional abstracts) for studies that enrolled postmenopausal women using progesterone vs. synthetic progestins and reported the outcomes of interest. (PDF 63 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Asi, N., Mohammed, K., Haydour, Q. et al. Progesterone vs. synthetic progestins and the risk of breast cancer: a systematic review and meta-analysis. Syst Rev 5, 121 (2016). https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-016-0294-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-016-0294-5

Keywords