Skip to main content

Cinacalcet versus standard treatment for chronic kidney disease: a protocol for a systematic review and meta-analysis

Abstract

Background

Chronic kidney disease-mineral and bone disorders (CKD-MBD) have been associated with poor health outcomes, including diminished quality and length of life. Standard management for CKD-MBD includes phosphate-restricted diet, active vitamin D, vitamin D analogs, and phosphate binders. Persistently elevated parathyroid hormone (PTH) levels may require the addition of Cinacalcet hydrochloride (cinacalcet) which sensitizes calcium receptors on the parathyroid glands. The objective of this systematic review is to compare the effect of cinacalcet versus standard treatment in patients with CKD-MBD.

Methods/design

Data sources will include MEDLINE, EMBASE, the Cochrane Register of Controlled Trials, and Web of Science from 1996 to June 2015. Teams of two reviewers will, independently and in duplicate, screen titles and abstracts and potentially eligible full text reports to determine eligibility, and subsequently abstract data and assess risk of bias in eligible trials. We will calculate the effect estimates (risk ratios or mean differences) and 95 % confidence intervals, as well as statistical measures of variability in results across studies using random effect models for patient-important and intermediate outcomes. We will use the GRADE (Grading of Recommendations, Assessment, Development and Evaluation) approach to rate the quality of evidence about estimates of effect on an outcome-by-outcome basis. We will present our results with a GRADE summary table.

Discussion

Our review will explore the effect of cinacalcet versus standard treatment in patients with CKD-MBD. The results of this systematic review will help guide management of this patient population, and identify targets for future research.

Systematic review registration

PROSPERO CRD42015020318http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015020318.

Peer Review reports

Background

Chronic kidney disease-mineral and bone disorder (CKD-MBD) is a systematic condition defined by three components: (1) extra skeletal calcifications; (2) abnormal metabolism of serum calcium, phosphorus, parathyroid hormone (PTH), and vitamin D; and (3) abnormal bone metabolism, including bone turnover, mineralization, linear growth, and reduced strength [1]. CKD-MBD is also associated with extravascular calcifications, increased cardiovascular events, and mortality [1]. The pathogenesis of CKD-MBD involves receptor level problems, including vitamin D receptors and calcium-sensing receptors [2, 3]. Abnormal serum calcium, phosphorus, PTH, and vitamin D levels also contribute to the development of the disease process [24].

Parathyroid gland hyperplasia is a common finding in patients with CKD-MBD, and proliferation in parathyroid cells leads to increase in parathyroid gland secretion. This leads to secondary hyperparathyroidism (SHPT) which is associated with elevated serum PTH levels [5]. A consensus exists regarding the need for CKD-MBD treatment to maintain guideline recommended targets for calcium, phosphorus, and PTH in the presumption that meeting these targets will improve quality and quantity of life [3, 68].

In the management of CKD-MBD, recommendations suggest that patients should, in addition to phosphate-restricted diet, receive active vitamin D and phosphate binders [3, 6, 9]. Medical management of persistent elevated PTH requires the use of calcimimetic agents. Cinacalcet hydrochloride (cinacalcet) is a second generation calcimimetic agent used to sensitize calcium receptors on the parathyroid glands [10, 11]. This leads to decreased PTH synthesis and secretion [10, 11]. Cinacalcet is a positive allosteric modulator that interacts with non-calcium binding sites [2]. Although this therapy has a very wide applicability, including parathyroid cancers and primary and secondary hyperparathyroidism, cost is a major drawback that limits utilization [12].

In 2004, the US Food and Drug Administration approved cinacalcet for uncontrolled SHPT in CKD-MBD patients. The medication is not recommended for predialysis patients because of the potential risks for severe hypocalcemia and phosphate increase due to the low PTH levels [6, 13, 14]. The total cost of cinacalcet per patient with CKD-MBD ranges from $4000 to $23,500 per year in Canada.

CKD-MBD has been associated with increased mortality, and reduced bone and cardiovascular health [15]. Prior systematic reviews have found that cinacalcet treatment reduces the rate of parathyroidectomy, fracture, and hospitalization due to cardiovascular events [16, 17]; the effect on mortality has not been established [1820]. However, prior reviews have not included trials published after February 2013 and only included adult CKD patients.

We will update search covering more databases and the pediatric patient population with transparent quality assessment of findings. The consequences of CKD-MBD and pharmacokinetic and pharmacodynamic properties of cinacalcet may differ between the adult and pediatric patient populations. We will explore for a subgroup effect on this basis (adult versus children) and, if the test of interaction is significant, we will present results separately for these populations.

The objective of this systematic review is to evaluate the impact of cinacalcet treatment as compared to standard treatment alone or standard treatment plus placebo in patients with CKD-MBD and uncontrolled SHPT on patient-important outcomes, including cardiovascular events, fractures, parathyroidectomy, symptomatic hypotension, cardiovascular mortality, all-cause mortality, and intermediate outcomes—achieving Kidney Disease Outcome Quality Initiative targets (K/DOQI).

Methods/design

Data sources and search strategy

We will search the MEDLINE, EMBASE, and Cochrane Register of Controlled Trials and Web of Science databases from 1996 until June 2015 without any restrictions. We will use controlled vocabulary and text words to search all databases. We will scan the bibliographies of all prior systematic reviews and meta-analyses as well as all eligible primary studies for additional relevant articles. We will search for conference proceedings from 2010 to 2015 using the Web of Science and abstracts presented at recent annual meetings (the American Society of Nephrology, National Kidney Foundation, International Society of Nephrology and European Renal Association-European Dialysis and Transplant Association). Please refer to Table 1 for the full search strategy.

Table 1 Search strategy for the MEDLINE, EMBASE and Cochrane Central Register of Controlled Trials databases

Eligibility criteria

We will limit the studies included in this review to RCTs evaluating the effectiveness and safety of cinacalcet for the treatment of secondary HPT. The comparator will be the standard therapy alone or standard therapy plus placebo. The standard therapy includes phosphate binders and/or active vitamin D. This review will explore the effectiveness of cinacalcet treatment on the following outcomes: cardiovascular events, fractures, parathyroidectomy, symptomatic hypotension, cardiovascular mortality, all-cause mortality, end-of-treatment alkaline phosphatase, end-of-treatment PTH levels (any measure), end-of-treatment serum calcium concentrations (mg/dL or mmol/L), end-of-treatment serum phosphorus concentrations (mg/dL or mmol/L), end-of-treatment calcium x phosphorus product (mg2/dL2). We will not employ any restrictions for age. We will not include studies that the primary objective of which is to determine optimal dosing of cinacalcet and economic evaluation of cinacalcet treatment.

Study selection

Teams of two investigators will independently screen each unique title and abstract that our literature search identifies. If either reviewer identifies a citation as potentially relevant, we will obtain the full text of the article. Two reviewers will independently determine the eligibility of all studies that undergo full text evaluation. We will measure the inter-rater agreement for full text eligibility and assessment of the risk of bias using the kappa statistic [21]. Values of kappa between 0.40 and 0.59 have been considered to reflect fair agreement, between 0.60 and 0.74 to reflect good agreement and ≥0.75 to reflect excellent agreement [21]. Disagreements will be resolved through discussion between the reviewers or through adjudication with a third party if necessary.

Data abstraction

Using a standardized data collection form, two reviewers will collect the following information from each study: the author, date of publication, eligibility criteria, summary of baseline characteristics of the participants, number of participants in each arm at study onset and completion, duration of the trial, and treatment effects, including effectiveness and safety. We will resolve disagreements by discussion.

Quality assessment of individual studies

A modified version of the Cochrane risk for bias tool (http://distillercer.com/resources/) will be employed by two independent reviewers in order to assess risk of bias on an outcome-by-outcome basis for all eligible trials. The assessment will include the following components: adequacy of sequence generation, allocation sequence concealment, level of blinding, incomplete outcome data, loss to follow-up, and stopping early for benefit or futility [22]. Reviewers will input response options of “definitely yes”, “probably yes”, “probably no”, and “definitely no” for each of the domains, with definitely yes and probably yes ultimately assigned low risk of bias and definitely no and probably no assigned high risk of bias [23]. Reviewers will resolve disagreements by discussion, and one arbitrator will adjudicate unresolved disagreements.

We will use to assess the quality of evidence for each outcome using the GRADE (Grading of Recommendations, Assessment, Development and Evaluation) rating system [24]. In the GRADE system of rating quality of evidence for each outcome, randomized trials begin as high quality evidence, but may be rated down by one or more of five categories of limitations [25]. We will use the GRADE methodology to rate certainty in effect estimates and quality of evidence for each outcome as high, moderate, low, or very low [25]. We will use the detailed GRADE guidance to assess the overall risk of bias, imprecision, inconsistency, indirectness, and publication bias and summarize results with a GRADE summary table [26]. The quality of evidence will be rated down, if we determine risk of bias as well as large imprecision, inconsistency, indirectness, and publication bias.

With the respect to precision, we will assess the optimal information size (OIS; the number of patients generated by a conventional sample size calculation for a single trial) and the width of the 95 % CIs. GRADE guidance notes that meta-analyses of small trials can provide evidence of benefit with 95 % CIs that appear to convincingly exclude no effect; however, the results of reviews of such studies have often been subsequently refuted by larger trials [27, 28]. To address this potential concern in cases in which our meta-analysis suggests benefit but the sample size is less than the OIS, we will rate down imprecision. For the purposes of calculating the OIS, we will assume, for binary variables a relative risk reduction or increase (delta) of 25 %, an alpha of 0.05, and a beta of 0.20, and a median baseline risk from the available studies. In addition, we will examine the width of 95 % CIs and verify if 95 % CIs overlap clinical decision thresholds for each outcome.

In addition to assessment of statistical heterogeneity, the degree of proximity in point estimates and overlap in 95 % confidence intervals (95% CI) will be examined to assess consistency between studies. Differences in methodology, study populations, outcomes, and quality and quantity of interventions will be considered to evaluate directness.

For each outcome, we will assess publication bias by visually observing asymmetry of the funnel plot for each outcome [29, 30]. We will follow published guidance and construct funnel plots only for outcomes with ≥10 trials. Publication bias will be considered as unlikely unless the effect measure is asymmetrically distributed around the pooled effect [29].

After considering these reasons for rating down, we will judge the quality of evidence for each outcome as follows: “high” quality of evidence (we are very confident that the true effect lies close to that of the estimate of the effect); “moderate” quality of evidence (we are moderately confident in the effect estimate and the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different); “low” quality of evidence (our confidence in the effect estimate is limited and the true effect may be substantially different from the estimate of the effect); and “very low” quality of evidence (we have very little confidence in the effect estimate and the true effect is likely to be substantially different from the estimate of the effect) [25].

Data synthesis and statistical analysis

We will report descriptive statistics as proportions for categorical variables and mean or medians for the continuous variables. We will calculate pooled risk ratios (RRs) and the associated 95 % CI for each outcome using random effects models by applying the Mantel-Haenszel method. Absolute effects and the associated 95 % CI will be calculated by multiplying pooled RRs and 95 % CI by the pooled control rate of outcomes. Statistical heterogeneity will be assessed by the chi-square test and I 2 statistic. All data analyses will be performed using Stata (StataCorp. 2013. Stata Statistical Software: Release 13. College Station, TX: StataCorp LP).

Dealing with missing participant data for dichotomous outcomes: sensitivity analyses

We will conduct a complete-case analysis for our primary analysis and perform sensitivity analyses to address the robustness of our findings with respect to the missing data. We plan to use plausible worst-case scenario for the missing trial-level data. The extent to which point estimates and 95 % CIs differ in these sensitivity analyses will determine whether we rate down for risk of bias [30, 31].

Assessment of heterogeneity and subgroup analyses

Our estimates of study heterogeneity will be informed using the p value for the chi-square test for homogeneity and the I 2 statistic where 0–40 % may be unimportant heterogeneity, 30–60 % moderate, 50–90 % substantial, and 75–100 % considerable heterogeneity [32]. If the I 2 statistic indicates a value >50 %, we will explore heterogeneity. We will employ random effects meta-regression and include mean age, the mean baseline serum PTH concentration, trial duration, and stages of CKD (dialysis versus non-dialysis) in our univariate linear models.

We will employ subgroup analysis for the pediatric and adult patient populations. If the interaction test suggests a significant subgroup effect, we will report effect estimates for each subgroup separately.

Presentation of results

We will present the results of our meta-analyses in an evidence profile that will provide a succinct, easily digestible presentation of quality of evidence, and magnitude of effects [26]. Our evidence profile will be constructed to include the following elements: a measure of the typical burden of these outcomes (e.g., control group, estimated risk; if appropriate studies are available, we will use the baseline risk for population-based observational studies); a measure of the absolute risk difference between the risks with and without intervention; the relative magnitude of effect; the numbers of participants and studies addressing these outcomes; a GRADE rating of the overall confidence in estimate of effect for each outcome and any reasons for rating down the confidence [32].

Discussion

We expect to provide an objective assessment of effectiveness and safety of cinacalcet in patients with CKD-MBD. We will examine the impact of cinacalcet on patient-important outcomes. In addition, we will explore the quality of the existing evidence in both adult and pediatric patient populations with CKD-MBD. This will be the first systematic review that includes both pediatric and adult CKD patient populations in the assessment of cinacalcet and patient important outcomes available in the literature. We will disseminate our results in local meetings and in a peer-reviewed publication.

Strengths and limitations of this study

The methods of our proposed review are state of the art, including explicit eligibility criteria, a comprehensive search, independent duplicate assessment of eligibility, and the use of the GRADE approach to assessing quality of evidence of effect including independent duplicate assessment of risk of bias, precision, consistency, directness, and publication bias. Our protocol represents a model for systematic review methods. Our results are likely to be limited by limitations in the primary studies.

Abbreviations

Ca:

calcium

CKD-MBD:

chronic kidney disease-mineral and bone disorders

GRADE:

Grading of Recommendations, Assessment, Development and Evaluation

OIS:

optimal information size

P:

phosphate

PTH:

parathyroid hormone

RCT:

randomized controlled trail

RR:

risk ratios

SHPT:

secondary hyperparathyroidism

References

  1. Moe S, Drüeke T, Cunningham J, Goodman W, Martin K, Olgaard K, et al. Definition, evaluation, and classification of renal osteodystrophy: a position statement from Kidney Disease: Improving Global Outcomes (KDIGO). Kidney Int. 2006;69(11):1945–53.

    Article  PubMed  CAS  Google Scholar 

  2. Omata M, Fukagawa M, Kakuta T. Vascular calcification—pathological mechanism and clinical application-. Vascular calcification in chronic kidney disease-mineral and bone disorder (CKD-MBD). Clin Calcium. 2015;25(5):645–53.

    PubMed  CAS  Google Scholar 

  3. Wetmore JB, Quarles LD. Calcimimetics or vitamin D analogs for suppressing parathyroid hormone in end-stage renal disease: time for a paradigm shift? Nat Clin Pract Nephrol. 2009;5(1):24–33.

    Article  PubMed Central  PubMed  CAS  Google Scholar 

  4. Cunningham J, Locatelli F, Rodriguez M. Secondary hyperparathyroidism: pathogenesis, disease progression, and therapeutic options. Clin J Am Soc Nephrol CJASN. 2011;6(4):913–21.

    Article  PubMed  CAS  Google Scholar 

  5. Block GA, Martin KJ, de Francisco AL, Turner SA, Avram MM, Suranyi MG, et al. Cinacalcet for secondary hyperparathyroidism in patients receiving hemodialysis. N Engl J Med. 2004;350(15):1516–25.

    Article  PubMed  CAS  Google Scholar 

  6. Drueke TB. Cell biology of parathyroid gland hyperplasia in chronic renal failure. J Am Soc Nephrol. 2000;11(6):1141–52.

    PubMed  CAS  Google Scholar 

  7. KDIGO clinical practice guideline for the diagnosis, evaluation, prevention, and treatment of chronic kidney disease-mineral and bone disorder (CKD-MBD). Kidney Int Suppl, 2009(113): p. S1-130. doi: 10.1038/ki.2009.188.

  8. Uhlig K, Berns JS, Kestenbaum B, Kumar R, Leonard MB, Martin KJ, et al. KDOQI US commentary on the 2009 KDIGO clinical practice guideline for the diagnosis, evaluation, and treatment of CKD–mineral and bone disorder (CKD-MBD). Am J Kidney Dis. 2010;55(5):773–99.doi: 10.1053/j.ajkd.2010.02.340

    Article  PubMed  Google Scholar 

  9. Eknoyan G, Levin A, Levin NW. K/DOQI clinical practice guidelines for bone metabolism and disease in chronic kidney disease. Am J Kidney Dis, 2003. 42(4 Suppl 3): p. S1-201

  10. Hammerland LG, Garrett JE, Hung BC, Levinthal C, Nemeth EF. Allosteric activation of the Ca2+ receptor expressed in Xenopus laevis oocytes by NPS 467 or NPS 568. Mol Pharmacol. 1998;53(6):1083–8.

    PubMed  CAS  Google Scholar 

  11. Nemeth EF, Steffey ME, Hammerland LG, Hung BC, Van Wagenen BC, DelMar EG, et al. Calcimimetics with potent and selective activity on the parathyroid calcium receptor. Proc Natl Acad Sci U S A. 1998;95(7):4040–5.

    Article  PubMed Central  PubMed  CAS  Google Scholar 

  12. Qunibi WY. Cardiovascular calcification in nondialyzed patients with chronic kidney disease. Semin Dial., 2007. 20(2): p. 134–8.

  13. Charytan C, Coburn JW, Chonchol M, Herman J, Lien YH, Liu W, et al. Cinacalcet hydrochloride is an effective treatment for secondary hyperparathyroidism in patients with CKD not receiving dialysis. Am J Kidney Dis. 2005;46(1):58–67.

    Article  PubMed  CAS  Google Scholar 

  14. Chonchol M, Locatelli F, Abboud HE, Charytan C, de Francisco AL, Jolly S, et al. A randomized, double-blind, placebo-controlled study to assess the efficacy and safety of cinacalcet HCl in participants with CKD not receiving dialysis. Am J Kidney Dis. 2009;53(2):197–207.

    Article  PubMed  CAS  Google Scholar 

  15. Noordzij M, Korevaar JC, Boeschoten EW, Dekker FW, Bos WJ, Krediet RT, et al. The Kidney Disease Outcomes Quality Initiative (K/DOQI) guideline for bone metabolism and disease in CKD: association with mortality in dialysis patients. Am J Kidney Dis. 2005;46(5):925–32.

    Article  PubMed  Google Scholar 

  16. Palmer SC, Nistor I, Craig JC, Pellegrini F, Messa P, Tonelli M, et al. Cinacalcet in patients with chronic kidney disease: a cumulative meta-analysis of randomized controlled trials. PLoS Med / Public Library Science. 2013;10(4):e1001436.

    Google Scholar 

  17. Strippoli GF, Tong A, Palmer SC, Elder G, Craig JC. Calcimimetics for secondary hyperparathyroidism in chronic kidney disease patients. Cochrane Database Syst Rev. 2006;4:CD006254.

    PubMed  Google Scholar 

  18. Fishbane S, Shapiro WB, Corry DB, Vicks SL, Roppolo M, Rappaport K, et al. Cinacalcet HCl and concurrent low-dose vitamin D improves treatment of secondary hyperparathyroidism in dialysis patients compared with vitamin D alone: the ACHIEVE study results. Clin J Am Soc Nephrol CJASN. 2008;3(6):1718–25.

    Article  PubMed  CAS  Google Scholar 

  19. Messa P, Macário F, Yaqoob M, Bouman K, Braun J, von Albertini B, et al. The OPTIMA study: assessing a new cinacalcet (Sensipar/Mimpara) treatment algorithm for secondary hyperparathyroidism. Clin J Am Soc Nephrol CJASN. 2008;3(1):36–45.

    Article  PubMed  CAS  Google Scholar 

  20. Raggi P, Chertow GM, Torres PU, Csiky B, Naso A, Nossuli K, et al. The ADVANCE study: a randomized study to evaluate the effects of cinacalcet plus low-dose vitamin D on vascular calcification in patients on hemodialysis. Nephrol Dial Transplant. 2011;26(4):1327–39.

    Article  PubMed  CAS  Google Scholar 

  21. R.G.O. In: Hedges LV, Cooper H, editors. The Handbook of Research Synthesis, in Evaluating coding decisions. New York (NY): Russell Sage; 1994.

    Google Scholar 

  22. Higgins JP, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. J R Stat Soc Ser A Stat Soc. 2009;172(1):137–59.

    Article  PubMed Central  PubMed  Google Scholar 

  23. Akl EA, Sun X, Busse JW, Johnston BC, Briel M, Mulla S, et al. Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid. J Clin Epidemiol. 2012;65(3):262–7.

    Article  PubMed  Google Scholar 

  24. Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(7454):1490.

    Article  PubMed  Google Scholar 

  25. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6.

    Article  PubMed Central  PubMed  Google Scholar 

  26. Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol. 2011;64(4):380–2.

    Article  PubMed  Google Scholar 

  27. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 7. Rating the quality of evidence—inconsistency. J Clin Epidemiol. 2011;64(12):1294–302.

    Article  PubMed  Google Scholar 

  28. Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence—imprecision. J Clin Epidemiol. 2011;64(12):1283–93.

    Article  PubMed  Google Scholar 

  29. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol. 2011;64(12):1303–10.

    Article  PubMed  Google Scholar 

  30. Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol. 2011;64(12):1277–82.

    Article  PubMed  Google Scholar 

  31. Akl EA, Johnston BC, Alonso-Coello P, Neumann I, Ebrahim S, Briel M, et al. Addressing dichotomous data for participants excluded from trial analysis: a guide for systematic reviewers. PLoS One. 2013;8(2):e57132.

    Article  PubMed Central  PubMed  CAS  Google Scholar 

  32. Guyatt GH, Oxman AD, Santesso N, Helfand M, Vist G, Kunz R, et al. GRADE guidelines: 12. Preparing summary of findings tables-binary outcomes. J Clin Epidemiol. 2013;66(2):158–72.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We have not received any funding for this review.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nigar Sekercioglu.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

All authors participated in the preparation of the manuscript and agreed to the submitted version of the paper. NS contributed to the conception and design of the protocol and drafted the manuscript. LT, GG, RAM, and JWB contributed to the conception, design, and revision of the manuscript. All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sekercioglu, N., Busse, J.W., Mustafa, R.A. et al. Cinacalcet versus standard treatment for chronic kidney disease: a protocol for a systematic review and meta-analysis. Syst Rev 5, 2 (2016). https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-015-0177-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-015-0177-1

Keywords