Skip to main content

Team functioning and implementation of innovations in healthcare and human service settings: a systematic review protocol

Abstract

Background

Healthcare and human services increasingly rely on teams of individuals to deliver services. Implementation of evidence-based practices and other innovations in these settings requires teams to work together to change processes and behaviors. Accordingly, team functioning may be a key determinant of implementation outcomes. This systematic review will identify and summarize empirical research examining associations between team functioning and implementation outcomes in healthcare and human service settings.

Methods

We will conduct a comprehensive search of bibliographic databases (e.g., MEDLINE, PsycINFO, CINAHL, ERIC) for articles published from January 2000 or later. We will include peer-reviewed empirical articles and conference abstracts using quantitative, qualitative, or mixed methods. We will include experimental or observational studies that report on the implementation of an innovation in a healthcare or human service setting and examine associations between team functioning and implementation outcomes. Implementation outcomes of interest are acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, and sustainability. Two reviewers will independently screen all titles/abstracts, review full-text articles, and extract data from included articles. We will use the Mixed Methods Appraisal Tool to assess methodological quality/bias and conduct a narrative synthesis without meta-analysis.

Discussion

Understanding how team functioning influences implementation outcomes will contribute to our understanding of team-level barriers and facilitators of change. The results of this systematic review will inform efforts to implement evidence-based practices in team-based service settings.

Systematic review registration

PROSPERO CRD42020220168

Peer Review reports

Background

Team-based approaches to care, in which multiple providers work collaboratively with patients and families toward shared goals, are increasingly common across a range of healthcare and human service settings [1,2,3,4,5]. Occurring alongside the shift to team-based care is an increasing emphasis on evidence-based practice in healthcare and human services. In team-based service settings, implementing evidence-based practices and other innovations requires teams to change processes and behaviors to respond to new demands, yet little research has examined how team functioning influences implementation [6, 7].

Team functioning can be defined as how teams think, feel, and act [8,9,10,11,12]. Team functioning refers to processes and emergent states that may be affective, behavioral, or cognitive [8, 9]. Cognitive and affective states emerge from behaviors and interactions between team members and have reciprocal effects on these behaviors [8, 9]. Affective aspects of team functioning include cohesion, trust, respect, and collective efficacy. Behavioral processes include communication, coordination, conflict resolution, information sharing, and decision-making. Lastly, cognitive aspects include knowledge, shared mental models, and diversity in members’ expertise [9, 12,13,14,15,16,17,18,19]. Better team functioning is associated with better team performance in diverse work settings [8, 20, 21].

Research on teams in healthcare has focused primarily on the influence of team functioning on service outcomes (i.e., patient safety, efficiency, effectiveness, equity, patient-centeredness, and timeliness [22]). Better team functioning is associated with greater patient safety and better patient outcomes [23, 24], and there is increasing evidence that interventions to improve the functioning of healthcare teams improve patient safety and outcomes [24,25,26,27,28]. Less attention, however, has been paid to the role of teams in the implementation of evidence-based healthcare interventions.

Implementation of evidence-based practices is a multi-phased process that unfolds over time and is influenced by determinants (i.e., barriers and facilitators) at multiple levels. This systematic review is guided by the Exploration, Preparation, Implementation, and Sustainment (EPIS) determinant framework [29, 30] and Proctor and colleagues’ implementation outcomes framework [31]. EPIS specifies four phases—Exploration, Preparation, Implementation, and Sustainment—and describes inner context (i.e., within the organization) and outer context (i.e., external to the organization) determinants and mechanisms, as well as innovation qualities and bridging factors (linking outer and inner contexts) that affect implementation [29, 30]. Implementation outcomes, as defined by Proctor et al. [31], include acceptability, adoption, appropriateness, costs, feasibility, fidelity, penetration, and sustainability of the evidence-based practice being implemented [31]. They are distinct from and precede traditional effectiveness or patient-level outcomes (Fig. 1).

Fig. 1
figure 1

Conceptual model (adapted from Proctor et al. [31]). Note: Dark outlines indicate the focus of this systematic review

There is extensive evidence that characteristics of individual providers and organizations influence the implementation process [7, 30, 32,33,34,35]. However, team-level determinants of implementation have received less research attention. Team functioning has been shown to impact service and patient outcomes in healthcare [23, 24] and may impact these outcomes in part through its impact on implementation outcomes. Because teams must change processes and behaviors to implement a new practice, affective, behavioral, and cognitive aspects of team functioning are likely to influence the implementation process and affect implementation outcomes because of the need for teams to change. Figure 1 illustrates how team functioning may impact outcomes in healthcare and human service settings. The goal of this systematic review is to identify and summarize empirical research examining associations between team functioning and implementation outcomes when evidence-based practices and other innovations are implemented in healthcare and human service settings.

Methods

The protocol for this systematic review has been registered in the international prospective register of systematic reviews (PROSPERO; registration number: CRD42020220168) and is reported in accordance with the guidance provided in the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) statement ([36, 37]; see checklist in Additional File 1).

Eligibility criteria

Studies will be selected based on study design, setting, study characteristics, and outcomes, as described below.

Study design

We will include peer-reviewed empirical articles and conference abstracts using quantitative, qualitative, or mixed methods. We will include both observational (e.g., cross-sectional studies, cohort studies) and experimental studies (e.g., randomized controlled trials, nonrandomized trials). Study protocols, reviews (including meta-analyses), and commentaries will be excluded.

Setting

We will include studies conducted in healthcare or human service settings. Examples include primary care practices, hospitals, specialty clinics, treatment centers, long-term care facilities, group homes, correctional facilities, child welfare or youth services, aging services, and schools. We will exclude studies conducted in higher education settings unless specific to healthcare (e.g., a study conducted in a university health clinic).

Study characteristics

We will include studies that describe and report on the implementation of an innovation or intervention to improve patient care (e.g., guideline, evidence-based treatment). We will exclude studies of interventions designed to improve teamwork (e.g., team building or team training interventions) and studies of teams created to implement an innovation (e.g., implementation teams, quality improvement teams). Eligible studies must assess and report on at least one aspect of team functioning and test its association with at least one implementation outcome. For this review, we define team functioning as how teams think, feel, and act and include studies that measure affective, behavioral, or cognitive processes or emergent states. Implementation outcomes are defined below.

Outcomes

We will include studies that assess and report at least one implementation outcome, as defined by Proctor and colleagues [31]. Primary outcomes of interest are acceptability (i.e., perceptions that innovation is acceptable), adoption (i.e., decision to use innovation), appropriateness (i.e., perceived fit of innovation), costs of implementation effort, feasibility of the innovation, fidelity (i.e., degree to which innovation is implemented as designed), penetration/reach (i.e., extent to which innovation is integrated in setting; proportion of eligible recipients who receive innovation), and sustainability (i.e., extent to which innovation is maintained over time). We will include studies using common synonyms or other terms to describe implementation outcomes (e.g., extent of implementation, implementation quality). Results for each implementation outcome will be reported separately.

Information sources and search strategy

An experienced librarian (MLK) will develop bibliographic database search strings using controlled vocabulary, e.g., Medical Subject Headings (MeSH), and natural language terms to represent the concepts of “team functioning” and “implementation of evidence-based practice.” We will search the following electronic databases: Ovid MEDLINE, Ovid PsycINFO, EBSCOhost CINAHL, and EBSCOhost ERIC. A draft search strategy for Ovid MEDLINE is provided in Additional File 2. A publication date limit of 2000 to current will be applied to all searches. In 2000, the Institute of Medicine published the seminal report To Err is Human, which identified teamwork as important to reducing medical errors and initiated a period of increasing attention to teamwork in healthcare [23]. The past 20 years also includes the rapid development of implementation science as an independent field of research, marked by the founding of Implementation Science in 2006 and the first Annual Conference on the Science of Dissemination and Implementation in Health in 2008. Articles published in languages other than English will be translated using Google Translate [38].

After completing the above database searches, we will also search available conference abstracts from two leading implementation conferences (Annual Conference on the Science of Dissemination & Implementation in Health 2008–2020; Society for Implementation Research Collaboration 2011–2019). Lastly, we will hand-search the reference lists of included articles, perform a cited reference search for included articles in the Web of Science and Scopus databases, and consult content experts to identify additional relevant articles. Searches will be re-run prior to the final analysis, with any additional identified studies retrieved and considered for inclusion.

Selection process

DistillerSR software will be used to store search results and conduct reference screening. After removing duplicates, two independent reviewers will screen titles and abstracts for inclusion. We will pilot screening forms with at least 10 articles and refine forms before screening. Discrepancies in inclusion/exclusion determinations will be resolved through re-review, discussion between reviewers, and if needed, review of the title/abstract by a third reviewer. Next, two independent reviewers will review full texts to determine if the article should be included or excluded. Again, we will pilot forms with at least 10 articles and refine forms before beginning the review phase. Disagreements will be resolved through discussion between reviewers, and if needed, consultation with a third author. We will assess inter-rater reliability (e.g., Cohen’s kappa, percent agreement) for the title/abstract screening and full-text review phases. We will document reasons for exclusion and use a PRISMA flow diagram to present the number of identified, included, and excluded articles.

Data extraction

We will use DistillerSR software to extract relevant data, including basic study information (e.g., authors, publication year, funding source), study aim(s), study setting, sample characteristics (e.g., eligibility criteria, sample size, participant demographics), study type and design, innovation implemented, implementation methods, assessment timepoints, measures of team functioning, implementation outcome(s), statistical analysis methods, and results. We will pilot the data extraction form with at least 10 articles and refine the form before beginning data extraction. Data extraction will be performed by one reviewer and independently verified by a second. Discrepancies will be resolved through re-review of the original study, discussion, and if needed, consultation with a third author. Authors will be contacted for unreported data.

Quality and risk of bias assessment

After data has been extracted from all relevant studies, we will assess the methodological quality of each included study using the Mixed Methods Appraisal Tool (MMAT) [39]. This tool provides criteria to evaluate the quality of qualitative, quantitative, and mixed methods studies. Multiple publications on the same study will be assessed as a group. Each study will be assessed by one reviewer and independently verified by a second. Discrepancies between reviewers will be resolved through discussion and consultation with a third author when needed to reach consensus. Quality appraisal results will be summarized in a table and described in the narrative synthesis of findings.

Data synthesis

We plan to conduct a narrative synthesis of included articles following guidelines for the reporting of synthesis without meta-analysis (SWiM [40]). If more than five studies test associations between a specific aspect of team functioning and the same implementation outcome, we will conduct meta-analyses using random-effects models. Data extracted from included studies will be presented in tables organized by dimensions of team functioning (i.e., affective, behavioral, or cognitive). Tables will include characteristics of the setting (e.g., healthcare vs. human services) and team (e.g., size, stability) to allow for consideration of heterogeneity in findings. Tables will also include standardized metrics of association (e.g., correlation coefficients) for quantitative studies. Review findings will be presented in succinct tables that include lists of individual studies contributing to the finding, the range and distribution of quantitative results, summaries of qualitative findings, and ratings of evidence quality (described below).

Confidence in cumulative evidence

We will assess the strength of the overall body of evidence using GRADE [41] and GRADE-CERQual [42]. Both approaches result in ratings of high, moderate, low, or very low quality of evidence. GRADE ratings are based on (1) risk of bias in individual studies, (2) imprecision, (3) inconsistency across studies, (4) indirectness, and (5) publication bias. Similarly, GRADE-CERQual is designed for qualitative studies, and ratings are based on (1) methodological limitations of individual studies, (2) coherence, (3) adequacy (i.e., richness and quantity) of data, and (4) relevance to review question. Two independent reviewers will make ratings, and discrepancies between reviewers will be resolved through discussion and consultation with a third author when needed to reach consensus.

Discussion

Despite the increasing use of team-based care in healthcare and human services, little research has examined team-level determinants of implementation of evidence-based practices. Affective, behavioral, and cognitive aspects of team functioning are likely to affect the ways in which teams respond to change efforts and therefore impact implementation outcomes. We anticipate that better team functioning (e.g., high cohesion, effective communication) will be associated with better implementation outcomes, while problems in team functioning (e.g., poor conflict resolution, low trust) will negatively impact implementation outcomes.

This systematic review will provide a comprehensive summary of empirical research on associations between team functioning and implementation outcomes in healthcare and human service settings. Results will be reported in accordance with the PRISMA 2020 statement [43] and disseminated through conference presentations and publication in a peer-reviewed journal. Any changes to the protocol described here will be added in an amendment in PROSPERO and described in the final manuscript. Limitations of this review include the possibility of unintentionally omitting some relevant studies (e.g., studies that refer to work units or groups instead of teams). To reduce this risk, we will consult with content experts, search abstracts from prominent implementation conferences, and search reference lists of included articles. Although inclusion of qualitative and mixed methods studies is likely to increase the time required to identify relevant articles [44], they will be included because of their widespread use in implementation research [45,46,47]. Another likely challenge will be the operationalization and measurement of team functioning and implementation outcomes. There is likely to be significant variability in the specific domains of team functioning assessed by individual studies. Similarly, there is variability in implementation outcomes reported across studies and considerable unevenness in the availability and psychometric quality of implementation outcome measures [48]. Variations in how team functioning is defined and measured and variations in implementation outcomes may contribute to inconsistency across studies and hinder our ability to draw conclusions.

The findings of this systematic review will highlight gaps in our understanding of team-level influences on implementation to consider in future research. Findings may also inform the development and selection of implementation strategies to target team-level mechanisms. Understanding how team functioning influences implementation outcomes will contribute to our understanding of mechanisms of change and inform the use of targeted implementation strategies in team-based service settings.

Availability of data and materials

Not applicable.

Abbreviations

EPIS:

Exploration, Preparation, Implementation, and Sustainment

GRADE:

Grading of Recommendations Assessment, Development, and Evaluation

GRADE-CERQual:

Grading of Recommendations Assessment, Development, and Evaluation-Confidence in the Evidence from Reviews of Qualitative research

MeSH:

Medical Subject Headings

MMAT:

Mixed Methods Appraisal Tool

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

PRISMA-P:

Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols

References

  1. Fiscella K, McDaniel SH. The complexity, diversity, and science of primary care teams. Am Psychol. 2018;73(4):451–67. https://0-doi-org.brum.beds.ac.uk/10.1037/amp0000244.

    Article  PubMed  Google Scholar 

  2. Katkin JP, Kressly SJ, Edwards AR, Perrin JM, Kraft CA, Richerson JE, et al. Guiding principles for team-based pediatric care. Pediatrics. 2017;140(2):e20171489. https://0-doi-org.brum.beds.ac.uk/10.1542/peds.2017-1489.

    Article  PubMed  Google Scholar 

  3. Lewandowski CA, GlenMaye LF. Teams in child welfare settings: interprofessional and collaborative processes. Fam Soc. 2002;83(3):245–56. https://0-doi-org.brum.beds.ac.uk/10.1606/1044-3894.25.

    Article  Google Scholar 

  4. Lipton HL. Home is where the health is: advancing team-based care in chronic disease management. Arch Intern Med. 2009;169(21):1945–8. https://0-doi-org.brum.beds.ac.uk/10.1001/archinternmed.2009.428.

    Article  PubMed  Google Scholar 

  5. Mitchell P, Wynia M, Golden R, McNellis B, Okun S, Webb CE, Rohrbach V, Von Kohorn I. Core principles & values of effective team-based health care. NAM Perspectives. Washington, DC: Discussion Paper, National Academy of Medicine; 2012.  https://0-doi-org.brum.beds.ac.uk/10.31478/201210c.

  6. Huang K-Y, Kwon SC, Cheng S, Kamboukos D, Shelley D, Brotman LM, et al. Unpacking partnership, engagement, and collaboration research to inform implementation strategies development: theoretical frameworks and emerging methodologies. Front Public Health. 2018;6:190. https://0-doi-org.brum.beds.ac.uk/10.3389/fpubh.2018.00190.

  7. Williams NJ, Beidas RS. Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field. J Child Psychol Psychiatry. 2019;60(4):430–50. https://0-doi-org.brum.beds.ac.uk/10.1111/jcpp.12960.

    Article  PubMed  Google Scholar 

  8. Kozlowski SWJ, Bell BS. Work groups and teams in organizations: review update. In: Schmitt N, Highhouse S, editors. Handbook of psychology (Vol 12): industrial and organizational psychology. 2nd ed. Hoboken: Wiley; 2013. p. 111.

    Google Scholar 

  9. Kozlowski SWJ, Ilgen DR. Enhancing the effectiveness of work groups and teams. Psychol Sci Public Interest. 2006;7(3):77–124. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1529-1006.2006.00030.x.

    Article  PubMed  Google Scholar 

  10. Kraiger K, Ford JK, Salas E. Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. J Appl Psychol. 1993;78(2):311–28. https://0-doi-org.brum.beds.ac.uk/10.1037/0021-9010.78.2.311.

    Article  Google Scholar 

  11. Mitropoulos P, Memarian B. Team processes and safety of workers: cognitive, affective, and behavioral processes of construction crews. J Constr Eng Manag. 2012;138(10):1181–91. https://0-doi-org.brum.beds.ac.uk/10.1061/(ASCE)CO.1943-7862.0000527.

    Article  Google Scholar 

  12. Salas E, DiazGranados D, Klein C, Burke CS, Stagl KC, Goodwin GF, et al. Does team training improve team performance? A meta-analysis. Hum Factors. 2008;50(6):903–33. https://0-doi-org.brum.beds.ac.uk/10.1518/001872008X375009.

    Article  PubMed  Google Scholar 

  13. Cronin MA, Weingart LR. Representational gaps, information processing, and conflict in functionally diverse teams. Acad Manage Rev. 2007;32(3):761–73. https://0-doi-org.brum.beds.ac.uk/10.5465/amr.2007.25275511.

    Article  Google Scholar 

  14. DeChurch LA, Mesmer-Magnus JR. The cognitive underpinnings of effective teamwork: a meta-analysis. J Appl Psychol. 2010;95(1):32–53. https://0-doi-org.brum.beds.ac.uk/10.1037/a0017328.

    Article  PubMed  Google Scholar 

  15. Kozlowski SWJ, Bell BS. Work groups and teams in organization. In: Borman WC, Ilgen DR, Klimoski RJ, editors. Handbook of psychology (Vol 12): industrial and organizational psychology. New York: Wiley-Blackwell; 2003. p. 333–375.https://0-doi-org.brum.beds.ac.uk/10.1002/9781118133880.hop212017.

  16. Ren Y, Argote L. Transactive memory systems 1985–2010: an integrative framework of key dimensions, antecedents, and consequences. Acad Manag Ann. 2011;5(1):189–229. https://0-doi-org.brum.beds.ac.uk/10.5465/19416520.2011.590300.

    Article  Google Scholar 

  17. Edmondson AC, Harvey J-F. Cross-boundary teaming for innovation: integrating research on teams and knowledge in organizations. Hum Resour Manag Rev. 2018;28(4):347–60. https://0-doi-org.brum.beds.ac.uk/10.1016/j.hrmr.2017.03.002.

    Article  Google Scholar 

  18. Shuffler ML, Diazgranados D, Maynard MT, Salas E. Developing, sustaining, and maximizing team effectiveness: an integrative, dynamic perspective of team development interventions. Acad Manag Ann. 2018;12(2):688–724. https://0-doi-org.brum.beds.ac.uk/10.5465/annals.2016.0045.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Weingart LR, Todorova G, Cronin MA. Task conflict, problem-solving, and yielding: effects on cognition and performance in functionally diverse innovation teams. Negot Confl Manag Res. 2010;3(4):312–37. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1750-4716.2010.00063.x.

    Article  Google Scholar 

  20. Salas E, Rico R, Passmore J. The Wiley Blackwell handbook of the psychology of team working and collaborative processes. Wiley; 2017. https://0-doi-org.brum.beds.ac.uk/10.1002/9781118909997.ch1.

  21. Bisbey T, Salas E. Team dynamics and processes in the workplace. In: Oxford Research Encyclopedia of Psychology. Oxford University Press; 2019. https://0-doi-org.brum.beds.ac.uk/10.1093/acrefore/9780190236557.013.13.

  22. Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. National Academies Press; 2001. p. 359.

    Google Scholar 

  23. Dinh JV, Traylor AM, Kilcullen MP, Perez JA, Schweissing EJ, Venkatesh A, et al. Cross-disciplinary care: a systematic review on teamwork processes in health care. Small Group Res. 2020;51(1):125–66. https://0-doi-org.brum.beds.ac.uk/10.1177/1046496419872002.

    Article  Google Scholar 

  24. Schmutz J, Manser T. Do team processes really have an effect on clinical performance? A systematic literature review. BJA Br J Anaesth. 2013;110(4):529–44. https://0-doi-org.brum.beds.ac.uk/10.1093/bja/aes513.

    Article  CAS  PubMed  Google Scholar 

  25. Hughes AM, Gregory ME, Joseph DL, Sonesh SC, Marlow SL, Lacerenza CN, et al. Saving lives: a meta-analysis of team training in healthcare. J Appl Psychol. 2016;101(9):1266–304. https://0-doi-org.brum.beds.ac.uk/10.1037/apl0000120.

    Article  PubMed  Google Scholar 

  26. McCulloch P, Rathbone J, Catchpole K. Interventions to improve teamwork and communications among healthcare staff. BJS. 2011;98(4):469–79. https://0-doi-org.brum.beds.ac.uk/10.1002/bjs.7434.

    Article  CAS  Google Scholar 

  27. Miller CJ, Kim B, Silverman A, Bauer MS. A systematic review of team-building interventions in non-acute healthcare settings. BMC Health Serv Res. 2018;18(1):146. https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-018-2961-9.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Weaver SJ, Dy SM, Rosen MA. Team-training in healthcare: a narrative synthesis of the literature. BMJ Qual Saf. 2014;23(5):359–72. https://0-doi-org.brum.beds.ac.uk/10.1136/bmjqs-2013-001848.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23. https://0-doi-org.brum.beds.ac.uk/10.1007/s10488-010-0327-7.

    Article  PubMed  Google Scholar 

  30. Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1. https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-018-0842-6.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38(2):65–76. https://0-doi-org.brum.beds.ac.uk/10.1007/s10488-010-0319-7.

    Article  Google Scholar 

  32. Allen JD, Towne SD, Maxwell AE, DiMartino L, Leyva B, Bowen DJ, et al. Measures of organizational characteristics associated with adoption and/or implementation of innovations: a systematic review. BMC Health Serv Res. 2017;17(1):591. https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-017-2459-x.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://0-doi-org.brum.beds.ac.uk/10.1186/1748-5908-4-50.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. https://0-doi-org.brum.beds.ac.uk/10.1111/j.0887-378X.2004.00325.x.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Novins DK, Green AE, Legha RK, Aarons GA. Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review. J Am Acad Child Adolesc Psychiatry. 2013;52(10):1009–25 e18. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jaac.2013.07.012.

  36. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. https://0-doi-org.brum.beds.ac.uk/10.1186/2046-4053-4-1.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.g7647.

  38. Jackson JL, Kuriyama A, Anton A, Choi A, Fournier J-P, Geier A-K, et al. The accuracy of Google Translate for abstracting data from non–English-language trials for systematic reviews. Ann Intern Med. 2019;171(9):677–9. https://0-doi-org.brum.beds.ac.uk/10.7326/M19-0891.

    Article  PubMed  Google Scholar 

  39. Hong QN, Pluye P, Fàbregues S, Bartlett G, Boardman F, Cargo M, et al. Improving the content validity of the mixed methods appraisal tool: a modified e- Delphi study. J Clin Epidemiol. 2019;111:49–59 e1. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jclinepi.2019.03.008.

  40. Campbell M, McKenzie JE, Sowden A, Katikireddi SV, Brennan SE, Ellis S, et al. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020;368:l6890. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.l6890.

  41. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jclinepi.2010.04.026.

    Article  PubMed  Google Scholar 

  42. Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci. 2018;13(1):1–10. https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-017-0688-3.

  43. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.n71.

  44. Jones ML. Application of systematic review methods to qualitative research: practical issues. J Adv Nurs. 2004;48(3):271–8. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1365-2648.2004.03196.x.

    Article  PubMed  Google Scholar 

  45. Green CA, Duan N, Gibbons RD, Hoagwood KE, Palinkas LA, Wisdom JP. Approaches to mixed methods dissemination and implementation research: methods, strengths, caveats, and opportunities. Adm Policy Ment Health Ment Health Serv Res. 2015;42(5):508–23. https://0-doi-org.brum.beds.ac.uk/10.1007/s10488-014-0552-6.

    Article  Google Scholar 

  46. Hamilton AB, Finley EP. Qualitative methods in implementation research: an introduction. Psychiatry Res. 2019;280:112516. https://0-doi-org.brum.beds.ac.uk/10.1016/j.psychres.2019.112516.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health. 2011;38(1):44–53. https://0-doi-org.brum.beds.ac.uk/10.1007/s10488-010-0314-z.

    Article  PubMed  Google Scholar 

  48. Lewis CC, Fischer S, Weiner BJ, Stanick C, Kim M, Martinez RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implement Sci. 2015;10(1):155. https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-015-0342-x.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was supported by funding from the National Institute of Mental Health (MH018951; MH123729; MH124914), the Agency on Healthcare Research and Quality (1R18HS026862), and the Collaboration and Conflict Research Lab at Carnegie Mellon University Tepper School of Business. The content of this manuscript is solely the responsibility of the authors.

Author information

Authors and Affiliations

Authors

Contributions

EAM conceptualized the review and drafted the initial manuscript. DJK and CBW substantially contributed to the conceptualization of the review and revised the manuscript. MLK developed the search strategy. JF and GK contributed to the development of methods. MAD and LRW provided critical feedback on the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Elizabeth A. McGuier.

Ethics declarations

Ethics approval and consent to participate

The review described in this manuscript does not involve human participants. No ethical approval is required.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

PRISMA-P 2015 Checklist.

Additional file 2.

MEDLINE Search Example.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McGuier, E.A., Kolko, D.J., Klem, M.L. et al. Team functioning and implementation of innovations in healthcare and human service settings: a systematic review protocol. Syst Rev 10, 189 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-021-01747-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-021-01747-w

Keywords