Instrument Review Project
A Comprehensive Review of Dissemination and Implementation Science Instruments
Exciting advances have been made in the field of dissemination and implementation (D&I). However, much like the science-practice gap that motivates our field, a communication gap exists among stakeholders at the forefront of this work. Measurement issues have slowed the progression of the field of D&I given the laborious process of systematically developing psychometrically sound yet feasible and cost-effective ways to assess our efforts. The lag that occurs between initial development, implementation, and then publication delays the process further, resulting in instances in which independent research teams are devoting considerable resources to unnecessarily redundant work. As a consequence, progress toward the development of commonly used instruments has been very slow, limiting the extent to which researchers have access to and are able to benefit from the contributions of their colleagues.
The overarching aim of the SIRC Instrument Review Project is to conduct a comprehensive review of D&I instruments pulling, not only from published work, but also utilizing existing D&I research networks to obtain instruments in earlier phases of development.
Three primary outcomes for this project series include:
(1) a comprehensive library of D&I instruments measuring the implementation outcomes identified by Proctor and colleagues (2010) and organized by the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2009) to make available to SIRC members;
(2) a rating system reflecting the degree of empirical validation of instruments, adapted from the evidence-based assessment (EBA) work of Hunsley and Mash (2008);
(3) a consensus battery of instruments decided upon by D&I expert task force members using the EBA criteria to guide future D&I research efforts.
To achieve these goals we have two phases of research remaining.
An update on SIRC Instrument Review Project Progress (0/16/13)
We have now identified nearly 450 instruments to be included in our repository. Our research assistants are working feverishly to conduct literature reviews on each instrument to collect all published data to be used in the EBA rating process. We anticipate completing the specific instrument reviews by the end of this summer.
We have also formed the SIRC Instrument Review Task Force (IRTF)1 which contains over 50 implementation experts from around the world who are committed to helping us complete the rating of all our instruments. We are working with our IRTF to apply the EBA rating criteria to the implementation outcome instruments. We anticipate completing the rating process for all instruments (450+) by the end of this calendar year.
We will be going live with the results from the implementation outcomes constructs at our conference May 2013.
A Glimpse of what is to come.
Our instrument repository for SIRC members is under construction to adopt the following navigation scheme.
Once you select a domain from the CFIR diagram above you will be presented with a list of constructs as seen in the picture below.
Selecting a construct will then take you to a construct page that includes the definition, and the list of measures with a brief summary of each (shown below).
Finally, you can select a measure to access sample items, links to related articles, the scoring guide, and any other supplemental material (see below). Eventually we will also provide the Evidence Based Rating scores for each measure to facilitate decision making.
1. Current SIRC IRT members include (listed in alphabetical order by last name):
Drs. Gregory Aarons, Cassidy Arnold, Melanie Barwick, Rinad Beidas, Helen Best, Elisa Borah, Cameo Borntrager, Craig Bryan, Adam Carmel, Mark Chaffin, Kate Comtois, Laura Damschroder, Dennis Donovan, Shannon Dorsey, Michelle Duda, Julia Felton, Dean Fixsen, Howard Goldman, Carmen Hall, Rochelle Hanson, Petra Helmond, Amanda Jensen-Doss, Sarah Kaye, Meghan Keough, Sara Landes, Cara Lewis, Marsha Linehan, Aaron Lyon, Michael McDonell, Kate McHugh, Maria Mancebo, Shari Manning, Christopher Martell, Erin Miga, Brian Mittman, Sandra Naoom, Byron Powell, Raphael Rose, Lisa Ruble, Joe Ruzek, Anju Sahay, Sonja Schoenwald, Rebecca Selove, Jeffrey Smith, Bradley Steinfeld, Phil Ullrich, Bryan Weiner, Elizabeth A. Wells, and Shannon Wiltsey Stirman.