Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)

Tracy L. Finch; Melissa Girling; Carl R. May; Frances S. Mair; Elizabeth Murray; Shaun Treweek; Elaine McColl; Ian Nicholas Steen; Clare Cook; Christopher R. Vernazza; Nicola Mackintosh; Samridh Sharma; Gaery Barbery; Jimmy Steele; Tim Rapley

doi:10.1186/s12874-018-0591-x

journal article Open Access Nov 15, 2018

Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)

Tracy L. Finch

Melissa Girling

Carl R. May Frances S. Mair Elizabeth Murray Shaun Treweek

Elaine McColl Ian Nicholas Steen Clare Cook Christopher R. Vernazza Nicola Mackintosh Samridh Sharma Gaery Barbery Jimmy Steele Tim Rapley

BMC Medical Research Methodology Vol. 18 No. 1 · Springer Science and Business Media LLC

View at Publisher Save 10.1186/s12874-018-0591-x

Topics

No keywords indexed for this article. Browse by subject →

References

49

[1]

Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3):327. 10.1007/s10464-008-9165-0

[2]

Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory

Carl May, Tracy Finch

Sociology 2009 10.1177/0038038509103208

[3]

Developing and evaluating complex interventions: the new Medical Research Council guidance

Peter Craig, Paul Dieppe, Sally Macintyre et al.

BMJ 2008 10.1136/bmj.a1655

[4]

Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations

TRISHA GREENHALGH, Glenn Robert, FRASER MACFARLANE et al.

The Milbank Quarterly 2004 10.1111/j.0887-378x.2004.00325.x

[5]

Linton JD. Implementation research: state of the art and future directions. Technovation. 2002;22(2):65–79. 10.1016/s0166-4972(01)00075-x

[6]

Lau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, Everitt H, Kennedy A, Qureshi N, Rogers A, et al. Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews. Implement Sci. 2016;11(1):1–39.

[7]

Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1):50. 10.1186/1748-5908-7-50

[8]

Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda

Enola Proctor, Hiie Silmere, Ramesh Raghavan et al.

Administration and Policy in Mental Health and Men... 2011 10.1007/s10488-010-0319-7

[9]

Rabin BA, Purcell P, Naveed S, Moser RP, Henton MD, Proctor EK, Brownson RC, Glasgow RE. Advancing the application, quality and harmonization of implementation science measures. Implement Sci. 2012;7(1):119. 10.1186/1748-5908-7-119

[10]

Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Implement Sci. 2014;9(1):7. 10.1186/1748-5908-9-7

[11]

Weiner B. A theory of organizational readiness for change. Implement Sci. 2009;4:67. 10.1186/1748-5908-4-67

[12]

Weiner BJ, Amick H, Lee S-YD. Review: conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436. 10.1177/1077558708317802

[13]

Weiner BJ, Belden CM, Bergmire DM, Johnston M. The meaning and measurement of implementation climate. Implement Sci. 2011;6(1):78. 10.1186/1748-5908-6-78

[14]

Gagnon M-P, Attieh R, Ghandour EK, Légaré F, Ouimet M, Estabrooks CA, Grimshaw J. A systematic review of instruments to assess organizational readiness for knowledge translation in health care. PLoS One. 2014;9(12):e114338. 10.1371/journal.pone.0114338

[15]

Cook JM, Dinnen S, Thompson R, Ruzek J, Coyne JC, Schnurr PP. A quantitative test of an implementation framework in 38 VA residential PTSD programs. Adm Policy Ment Health Ment Health Serv Res. 2015;42(4):462–73. 10.1007/s10488-014-0590-0

[16]

Cook JM, O’Donnell C, Dinnen S, Coyne JC, Ruzek JI, Schnurr PP. Measurement of a model of implementation for health care: toward a testable theory. Implement Sci. 2012;7(1):59. 10.1186/1748-5908-7-59

[17]

Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science

Laura J Damschroder, David C Aron, Rosalind E Keith et al.

Implementation Science 2009 10.1186/1748-5908-4-50

[18]

Liang S, Kegler M, Carvalho M, Fernandez M, Weiner B, Jacobs S, Williams R, Risendal B, Coombs L, Friedman D, et al. Measuring constructs from the consolidated framework for implementation research in the context of increasing colorectal cancer screening at community health centers. Implement Sci. 2015;10(1):A10. 10.1186/1748-5908-10-s1-a10

[19]

Hodge LM, Turner KMT, Sanders MR, Filus A. Sustained implementation support scale: validation of a measure of program characteristics and workplace functioning for sustained program implementation. J Behav Health Serv Res. 2016;44(3):1–23. 10.1007/s11414-016-9505-z

[20]

Jacobs SR, Weiner BJ, Bunger AC. Context matters: measuring implementation climate among individuals and groups. Implement Sci. 2014;9(1):46. 10.1186/1748-5908-9-46

[21]

Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implement Sci. 2014;9(1):118. 10.1186/s13012-014-0118-8

[22]

Lewis CC, Fischer S, Weiner BJ, Stanick C, Kim M, Martinez RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implement Sci. 2015;10(1):155. 10.1186/s13012-015-0342-x

[23]

May C, Mair FS, Finch T, MacFarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4:29. 10.1186/1748-5908-4-29

[24]

May C, Finch T, Ballini L, MacFarlane A, Mair F, Murray E, Treweek S, Rapley T. Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit. BMC Health Serv Res. 2011;11(1):245. 10.1186/1472-6963-11-245

[25]

Rapley T, Finch TL et al. Improving the normalization of complex interventions: part 1 - development of the NoMAD survey tool for assessing implementation work based on normalization process theory (NPT) Pending resubmission to BMC Medical Research Methodology in October 2018 2018. https://doi.org/10.1186/s12874-018-0590-y . 10.1186/s12874-018-0590-y

[26]

Nunnally JC. Pyschometric Theory. 2nd ed. New York: McGraw-Hill; 1978.

[27]

Edwards PJ, Roberts I, Clarke MJ, DiGuiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. ochrane Database Syst Rev. 2009;(3). Art. No.: MR000008. https://doi.org/10.1002/14651858.MR000008.pub4 . 10.1002/14651858.mr000008.pub4

[28]

Unidimensional Versus Domain Representative Parceling of Questionnaire Items: An Empirical Example

Joseph M. Kishton, Keith F. Widaman

Educational and Psychological Measurement 1994 10.1177/0013164494054003022

[29]

To Parcel or Not to Parcel: Exploring the Question, Weighing the Merits

Todd D. Little, William A. Cunningham, Golan Shahar et al.

Structural Equation Modeling: A Multidisciplinary... 2002 10.1207/s15328007sem0902_1

[30]

Williams LJ, Holahan P. Parsimony based fit indices for multiple indicator models: do they work? Struct Equ Model Multidiscip J. 1994;2:161–89. 10.1080/10705519409539970

[31]

Bagozzi RP, Heatherton TF. A general approach to representing multifaceted personality constructs: application to state self-esteem. Struct Equ Model. 1994;1:35–67. 10.1080/10705519409539961

[32]

Landis RS, Beal BJ, Tesluk PE. A comparison of approaches to forming composite measures in structural equation models. Organ Res Methods. 2000;3:186–207. 10.1177/109442810032003

[33]

Significance tests and goodness of fit in the analysis of covariance structures.

P. M. BENTLER, Douglas G. Bonett

Psychological Bulletin 1980 10.1037/0033-2909.88.3.588

[34]

Steiger JH. Understanding the limitations of global fit assessment in structural equation modeling. Personal Individ Differ. 2007;42:893–8. 10.1016/j.paid.2006.09.017

[35]

Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives

Li‐tze Hu, Peter M. Bentler

Structural Equation Modeling: A Multidisciplinary... 1999 10.1080/10705519909540118

[36]

Jamieson S. Likert scales: how to (ab)use them. Med Educ, 2004;38(12):1217–18. 10.1111/j.1365-2929.2004.02012.x

[37]

Wirth RJ, Edwards MC. Item factor analysis: Current approaches and future directions. Psychol Methods. 2007;12(1):58–79. 10.1037/1082-989x.12.1.58

[38]

Rabin BA, Purcell P, Naveed S, Moser RP, Henton MD, Proctor EK. Advancing the application, quality and harmonization of implementation science measures. Implement Sci. 2012;7:119. 10.1186/1748-5908-7-119

[39]

Clinton-McHarg T, Yoong SL, Tzelepis F, Regan T, Fielding A, Skelton E, Kingsland M, Ooi JY, Wolfenden L. Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the consolidated framework for implementation research: a systematic review. Implement Sci. 2016;11(1):148. 10.1186/s13012-016-0512-5

[40]

Squires JE, Estabrooks CA, O'Rourke HM, Gustavsson P, Newburn-Cook CV, Wallin L. A systematic review of the psychometric properties of self-report research utilization measures used in healthcare. Implement Sci. 2011;6(1):83. 10.1186/1748-5908-6-83

[41]

Finch T, Rapley T, Girling M, Mair F, Murray E, Treweek S, McColl E, Steen I, May C. Improving the normalization of complex interventions: measure development based on normalization process theory (NoMAD): study protocol. Implement Sci. 2013;8(1):43. 10.1186/1748-5908-8-43

[42]

McEvoy R, Ballini L, Maltoni S, O'Donnell C, Mair F, MacFarlane A. A qualitative systematic review of studies using the normalization process theory to research implementation processes. Implement Sci. 2014;9(1):2. 10.1186/1748-5908-9-2

[43]

Glasgow RE, Riley WT. Pragmatic measures: what they are and why we need them. Am J Prev Med. 2013;45(2):237–43. 10.1016/j.amepre.2013.03.010

[44]

Huijg JM, Gebhardt WA, Crone MR, Dusseldorp E, Presseau J. Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research. Implement Sci. 2014;9:11. 10.1186/1748-5908-9-11

[45]

Huijg JM, Gebhardt WA, Dusseldorp E, Verheijden MW, van der Zouwe N, Middelkoop BJC, Crone MR. Measuring determinants of implementation behavior: psychometric properties of a questionnaire based on the theoretical domains framework. Implement Sci. 2014;9(1):33. 10.1186/1748-5908-9-33

[46]

Dyson J, Lawton R, Jackson C, Cheater F. Development of a theory-based instrument to identify barriers and levers to best hand hygiene practice among healthcare practitioners. Implement Sci. 2013;8(1):111. 10.1186/1748-5908-8-111

[47]

Stamatakis KA, McQueen A, Filler C, Boland E, Dreisinger M, Brownson RC, Luke DA. Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings. Implement Sci. 2012;7(1):65. 10.1186/1748-5908-7-65

[48]

Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9(1):45. 10.1186/1748-5908-9-45

[49]

Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda

Enola Proctor, Hiie Silmere, Ramesh Raghavan et al.

Administration and Policy in Mental Health and Men... 2011 10.1007/s10488-010-0319-7

Cited By

226

Implementing the Action Falls Program Into Care Homes in England (the FinCH Imp Study)

Fran Allen, Pip Logan · 2025

Journal of the American Medical Dir...

Community and hospital-based healthcare professionals perceptions of digital advance care planning for palliative and end-of-life care: a latent class analysis

Jacqueline Birtwistle, Gabriella Williamson · 2025

Health and Social Care Delivery Res...

A personalized mHealth intervention for the universal prevention of perinatal mental disorders in routine maternal care (e-Perinatal): A protocol study for a hybrid feasibility pilot trial

Francisco J. Nieto-Casado, Irene Gómez-Gómez · 2025

Open Research Europe

Implementation of a psychological online intervention for low to moderate depression in primary care: study protocol

Rosa Lorente-Català, Margalida Gili · 2022

Internet Interventions

Programme theory and realist evaluation of the ‘Smoke-Free Vocational Schools’ research and intervention project: a study protocol

Anneke Vang Hjort, Tenna Børsting Christiansen · 2021

BMJ Open

Improving tracheostomy care in the United Kingdom: results of a guided quality improvement programme in 20 diverse hospitals

Brendan A. McGrath, Sarah Wallace · 2020

British Journal of Anaesthesia

The Swedish version of the Normalization Process Theory Measure S-NoMAD: translation, adaptation, and pilot testing

Marie Elf, Sofi Nordmark · 2018

Implementation Science

Metrics

226

Citations

49

References

Details

Published: Nov 15, 2018
Vol/Issue: 18(1)
License: View

Authors

University of Northumbria at Newcastle

Aberdeen Centre for Evaluation, University of Aberdeen, Aberdeen, UK

Christopher R. Vernazza

Funding

Economic and Social Research Council Award: RES-062-23-3274

Cite This Article

Tracy L. Finch, Melissa Girling, Carl R. May, et al. (2018). Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Medical Research Methodology, 18(1). https://doi.org/10.1186/s12874-018-0591-x

Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)

You May Also Like