journal article
Oct 01, 2024
Measuring evidence-based practice knowledge, skills, attitudes, and behavior in students of manual therapy education programs: A scoping review of instruments and their measurement properties
Abstract
ABSTRACT
Objective
The purpose of this review was to identify assessment instruments and their measurement properties for assessing evidence-based practice (EBP) knowledge, skills, attitudes, and behavior among students of manual therapy education programs.
Methods
7 electronic databases were systematically searched from inception to May 19, 2023. (MEDLINE, EMBASE, CINAHL, ERIC, EBSCO Discovery, LISA, Google Scholar.) Search terms were subject headings specific to each database (MeSH in MEDLINE) and relevant to evidence-based practice, assessment tools/instruments, and manual therapy healthcare professions. Eligible studies included students of manual therapy education programs (chiropractic, physiotherapy, occupational therapy, osteopathy) and provided evidence supporting instrument measurement properties (reliability, validity). Titles and abstracts were screened by 2 reviewers. Data on each instrument and its properties were extracted and tabulated by 2 reviewers. Instruments were compared using the Classification Rubric for EBP Assessment Tools in Education (CREATE) framework including the 5 steps in the EBP model. Joanna Briggs Institute methodology and Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist were followed.
Results
5 studies were identified, (3 physiotherapy, 2 chiropractic) Two studies used a physiotherapy-focused modification of the Fresno test. One study presented the Knowledge of Research Evidence Competencies instrument. Two studies presented original instruments. Instruments focused on the knowledge domain and did not assess all 5 EBP model steps.
Conclusion
The current literature does not address all 5 steps of the EBP model. The identified instruments have the potential to ensure chiropractic institutions are graduating chiropractors who are highly skilled in evidence-based practice.
Objective
The purpose of this review was to identify assessment instruments and their measurement properties for assessing evidence-based practice (EBP) knowledge, skills, attitudes, and behavior among students of manual therapy education programs.
Methods
7 electronic databases were systematically searched from inception to May 19, 2023. (MEDLINE, EMBASE, CINAHL, ERIC, EBSCO Discovery, LISA, Google Scholar.) Search terms were subject headings specific to each database (MeSH in MEDLINE) and relevant to evidence-based practice, assessment tools/instruments, and manual therapy healthcare professions. Eligible studies included students of manual therapy education programs (chiropractic, physiotherapy, occupational therapy, osteopathy) and provided evidence supporting instrument measurement properties (reliability, validity). Titles and abstracts were screened by 2 reviewers. Data on each instrument and its properties were extracted and tabulated by 2 reviewers. Instruments were compared using the Classification Rubric for EBP Assessment Tools in Education (CREATE) framework including the 5 steps in the EBP model. Joanna Briggs Institute methodology and Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist were followed.
Results
5 studies were identified, (3 physiotherapy, 2 chiropractic) Two studies used a physiotherapy-focused modification of the Fresno test. One study presented the Knowledge of Research Evidence Competencies instrument. Two studies presented original instruments. Instruments focused on the knowledge domain and did not assess all 5 EBP model steps.
Conclusion
The current literature does not address all 5 steps of the EBP model. The identified instruments have the potential to ensure chiropractic institutions are graduating chiropractors who are highly skilled in evidence-based practice.
Topics
No keywords indexed for this article. Browse by subject →
References
74
[1]
Tikkinen
KA,
Guyatt
GH.
Understanding of research results, evidence summaries and their applicability—not critical appraisal—are core skills of medical curriculum. BMJ Evid Based Med. 2021;26(5):231–233. doi:10.1136/bmjebm-2020-111542
[2]
Belita
E,
Squires
JE,
Yost
J,
Ganann
R,
Burnett
T,
Dobbins
M.
Measures of evidence-informed decision-making competence attributes: a psychometric systematic review. BMC Nurs. 2020;19:1–28. doi:10.1186/s12912-020-00436-8m
[3]
Lehane
E,
Leahy-Warren
P,
O’Riordan
C,
et al.
Evidence-based practice education for healthcare professions: an expert view. BMJ Evid Based Med. 2019;24:103–108. doi:10.1136/bmjebm-2018-111019
[4]
Tilson
JK,
Kaplan
SL,
Harris
JL,
et al.
Sicily statement on classification and development of evidence-based practice learning assessment tools. BMC Med Educ. 2011;11(1):1–10. doi:10.1186/1472-6920-11-78
[5]
Council on Chiropractic Education (CCE)
. CCE accreditation standards principles, processes & requirements for accreditation. 2020. Accessed January 25, 2024. https://www.cceusa.org/uploads/1/0/6/5/106500339/2020_cce__accreditation_standards__current_.pdf
[6]
Federation of Canadian Chiropractic (FCC).
Entry-to-practice competency profile for chiropractors in Canada. 2018. Accessed January 25, 2024. https://chirofed.ca/wp-content/uploads/2021/03/entry-to-practice-competency-profile-DCP-Canada-Nov-9.pdf
[7]
Kumaravel
B,
Hearn
JH,
Jahangiri
L,
Pollard
R,
Stocker
CJ,
Nunan
D.
A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education. Syst Rev. 2020;9(1):1–12. doi:10.1186/s13643-020-01311-y
[8]
Albarqouni
L,
Hoffmann
T,
Glasziou
P.
Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):1–8. doi:10.1186/s12909-018-1284-1
[9]
Dawes
M,
Summerskill
W,
Glasziou
P,
et al.
Sicily statement on evidence-based practice. BMC Med Educ. 2005;5:1–7. doi:10.1186/1472-6920-5-1
[10]
Shaneyfelt
T,
Baum
KD,
Bell
D,
et al.
Instruments for evaluating education in evidence-based practice: a systematic review. JAMA. 2006;296(9):1116–1127. doi:10.1001/jama.296.9.1116
[11]
Rengerink
KO,
Zwolsman
SE,
Ubbink
DT,
Mol
BW,
Van Dijk
N,
Vermeulen
H.
Tools to assess evidence-based practice behaviour among healthcare professionals. BMJ Evid Based Med. 2013;18(4):129–138. doi:10.1136/eb-2012-100969
[12]
Leung
K,
Trevena
L,
Waters
D.
Systematic review of instruments for measuring nurses’ knowledge, skills and attitudes for evidence‐based practice
.
J Adv Nurs
. 2014;70(10):2181–2195. doi:10.1111/jan.12454
[13]
Buchanan
H,
Siegfried
N,
Jelsma
J.
Survey instruments for knowledge, skills, attitudes and behaviour related to evidence‐based practice in occupational therapy: a systematic review. Occup Ther Int. 2016;23(2):59–90. doi:10.1002/oti.1398
[14]
Glegg
SM,
Holsti
L.
Measures of knowledge and skills for evidence-based practice: a systematic review. Can J Occup Ther. 2010;77(4):219–232. doi:10.2182/cjot.2010.77.4.4
[15]
Fernández‐Domínguez
JC,
Sesé‐Abad
A,
Morales‐Asencio
JM,
Oliva‐Pascual‐Vaca
A,
Salinas‐Bueno
I,
de Pedro‐Gómez
JE.
Validity and reliability of instruments aimed at measuring evidence‐based practice in physical therapy: a systematic review of the literature. J Eval Clin Pract. 2014;20(6):767–778. doi:10.1111/jep.12180
[16]
Boruff
JT,
Harrison
P.
Assessment of knowledge and skills in information literacy instruction for rehabilitation sciences students: a scoping review. J Med Libr Assoc. 2018;106(1):15. doi:10.5195/jmla.2018.227
[17]
McGowan
J,
Sampson
M,
Salzwedel
DM,
Cogo
E,
Foerster
V,
Lefebvre
C.
PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75:40–46. doi:10.1016/j.jclinepi.2016.01.021
[18]
Aromataris
E,
Munn
Z.
Chapter 1: JBI Systematic Reviews. In: AromatarisE,MunnZ (Editors). JBI Manual for Evidence Synthesis. JBI, 2020. https://synthesismanual.jbi.global.
[19]
Tepe
R,
Tepe
C.
Development and psychometric evaluation of an information literacy self-efficacy survey and an information literacy knowledge test. J Chiropr Educ. 2015;29(1):11–15. doi:10.7899/JCE-14-15
[20]
Armstrong
R,
Hall
BJ,
Doyle
J,
Waters
E.
‘Scoping the scope’ of a Cochrane review. J Public Health. 2011;33(1):147–150. doi:10.1093/pubmed/fdr015
[21]
Tricco
AC,
Lillie
E,
Zarin
W,
et al.
PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169:467–473. doi:10.7326/M18-0850
[22]
Page
MJ,
McKenzie
JE,
Bossuyt
PM,
et al.
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
.
Int J Surg
. 2021;88:105906. doi:10.1016/j.ijsu.2021.105906
[23]
Feinstein
AR,
Cicchetti
DV.
High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543–549. doi:10.1016/0895-4356(90)90158-l
[24]
Tilson
JK.
Validation of the modified Fresno test: assessing physical therapists’ evidence based practice knowledge and skills. BMC Med Educ. 2010;10:1–9. doi:10.1186/1472-6920-10-38
[25]
Lewis
LK,
Williams
MT,
Olds
TS.
Development and psychometric testing of an instrument to evaluate cognitive skills of evidence based practice in student health professionals. BMC Med Educ. 2011;11:1–1. doi:10.1186/1472-6920-11-77
[26]
Leo
MC,
Peterson
D,
Haas
M,
LeFebvre
R,
Bhalerao
S.
Development and psychometric evaluation of an evidence-based practice questionnaire for a chiropractic curriculum. J Manipulative Physiol Ther. 2012;35(9):692–700. doi:10.1016/j.jmpt.2012.10.011
[27]
Miller
AH,
Cummings
N,
Tomlinson
J.
Measurement error and detectable change for the modified Fresno Test in first-year entry-level physical therapy students. J Allied Health. 2013;42(3):169–174.
[28]
Amsterdam Public Health
. COSMIN (Consensus-based standards for the selection of health measurement instruments). Accessed Sept 26 2023. https://www.cosmin.nl
[29]
Terwee
C,
Mokkink
LB,
Knol
DL,
Ostelo
R,
Bouter
LM,
de Vet
HC.
Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21:651–657. doi:10.1007/s11136-011-9960-1
[30]
Roberge-Dao
J,
Maggio
LA,
Zaccagnini
M,
et al.
Quality, methods, and recommendations of systematic reviews on measures of evidence-based practice: an umbrella review
.
JBI Evid Synth
. 2022;20(4):1004–1073. doi:10.11124/JBIES-21-00118
[31]
Long
K,
McEvoy
M,
Lewis
L,
Wiles
L,
Williams
M,
Olds
T.
Entry-level evidence-based practice training in physiotherapy students: does it change knowledge, attitudes, and behaviours? A longitudinal study. Internet J Allied Health Sci Prac. 2011;9(3):1–11.
[32]
Cohen
J.
Statistical Power Analysis for the Behavioral Sciences
. 2nd ed. New Jersey: Lawrence Erlbaum Associates; 1988.
[33]
Atler
K,
Stephens
J.
Pilot use of the Adapted Fresno Test for evaluating evidence-based practice knowledge in occupational therapy students. Am J Occup Ther. 2020;74(4):7404205100p1-9. doi:10.5014/ajot.2020.037861
[34]
Lehane
E,
Agreli
H,
O’Connor
S,
et al.
Building capacity: getting evidence-based practice into healthcare professional curricula. BMJ Evid Based Med. 2021;26(5):246–246. doi:10.1136/bmjebm-2020-111385
[35]
Albarqouni
L,
Hoffmann
T,
Straus
S,
et al.
Core competencies in evidence-based practice for health professionals: consensus statement based on a systematic review and Delphi survey. JAMA Netw Open. 2018;1(2):e180281. doi:10.1001/jamanetworkopen.2018.0281
[36]
Hoffmann
TC,
Montori
VM,
Del Mar
C.
The connection between evidence-based medicine and shared decision making. JAMA. 2014;312(13):1295–1296. doi:10.1001/jama.2014.10186
[37]
Straus
S,
Richardson
W,
Glasziou
P,
Haynes
R.
Evidence-Based Medicine. How to Practice and Teach
EBM. Edinburgh: Churchill Livingstone; 2005.
[38]
Tikkinen
KA,
Guyatt
GH.
Understanding of research results, evidence summaries and their applicability—not critical appraisal—are core skills of medical curriculum. BMJ Evid Based Med. 2021;26(5):231–233. doi:10.1136/bmjebm-2020-111542
[39]
Belita
E,
Squires
JE,
Yost
J,
Ganann
R,
Burnett
T,
Dobbins
M.
Measures of evidence-informed decision-making competence attributes: a psychometric systematic review. BMC Nurs. 2020;19:1–28. doi:10.1186/s12912-020-00436-8m
[40]
Lehane
E,
Leahy-Warren
P,
O’Riordan
C,
et al.
Evidence-based practice education for healthcare professions: an expert view. BMJ Evid Based Med. 2019;24:103–108. doi:10.1136/bmjebm-2018-111019
[41]
Tilson
JK,
Kaplan
SL,
Harris
JL,
et al.
Sicily statement on classification and development of evidence-based practice learning assessment tools. BMC Med Educ. 2011;11(1):1–10. doi:10.1186/1472-6920-11-78
[42]
Council on Chiropractic Education (CCE)
. CCE accreditation standards principles, processes & requirements for accreditation. 2020. Accessed January 25, 2024. https://www.cceusa.org/uploads/1/0/6/5/106500339/2020_cce__accreditation_standards__current_.pdf
[43]
Federation of Canadian Chiropractic (FCC).
Entry-to-practice competency profile for chiropractors in Canada. 2018. Accessed January 25, 2024. https://chirofed.ca/wp-content/uploads/2021/03/entry-to-practice-competency-profile-DCP-Canada-Nov-9.pdf
[44]
Kumaravel
B,
Hearn
JH,
Jahangiri
L,
Pollard
R,
Stocker
CJ,
Nunan
D.
A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education. Syst Rev. 2020;9(1):1–12. doi:10.1186/s13643-020-01311-y
[45]
Albarqouni
L,
Hoffmann
T,
Glasziou
P.
Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):1–8. doi:10.1186/s12909-018-1284-1
[46]
Dawes
M,
Summerskill
W,
Glasziou
P,
et al.
Sicily statement on evidence-based practice. BMC Med Educ. 2005;5:1–7. doi:10.1186/1472-6920-5-1
[47]
Shaneyfelt
T,
Baum
KD,
Bell
D,
et al.
Instruments for evaluating education in evidence-based practice: a systematic review. JAMA. 2006;296(9):1116–1127. doi:10.1001/jama.296.9.1116
[48]
Rengerink
KO,
Zwolsman
SE,
Ubbink
DT,
Mol
BW,
Van Dijk
N,
Vermeulen
H.
Tools to assess evidence-based practice behaviour among healthcare professionals. BMJ Evid Based Med. 2013;18(4):129–138. doi:10.1136/eb-2012-100969
[49]
Leung
K,
Trevena
L,
Waters
D.
Systematic review of instruments for measuring nurses’ knowledge, skills and attitudes for evidence‐based practice
.
J Adv Nurs
. 2014;70(10):2181–2195. doi:10.1111/jan.12454
[50]
Buchanan
H,
Siegfried
N,
Jelsma
J.
Survey instruments for knowledge, skills, attitudes and behaviour related to evidence‐based practice in occupational therapy: a systematic review. Occup Ther Int. 2016;23(2):59–90. doi:10.1002/oti.1398
Showing 50 of 74 references
Metrics
0
Citations
74
References
Details
- Published
- Oct 01, 2024
- Vol/Issue
- 38(2)
- Pages
- 179-189
Authors
Cite This Article
Lara deGraauw, Jocelyn Cox, Jaclyn Kissel, et al. (2024). Measuring evidence-based practice knowledge, skills, attitudes, and behavior in students of manual therapy education programs: A scoping review of instruments and their measurement properties. Journal of Chiropractic Education, 38(2), 179-189. https://doi.org/10.7899/jce-23-28
Related
You May Also Like
Interprofessional collaboration in research, education, and clinical practice: working together for a better future
Bart N. Green, Claire D. Johnson · 2015
330 citations
Looking back at the lawsuit that transformed the chiropractic profession part 6: Preparing for the lawsuit
Claire D. Johnson, Bart N. Green · 2021
13 citations
How Learning Works: Seven Research-Based Principles for Smart Teaching
Julie G. Nyquist, Rima Jubran · 2012
12 citations