journal article Open Access Jun 25, 2015

Supporting quality public and patient engagement in health system organizations: development and usability testing of the P ublic and P atient E ngagement E valuation T ool

Health Expectations Vol. 19 No. 4 pp. 817-827 · Wiley
View at Publisher Save 10.1111/hex.12378
Abstract
Abstract

Objectives

Only rudimentary tools exist to support health system organizations to evaluate their public and patient engagement (
PPE
) activities. This study responds to this gap by developing a generic evaluation tool for use in a wide range of organizations.



Methods

The evaluation tool was developed through an iterative, collaborative process informed by a review of published and grey literature and with the input of
C
anadian
PPE
researchers and practitioners. Over a 3‐year period, structured e‐mail, telephone and face‐to‐face exchanges, including a modified Delphi process, were used to produce an evaluation tool that includes core principles of high‐quality engagement, expected outcomes for each principle and three unique evaluation questionnaires that were tested and revised with input from 65 end users.



Results

The tool is structured around four core principles of ‘quality engagement’: (i) integrity of design and process; (ii) influence and impact; (iii) participatory culture; and (iv) collaboration and common purpose. Three unique questionnaires were developed to assess each of these four evaluation domains from the following perspectives: (i) those who participate in
PPE
activities; (ii) those who plan, execute or sponsor
PPE
activities within organizations; and (iii) those who provide the leadership and capacity for
PPE
within their organizations.



Conclusions

This is the first known collaboration of researchers and practitioners in the co‐design of a comprehensive
PPE
evaluation tool aimed at three distinct respondent groups and for use in a wide range of health system organization settings.
Topics

No keywords indexed for this article. Browse by subject →

References
34
[1]
A Typology of Public Engagement Mechanisms

Gene Rowe, Lynn J. Frewer

Science, Technology, & Human Values 10.1177/0162243904271724
[3]
Christiaens W (2012)
[7]
[13]
PopayJ CollinsM (editors) with the PiiAF Study Group.The Public Involvement Impact Assessment Framework Guidance. Universities of Lancaster Liverpool and Exeter 2014. Available at:http://piiaf.org.uk/documents/piiaf-guidance-jan14.pdf accessed 10 April 2015.
[17]
AbelsonJ GauvinF‐P.Assessing the impacts of public participation: Concepts evidence and policy implications.Research Report P06.Ontario:Canadian Policy Research Networks 2006. Available at:http://www.cprn.org/documents/42669_fr.pdf accessed 21 January 2015.
[18]
MotsiG.Evaluating citizen engagement in policy making. Paper presented at: Canadian Evaluation Society Conference; 2009 June 2; Ottawa Ontario. [Place unknown]: Institute on Governance 2009. Available at:http://iog.ca/wp-content/uploads/2012/12/2009_May_Evaluating_Citizen_Engagement.pdf accessed 21 January 2015.
[20]
HendricksA.Evaluation Framework for Community Engagement Based on the United Nations Brisbane Declaration.Australia:Darzin Sortware 2009. Available at:http://www.darzin.com/wp-content/uploads/2010/09/Brisb-Decl-Evaluation-Framework-19-May-09-_2_pdf accessed 21 January 2015.
[23]
Mass LBP (2009)
[24]
Government of British Columbia.Primary Health Care Charter: A Collaborative Approach.British Columbia:Government of British Columbia 2007. Available at:http://www.health.gov.bc.ca/library/publications/year/2007/phc_charter.pdf accessed 2 February 2015.
[25]
Government of Ontario.Service Ontario e‐Laws: Local Health System Integration Act.Ontario:Government of Ontario 2006. Available at:http://www.e-laws.gov.on.ca/html/statutes/english/elaws_statutes_06l04_e.htm accessed 21 January 2015.
[26]
Government of Quebec (2005)
[27]
Government of Ontario (2011)
[28]
Vancouver Coastal Health (2011)
[29]
Capital Health (2011)
[30]
AbelsonJ MontessantiS LiK GauvinF‐P MartinE.Effective strategies for interactive public engagement in the development of healthcare policies and programs.Ontario:Canadian Health Services Research Foundation 2010. Available at:http://www.cfhi-fcass.ca/Libraries/Commissioned_Research_Reports/Abelson_EN_FINAL.sflb.ashx accessed 21 January 2015.
[31]
Webler T (1995)
[32]
NabatchiT.A Manager's guide to evaluating citizen participation. IBM Centre for the Business Government: Fostering Transparency and Democracy Series 2012[cited 2015 Jan 21]. Available at:http://unpan1.un.org/intradoc/groups/public/documents/UN-DPADM/UNPAN048340.pdf accessed 21 January 2015.
[33]
Capital Health.Involving Patients and Citizens: A Review of Capital Health's Engagement Policy Achievements 2010–2014.2014. Available at:www.cdha.nshealth.ca/system/files/.../engagement-policy-review.pdf? accessed 6 February 2015.
[34]
Vancouver Coastal Health.What do you know about Patient and Public Engagement work at VCH? 2014. Available at:https://www.vch.ca/media/Revised_February_14_National_Engagement_Survey_Result_Summary(1) accessed 6 February 2015.
Metrics
155
Citations
34
References
Details
Published
Jun 25, 2015
Vol/Issue
19(4)
Pages
817-827
License
View
Funding
Canadian Institutes of Health Research Award: MHS‐124759
Alberta Health Services
Capital Health
Cite This Article
Julia Abelson, Kathy Li, Geoff Wilson, et al. (2015). Supporting quality public and patient engagement in health system organizations: development and usability testing of the P ublic and P atient E ngagement E valuation T ool. Health Expectations, 19(4), 817-827. https://doi.org/10.1111/hex.12378