A Hybrid Analytic Hierarchy Process and Likert Scale Approach for the Quality Assessment of Medical Education Programs

Alfonso Maria Ponsiglione; Francesco Amato; Santolo Cozzolino; Giuseppe Russo; Maria Romano; Giovanni Improta

doi:10.3390/math10091426

journal article Open Access Apr 24, 2022

A Hybrid Analytic Hierarchy Process and Likert Scale Approach for the Quality Assessment of Medical Education Programs

Alfonso Maria Ponsiglione

Francesco Amato

Santolo Cozzolino Giuseppe Russo

Maria Romano

Giovanni Improta

Mathematics Vol. 10 No. 9 pp. 1426 · MDPI AG

View at Publisher Save 10.3390/math10091426

Abstract

The quality assessment of training courses is of utmost importance in the medical education field to improve the quality of the training. This work proposes a hybrid multicriteria decision-making approach based on two methodologies, a Likert scale (LS) and the analytic hierarchy process (AHP), for the quality assessment of medical education programs. On one hand, the qualitative LS method was adopted to estimate the degree of consensus on specific topics; on the other hand, the quantitative AHP technique was employed to prioritize parameters involved in complex decision-making problems. The approach was validated in a real scenario for evaluating healthcare training activities carried out at the Centre of Biotechnology of the National Hospital A.O.R.N. “A. Cardarelli” of Naples (Italy). The rational combination of the two methodologies proved to be a promising decision-making tool for decision makers to identify those aspects of a medical education program characterized by a lower user satisfaction degree (revealed by the LS) and a higher priority degree (revealed by the AHP), potentially suggesting strategies to increase the quality of the service provided and to reduce the waste of resources. The results show how this hybrid approach can provide decision makers with helpful information to select the most important characteristics of the delivered education program and to possibly improve the weakest ones, thus enhancing the whole quality of the training courses.

Topics

No keywords indexed for this article. Browse by subject →

References

78

[1]

Davis "American College of Chest Physicians Health and Science Policy Committee Continuing Medical Education Effect on Practice Performance: Effectiveness of Continuing Medical Education: American College of Chest Physicians Evidence-Based Educational Guidelines" Chest (2009) 10.1378/chest.08-2517

[2]

Udo "Using Analytic Hierarchy Process to Analyze the Information Technology Outsourcing Decision" Ind. Manag. Data Syst. (2000) 10.1108/02635570010358348

[3]

Saaty "Decision Making with the Analytic Hierarchy Process" Int. J. Serv. Sci. (2008)

[4]

Jarm, T., Cvetkoska, A., Mahnič-Kalamiza, S., and Miklavcic, D. (2021). Evaluation of Medical Training Courses Satisfaction: Qualitative Analysis and Analytic Hierarchy Process. Proceedings of the 8th European Medical and Biological Engineering Conference, Portorož, Slovenia, 29 November–3 December 2020, Springer International Publishing. 10.1007/978-3-030-64610-3

[5]

Analytic hierarchy process: An overview of applications

Omkarprasad S. Vaidya, Sushil Kumar

European Journal of Operational Research 2006 10.1016/j.ejor.2004.04.028

[6]

Agha "Evaluating and Benchmarking Non-Governmental Training Programs: An Analytic Hierarchy Approach" JJMIE (2008)

[7]

Saaty, T.L. (1990). The Analytic Hierarchy Process: Planning, Priority Setting, Resource Allocation, RWS. 10.1108/eb022672

[8]

Franek "Judgment Scales and Consistency Measure in AHP" Procedia Econ. Financ. (2014) 10.1016/s2212-5671(14)00332-3

[9]

Badri "Awards of Excellence in Institutions of Higher Education: An AHP Approach" Int. J. Educ. Manag. (2004)

[10]

Izquierdo "An Approach to AHP Decision in a Dynamic Context" Decis. Support Syst. (2012) 10.1016/j.dss.2012.04.015

[11]

Canco, I., Kruja, D., and Iancu, T. (2021). AHP, a Reliable Method for Quality Decision Making: A Case Study in Business. Sustainability, 13. 10.3390/su132413932

[12]

Viveros "Dynamic Analytic Hierarchy Process: AHP Method Adapted to a Changing Environment" IFAC Proc. Vol. (2012) 10.3182/20121122-2-es-4026.00005

[13]

Wang, C.-N., Kao, J.-C., Wang, Y.-H., Nguyen, V.T., Nguyen, V.T., and Husain, S.T. (2021). A Multicriteria Decision-Making Model for the Selection of Suitable Renewable Energy Sources. Mathematics, 9. 10.3390/math9121318

[14]

Wang "Strategic Renewable Energy Resources Selection for Pakistan: Based on SWOT-Fuzzy AHP Approach" Sustain. Cities Soc. (2020) 10.1016/j.scs.2019.101861

[15]

Heo "Analysis of the Assessment Factors for Renewable Energy Dissemination Program Evaluation Using Fuzzy AHP" Renew. Sustain. Energy Rev. (2010) 10.1016/j.rser.2010.01.020

[16]

Dorado "An AHP Application to Select Software for Engineering Education" Comput. Appl. Eng. Educ. (2014) 10.1002/cae.20546

[17]

Laguna-Sánchez, P., Palomo, J., de la Fuente-Cabrero, C., and de Castro-Pardo, M. (2021). A Multiple Criteria Decision Making Approach to Designing Teaching Plans in Higher Education Institutions. Mathematics, 9. 10.3390/math9010009

[18]

Nosal "Application of AHP Method for Multi-Criteria Evaluation of Variants of the Integration of Urban Public Transport" Transp. Res. Procedia (2014) 10.1016/j.trpro.2014.10.006

[19]

Almeida "Proposal of A Carsharing System to Improve Urban Mobility" Theor. Empir. Res. Urban Manag. (2017)

[20]

Lu, X., Lu, J., Yang, X., and Chen, X. (2022). Assessment of Urban Mobility via a Pressure-State-Response (PSR) Model with the IVIF-AHP and FCE Methods: A Case Study of Beijing, China. Sustainability, 14. 10.3390/su14053112

[21]

Ricciardi "Implementation and Validation of a New Method to Model Voluntary Departures from Emergency Departments" Math. Biosci. Eng. (2021) 10.3934/mbe.2021013

[22]

Ponsiglione "A Six Sigma DMAIC Methodology as a Support Tool for Health Technology Assessment of Two Antibiotics" Math. Biosci. Eng. (2021) 10.3934/mbe.2021174

[23]

Improta, G., Perrone, A., Russo, M.A., and Triassi, M. (2019). Health Technology Assessment (HTA) of Optoelectronic Biosensors for Oncology by Analytic Hierarchy Process (AHP) and Likert Scale. BMC Med. Res. Methodol., 19. 10.1186/s12874-019-0775-z

[24]

Improta "Analytic Hierarchy Process (AHP) in Dynamic Configuration as a Tool for Health Technology Assessment (HTA): The Case of Biosensing Optoelectronics in Oncology" Int. J. Inf. Technol. Decis. Mak. (2019) 10.1142/s0219622019500263

[25]

Improta "Use of the AHP Methodology in System Dynamics: Modelling and Simulation for Health Technology Assessments to Determine the Correct Prosthesis Choice for Hernia Diseases" Math. Biosci. (2018) 10.1016/j.mbs.2018.03.004

[26]

Danner "Integrating Patients’ Views into Health Technology Assessment: Analytic Hierarchy Process (AHP) as a Method to Elicit Patient Preferences" Int. J. Technol. Assess. Health Care (2011) 10.1017/s0266462311000523

[27]

Galli "Deep Learning for HDD Health Assessment: An Application Based on LSTM" IEEE Trans. Comput. (2022) 10.1109/tc.2020.3042053

[28]

Dell-Kuster, S., Sanjuan, E., Todorov, A., Weber, H., Heberer, M., and Rosenthal, R. (2014). Designing Questionnaires: Healthcare Survey to Compare Two Different Response Scales. BMC Med. Res. Methodol., 14. 10.1186/1471-2288-14-96

[29]

Krzych "The Likert Scale Is a Powerful Tool for Quality of Life Assessment among Patients after Minimally Invasive Coronary Surgery" Pol. Pol. J. Cardio-Thorac. Surg. (2018)

[30]

Kalaja "Service Quality Assessment in Health Care Sector: The Case of Durres Public Hospital" Procedia Soc. Behav. Sci. (2016) 10.1016/j.sbspro.2016.11.082

[31]

Melillo, P., Delle Donne, A., Improta, G., Cozzolino, S., and Bracale, M. (2011, January 15–18). Assessment of Patient Satisfaction Using an AHP Model: An Application to a Service of Pharmaceutical Distribution. Proceedings of the International Symposium on the Analytic Hierarchy Process, Sorrento, Italy. 10.13033/isahp.y2011.087

[32]

Wang "On the Extent Analysis Method for Fuzzy AHP and Its Applications" Eur. J. Oper. Res. (2008) 10.1016/j.ejor.2007.01.050

[33]

Chang "Applications of the Extent Analysis Method on Fuzzy AHP" Eur. J. Oper. Res. (1996) 10.1016/0377-2217(95)00300-2

[34]

Liu "A Review of Fuzzy AHP Methods for Decision-Making with Subjective Judgements" Expert Syst. Appl. (2020) 10.1016/j.eswa.2020.113738

[35]

Radovanovic "Application of Hybrid Model Fuzzy AHP—VIKOR in Selection of the Most Efficient Procedure for Rectification of the Optical Sight of the Long-Range Rifle" Decis. Mak. Appl. Manag. Eng. (2020) 10.31181/dmame2003131r

[36]

Osiro "A Comparison between Fuzzy AHP and Fuzzy TOPSIS Methods to Supplier Selection" Appl. Soft Comput. (2014) 10.1016/j.asoc.2014.03.014

[37]

Zavadskas "Integration of Interval Rough AHP and Interval Rough MABAC Methods for Evaluating University Web Pages" Appl. Soft Comput. (2018) 10.1016/j.asoc.2018.02.057

[38]

Taha "A Hybrid Fuzzy AHP-PROMETHEE Decision Support System for Machine Tool Selection in Flexible Manufacturing Cell" J. Intell. Manuf. (2012) 10.1007/s10845-011-0560-2

[39]

Sindhu "Investigation of Feasibility Study of Solar Farms Deployment Using Hybrid AHP-TOPSIS Analysis: Case Study of India" Renew. Sustain. Energy Rev. (2017) 10.1016/j.rser.2017.01.135

[40]

Kusumawardani "Application of fuzzy AHP-TOPSIS method for decision making in human resource manager selection process" Procedia Comput. Sci. (2015) 10.1016/j.procs.2015.12.173

[41]

Comparison of Multi-Criteria Decision Support Methods (AHP, TOPSIS, SAW & PROMENTHEE) for Employee Placement

M M D Widianta, T Rizaldi, D P S Setyohadi et al.

Journal of Physics: Conference Series 2018 10.1088/1742-6596/953/1/012116

[42]

Likert Scale: Explored and Explained

Ankur Joshi, Saket Kale, Satish Chandel et al.

British Journal of Applied Science & Technolog... 2015 10.9734/bjast/2015/14975

[43]

Analyzing and Interpreting Data From Likert-Type Scales

Gail M. Sullivan, Anthony R. Artino

Journal of Graduate Medical Education 2013 10.4300/jgme-5-4-18

[44]

Kersnik "An Evaluation of Patient Satisfaction with Family Practice Care in Slovenia" Int. J. Qual. Health Care. (2000) 10.1093/intqhc/12.2.143

[45]

Mcleod, S. (2022, January 31). Likert Scale Definition, Examples and Analysis. Simply Psychology. Available online: www.simplypsychology.org/likert-scale.html.

[46]

Saaty "Basic Theory of the Analytic Hierarchy Process: How to Make a Decision" Rev. Real Acad. Cienc. Exactas Fis. Nat. (1999)

[47]

Gronroos "Service Quality: The Six Criteria of Good Perceived Service" Rev. Bus. (1988)

[48]

A Conceptual Model of Service Quality and Its Implications for Future Research

A. Parasuraman, Valarie A. Zeithaml, Leonard L. Berry

Journal of Marketing 2018 10.1177/002224298504900403

[49]

Decision making — the Analytic Hierarchy and Network Processes (AHP/ANP)

Thomas L. Saaty

Journal of Systems Science and Systems Engineering 2004 10.1007/s11518-006-0151-5

[50]

Saaty "Decision-Making with the AHP: Why Is the Principal Eigenvector Necessary" Eur. J. Oper. Res. (2003) 10.1016/s0377-2217(02)00227-8

Showing 50 of 78 references

Metrics

66

Citations

78

References

Details

Published: Apr 24, 2022
Vol/Issue: 10(9)
Pages: 1426
License: View

Authors

A

Alfonso Maria Ponsiglione

Department of Electrical Engineering and Information Technology, University of Naples “Federico II”, 80125 Naples, Italy

F

Francesco Amato

Department of Electrical Engineering and Information Technology, University of Naples “Federico II”, 80125 Naples, Italy; Interdepartmental Center for Research in Healthcare Management and Innovation in Healthcare (CIRMIS), University of Naples “Federico II”, 80125 Naples, Italy

S

Santolo Cozzolino

U.O.C. Formazione, Ricerca e Cooperazione Internazionale, National Hospital A.O.R.N. “A. Cardarelli”, 80131 Naples, Italy

G

Giuseppe Russo

National Hospital A.O.R.N. “A. Cardarelli”, 80131 Naples, Italy

M

Maria Romano

Department of Electrical Engineering and Information Technology, University of Naples “Federico II”, 80125 Naples, Italy

G

Giovanni Improta

Interdepartmental Center for Research in Healthcare Management and Innovation in Healthcare (CIRMIS), University of Naples “Federico II”, 80125 Naples, Italy; Department of Public Health, School of Medicine and Surgery, University of Naples “Federico II”, 80125 Naples, Italy

Cite This Article

Alfonso Maria Ponsiglione, Francesco Amato, Santolo Cozzolino, et al. (2022). A Hybrid Analytic Hierarchy Process and Likert Scale Approach for the Quality Assessment of Medical Education Programs. Mathematics, 10(9), 1426. https://doi.org/10.3390/math10091426

A Hybrid Analytic Hierarchy Process and Likert Scale Approach for the Quality Assessment of Medical Education Programs

You May Also Like