journal article Open Access Apr 17, 2024

How should artificial intelligence be used in Australian health care? Recommendations from a citizens’ jury

Medical Journal of Australia Vol. 220 No. 8 pp. 409-416 · AMPCo
View at Publisher Save 10.5694/mja2.52283
Abstract
AbstractObjectiveTo support a diverse sample of Australians to make recommendations about the use of artificial intelligence (AI) technology in health care.Study designCitizens’ jury, deliberating the question: “Under which circumstances, if any, should artificial intelligence be used in Australian health systems to detect or diagnose disease?”Setting, participantsThirty Australian adults recruited by Sortition Foundation using random invitation and stratified selection to reflect population proportions by gender, age, ancestry, highest level of education, and residential location (state/territory; urban, regional, rural). The jury process took 18 days (16 March – 2 April 2023): fifteen days online and three days face‐to‐face in Sydney, where the jurors, both in small groups and together, were informed about and discussed the question, and developed recommendations with reasons. Jurors received extensive information: a printed handbook, online documents, and recorded presentations by four expert speakers. Jurors asked questions and received answers from the experts during the online period of the process, and during the first day of the face‐to‐face meeting.Main outcome measuresJury recommendations, with reasons.ResultsThe jurors recommended an overarching, independently governed charter and framework for health care AI. The other nine recommendation categories concerned balancing benefits and harms; fairness and bias; patients’ rights and choices; clinical governance and training; technical governance and standards; data governance and use; open source software; AI evaluation and assessment; and education and communication.ConclusionsThe deliberative process supported a nationally representative sample of citizens to construct recommendations about how AI in health care should be developed, used, and governed. Recommendations derived using such methods could guide clinicians, policy makers, AI researchers and developers, and health service users to develop approaches that ensure trustworthy and responsible use of this technology.
Topics

No keywords indexed for this article. Browse by subject →

References
24
[1]
Australian Department of Industry Science and Resources.Supporting responsible AI: discussion paper. Government's interim response. 17 Jan 2024.https://consult.industry.gov.au/supporting‐responsible‐ai(viewed Mar 2024).
[3]
Wadie J. "A roadmap for artificial intelligence in healthcare for Australia news" Australian Alliance for Artificial Intelligence in Healthcare (2021)
[6]
MoodieC.Australian Medical Association calls for national regulations around AI in health care.ABC News(Australia) 28 May2023.https://www.abc.net.au/news/2023‐05‐28/ama‐calls‐for‐national‐regulations‐for‐ai‐in‐health/102381314(viewed Oct 2023).
[10]
Australian Centre for Health Engagement Evidence and Values.Artificial intelligence in health: community jury. Undated.https://uow.info/TAWSYN_JURY(viewed Oct 2023).
[11]
White K (2022)
[12]
Brown J (2005)
[15]
Australian Bureau of Statistics.Snapshot of Australia 2021. 28 June 2022.https://www.abs.gov.au/statistics/people/people‐and‐communities/snapshot‐australia/2021(viewed Oct 2023).
[16]
Australian Bureau of Statistics.Education and training: census 2021. 28 June 2022.https://www.abs.gov.au/statistics/people/education/education‐and‐training‐census/latest‐release(viewed Oct 2023).
[17]
Australian Bureau of Statistics.National state and territory population December 2023. 28 June 2022.https://www.abs.gov.au/statistics/people/population/national‐state‐and‐territory‐population/dec‐2021(viewed Oct 2023).
[18]
Australian Institute of Health and Welfare.Profile of Australia's population. 6 June 2023.https://www.aihw.gov.au/reports/australias‐health/profile‐of‐australias‐population(viewed Oct 2023).
[20]
Forum for Ethical AI.Democratising decisions about technology: a toolkit. 24 Oct 2019.https://www.thersa.org/reports/democratising‐decisions‐technology‐toolkit(viewed Oct 2023).
[21]
Ada Lovelace Institute.The Citizens’ Biometrics Council London: report with recommendations and findings of a public deliberation on biometrics technology policy and governance. 30 Mar 2021.https://www.adalovelaceinstitute.org/report/citizens‐biometrics‐council(viewed Oct 2023).
[22]
European Commission.Proposal for a regulation of the European parliament and the council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain union legislative acts (COM/2021/206 final). 21 Apr 2021.https://eur‐lex.europa.eu/legal‐content/EN/TXT/?uri=CELEX:52021PC0206(viewed Oct 2023).
[23]
Therapeutic Goods Administration.Regulation of software based medical devices. 28 Sept 2023.https://www.tga.gov.au/how‐we‐regulate/manufacturing/medical‐devices/manufacturer‐guidance‐specific‐types‐medical‐devices/regulation‐software‐based‐medical‐devices(viewed Oct 2023).
Metrics
19
Citations
24
References
Details
Published
Apr 17, 2024
Vol/Issue
220(8)
Pages
409-416
License
View
Funding
National Health and Medical Research Council Award: NHMRC 1181960
Cite This Article
Stacy M Carter, Yves Saint James Aquino, Lucy Carolan, et al. (2024). How should artificial intelligence be used in Australian health care? Recommendations from a citizens’ jury. Medical Journal of Australia, 220(8), 409-416. https://doi.org/10.5694/mja2.52283