Practical and ethical challenges of large language models in education: A systematic scoping review
Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a range of educational tasks (eg, question generation, feedback provision, and essay grading), there are concerns regarding the practicality and ethicality of these innovations. Such concerns may hinder future research and the adoption of LLMs‐based innovations in authentic educational contexts. To address this, we conducted a systematic scoping review of 118 peer‐reviewed papers published since 2017 to pinpoint the current state of research on using LLMs to automate and support educational tasks. The findings revealed 53 use cases for LLMs in automating education tasks, categorised into nine main categories: profiling/labelling, detection, grading, teaching support, prediction, knowledge representation, feedback, content generation, and recommendation. Additionally, we also identified several practical and ethical challenges, including low technological readiness, lack of replicability and transparency and insufficient privacy and beneficence considerations. The findings were summarised into three recommendations for future studies, including updating existing innovations with state‐of‐the‐art models (eg, GPT‐3/4), embracing the initiative of open‐sourcing models/systems, and adopting a human‐centred approach throughout the developmental process. As the intersection of AI and education is continuously evolving, the findings of this study can serve as an essential reference point for researchers, allowing them to leverage the strengths, learn from the limitations, and uncover potential research opportunities enabled by ChatGPT and other generative AI models.
Practitioner notes
What is currently known about this topic
Generating and analysing text‐based content are time‐consuming and laborious tasks.
Large language models are capable of efficiently analysing an unprecedented amount of textual content and completing complex natural language processing and generation tasks.
Large language models have been increasingly used to develop educational technologies that aim to automate the generation and analysis of textual content, such as automated question generation and essay scoring.
What this paper adds
A comprehensive list of different educational tasks that could potentially benefit from LLMs‐based innovations through automation.
A structured assessment of the practicality and ethicality of existing LLMs‐based innovations from seven important aspects using established frameworks.
Three recommendations that could potentially support future studies to develop LLMs‐based innovations that are practical and ethical to implement in authentic educational contexts.
Implications for practice and/or policy
Updating existing innovations with state‐of‐the‐art models may further reduce the amount of manual effort required for adapting existing models to different educational tasks.
The reporting standards of empirical research that aims to develop educational technologies using large language models need to be improved.
Adopting a human‐centred approach throughout the developmental process could contribute to resolving the practical and ethical challenges of large language models in education.
No keywords indexed for this article. Browse by subject →
Enkelejda Kasneci, Kathrin Sessler, Stefan Küchemann et al.
Showing 50 of 89 references
Bao Vu Huynh Phan, Hao Anh Tong · 2026
K. James Hartshorn, Austin Pack · 2026
Sunyu Tao, Hongfeng Zhang · 2026
Marco Angrisani, Maria Casanova · 2026
Shubham Vatsal, Harsh Dubey · 2026
Pingrong Lin, Qin Deng · 2026
Akanksha Shukla, Dr. Rohit Kumar · 2025
Mubashar Raza, Zarmina Jahangir · 2025
Yueqiao Jin, Lixiang Yan · 2025
Ruiqi Deng, Maoli Jiang · 2025
Wuzhida Bao, Yuting Cao · 2025
Shreyas Chaudhari, Pranjal Aggarwal · 2025
Yunjo An, Ji Hyun Yu · 2025
Tanya Nazaretsky, Paola Mejia-Domenzain · 2025
Rosemary Fisher, Taylor Gogan · 2025
Lixiang Yan, Roberto Martinez-Maldonado · 2025
Philseok Lee, Zihao Jia · 2025
Dimitrios Christos Kavargyris, Konstantinos Georgiou · 2025
Tehseen Mazhar, Sunawar khan · 2025
Davy Tsz Kit Ng, Eagle Kai Chi Chan · 2025
- Published
- Aug 06, 2023
- Vol/Issue
- 55(1)
- Pages
- 90-112
- License
- View
You May Also Like
Andrina Granić, Nikola Marangunić · 2019
794 citations
Sylvester Arnab, Theodore Lim · 2014
612 citations
Rong Wu, Zhiyin Yu · 2023
398 citations
Abelardo Pardo, George Siemens · 2014
362 citations