Assessment and Learning in Knowledge Spaces (ALEKS) Adaptive System Impact on Students’ Perception and Self-Regulated Learning Skills

Hoda Harati; Laura Sujo-Montes; Chih-Hsiung Tu; Shadow Armfield; Cherng-Jyh Yen

doi:10.3390/educsci11100603

journal article Open Access Oct 01, 2021

Assessment and Learning in Knowledge Spaces (ALEKS) Adaptive System Impact on Students’ Perception and Self-Regulated Learning Skills

Hoda Harati Laura Sujo-Montes

Chih-Hsiung Tu Shadow Armfield Cherng-Jyh Yen

Education Sciences Vol. 11 No. 10 pp. 603 · MDPI AG

View at Publisher Save 10.3390/educsci11100603

Abstract

Adaptive learning is an educational method that uses computer algorithms and artificial intelligence (AI) to customize learning materials and activities based on each user’s model. Adaptive learning has been used for more than 20 years. However, it is still unique, and no other system could bring more or even similar capabilities than the ones adaptive technology offers, including the application of AI, psychology, psychometrics, machine learning, and providing a personalized learning environment. However, there are not many studies on its practicality, usefulness, improving students’ learning skills, students’ perception, etc., due to the limited number of institutes investing in this new technology. This paper presents the results of administering the newly developed Adaptive Self-regulated Learning Questionnaire (ASRQ) in an adaptive learning course equipped with the ALEKS (Assessment and Learning in Knowledge Spaces) system to study the amount of Self-regulated Learning Skills (SRL) score change, if any, of the students. The ASRQ was administered at the beginning and end of the semester as a pretest and posttest. Then, the quantitative Sample Paired t Test was run to measure the students’ SRL score change between the beginning and end of the semester. The results showed a significant decline in students’ SRL skills score while working with ALEKS. This paper also discusses the reasons for the considerable drop in SRL skills based on students’ perception and feedback collected through administering an open-ended survey at the end of the semester. The survey’s qualitative analysis showed various possible factors contributing to the decline of the SRL skills score, including lack of motivation, system complexity, hard penalty, lack of social presence, and lack of system practicality.

Topics

No keywords indexed for this article. Browse by subject →

References

51

[1]

Li "Coronavirus disease 2019 (COVID-19): Current status and future perspectives" Int. J. Antimicrob. Agents (2020) 10.1016/j.ijantimicag.2020.105951

[2]

Villegas-Ch, W., Román-Cañizares, M., and Palacios-Pacheco, X. (2020). Improvement of an Online Education Model with the Integration of Machine Learning and Data Analysis in an LMS. Appl. Sci., 10. 10.3390/app10155371

[3]

Educause Horizon Report (2020) (2021, April 05). Teaching and Learning Edition. Available online: https://www.educause.edu/horizon-report-2020.

[4]

Drissi "An adaptive E-learning system based on student’s learning styles: An empirical study" Int. J. Distance Edu. Technol. (2016) 10.4018/ijdet.2016070103

[5]

Villegas-Ch, W., Roman-Cañizares, M., Jaramillo-Alcázar, A., and Palacios-Pacheco, X. (2020). Data Analysis as a Tool for the Application of Adaptive Learning in a University Environment. Appl. Sci., 10. 10.3390/app10207016

[6]

Barnard-Brak, L., Lan, W.Y., and Paton, V.O. (2010). Profiles in Self-Regulated Learning in the Online Learning Environment. Int. Rev. Res. Open Distance Learn., 11, Available online: http://www.irrodl.org/index.php/irrodl/article/view/769/1480. 10.19173/irrodl.v11i1.769

[7]

Quince, R.B. (2013). The Effects of Self-Regulated Learning Strategy Instruction and Structured-Diary Use on Students’ Self-Regulated Learning Conduct and Academic Success in Online Community-College General Education Courses. [Ph.D. Thesis, University of San Francisco]. Available online: https://repository.usfca.edu/cgi/viewcontent.cgi?article=1063&context=diss.

[8]

Heo, H., Joung, S., and Self-Regulated Strategies and Technologies for Adaptive Learning Management Systems for Web-Based Instruction (2021, July 19). Association for Educational Communications and Technology, Available online: https://eric.ed.gov/?id=ED485141.

[9]

Bail "Effects of a self-regulated learning course on the academic performance and graduation rate of college students in an academic support program" J. Coll. Read. Learn. (2008) 10.1080/10790195.2008.10850312

[10]

DuBois "A Self-regulated learning approach to teaching educational psychology" Educ. Psychol. Rev. (2007) 10.1023/a:1024792529797

[11]

Harati "Online adaptive learning: A study of score validity of the adaptive self-regulated learning model" Int. J. Web-Based Learn. Teach. Technol. (2020) 10.4018/ijwltt.2020100102

[12]

Boekaerts, M., Pintrich, P.R., and Zeidner, M. (2000). Attainment of Self-regulated: A social cognitive perspective. Handbook of Self-Regulated, Academic Press. 10.1016/b978-012109890-2/50030-5

[13]

Boekaerts, M., Pintrich, P.R., and Zeidner, M. (2000). The role of goal orientation in self-regulated learning. Handbook of Self-Regulation, Academic Press. 10.1016/b978-012109890-2/50043-3

[14]

A Review of Self-regulated Learning: Six Models and Four Directions for Research

Ernesto Panadero

Frontiers in Psychology 2017 10.3389/fpsyg.2017.00422

[15]

Dabbagh "Personal Learning Environments, social media, and Self-regulated learning: A natural formula for connecting formal and informal learning" Internet High. Educ. (2011) 10.1016/j.iheduc.2011.06.002

[16]

Ghatala "Strategy-monitoring training enables young learners to select effective strategies" Educational Psychol. (1986) 10.1080/00461520.1986.9653023

[17]

Zimmerman "Self-regulated learning and academic achievement" Educational Psychol. (1990) 10.1207/s15326985ep2501_2

[18]

Bandura, A. (1986). Social Foundations of Thought and Action: A Social Cognitive Theory, Prentice-Hall.

[19]

Bandura, A. (1997). Self-Efficacy: The Exercise of Control, Freeman.

[20]

Zimmerman, B.J., and Schunk, D.H. (1989). Models of Self-regulated learning and academic achievement. Self-Regulated Learning and Academic Achievement: Theory, Research, and Practice, Springer. 10.1007/978-1-4612-3618-4

[21]

Ethink (2021, August 07). Three Benefits of Adaptive Learning in Your LMS. Available online: https://ethinkeducation.com/blog/3-benefits-utilizing-adaptive-learning-lms/.

[22]

Brusilovsky, P. (2001, January 23–26). Adaptive educational hypermedia. Proceedings of the Tenth International PEG Conference, Tampere, Finland. Available online: http://www.pitt.edu/~peterb/papers/PEG01.html.

[23]

Moskal, P., Carter, D., and Johnson, D. (2020, July 23). Seven Things You Should Know about Adaptive Learning. Available online: https://library.educause.edu/resources/2017/1/7-things-you-should-know-about-adaptive-learning.

[24]

Brusilovsky, P., Kobsa, A., and Vassileva, J. (1995). Methods and techniques of adaptive hypermedia. Adaptive Hypertext and Hypermedia, Kluwer.

[25]

Project Tomorrow White Paper (2021, June 18). Leveraging Intelligent Adaptive Learning to Personalize Education: A Special White Paper Based upon the 2011 National Findings. Available online: http://www-static.dreambox.com/wp-content/uploads/2012/08/DreamBox-Leveraging-Intelligent-Adaptive-Learning.pdf.

[26]

Murray "Informing and performing: A study comparing adaptive learning to traditional learning" Int.J. Emerg. Trans-Discip. (2015)

[27]

Kuntz, D. (2021, May 18). What Is Adaptive Learning?. 2010., Available online: https://www.knewton.com/resources/blog/adaptive-learning/what-is-adaptive-learning/.

[28]

Park "Adaptive instructional system" Educ. Technol. Res. Dev. (2003)

[29]

Hesterman, D. (2021, May 20). Report on Intensive Mode Delivery in Engineering, Computer Science, and Mathematics. Available online: http://www.ecm.uwa.edu.au/__data/assets/pdf_file/0009/2700846/Hesterman-2015-UWA-ECM-Report-on-intensive-mode-delivery.pdf.

[30]

Yen "A predictive study of students’ self-regulated learning skills and their roles in the social network interaction of online discussion board" J. Educ. Technol. Dev. Exch. (2019)

[31]

(2021, August 07). McGraw Hill. Available online: https://www.mheducation.com/.

[32]

Lane, H.C., Yacef, K., Mostow, J., and Pavlik, P. (2013). Discovering behavior patterns of self-regulated learners in an inquiry-based learning environment. Lecture Notes in Computer Science: Artificial Intelligence in Education, Springer.

[33]

Dabbagh, N., and Bannan-Ritland, B. (2005). Online Learning: Concept, Strategies, and Applications, Pearson Education.

[34]

Inan "A design and development of an online learning support system (OLSS) for preservice teachers: A discussion of attitudes and utilization" J. Interact. Instr. Dev. (2004)

[35]

Latham "The Goal-setting and goal orientation labyrinth" Organ.Dyn. (2016) 10.1016/j.orgdyn.2016.10.001

[36]

Nussbaumer "A Competence-based service for supporting self-regulated learning in virtual environments" J. Learn. Anal. (2015)

[37]

Becoming a Self-Regulated Learner: An Overview

Barry J. Zimmerman

Theory Into Practice 2002 10.1207/s15430421tip4102_2

[38]

Araka, E., Maina, E., Gitonga, R., and Oboko, R. (2019, January 10). A conceptual model for measuring and supporting self-regulated learning using educational data mining on learning management systems. Proceedings of the 2019 IST-Africa Week Conference (IST-Africa), Nairobi, Kenya. 10.23919/istafrica.2019.8764852

[39]

Bergey "Scientific inquiry self-efficacy and computer game self-efficacy as predictors and outcomes of middle school boys’ and girls’ performance in a science assessment in a virtual environment" J. Sci. Educ. Technol. (2015) 10.1007/s10956-015-9558-4

[40]

Anderson, T. (2004). Foundations of educational theory for online learning. The Theory and Practice of Online Learning, Athabasca University Press.

[41]

Hofer "Teaching self-regulated learning through a “Learning to Learn” course" Teac. Psychol. (2003) 10.1207/s15328023top3001_05

[42]

Schunk "Social origins of self-regulatory competence" Educ. Psychol. (1997) 10.1207/s15326985ep3204_1

[43]

Marca "Addressing student motivation, self-regulation, and engagement in a flipped classroom to decrease boredom" Int. J. Inf. Educ. Technol. (2017)

[44]

Huang "Perceived satisfaction, perceived usefulness, and interactivscore. E-learning environments as predictors to self-regulation in e-learning environments" Comput. Educ. (2013) 10.1016/j.compedu.2012.07.015

[45]

Kollar "Supporting self-regulated learners for a while and what computers can contribute" J. Educ. Comput. Res. (2006) 10.2190/rk02-7384-2723-g744

[46]

Bonk "Understanding the self-directed online learning preferences, goals, achievements, and challenges of MIT open courseware subscribers" J. Educ. Technol. Soc. (2015)

[47]

Inan, A.F., Flores, R., and Grant, M.M. (2021, August 07). Perspective on the Design and Evaluation of Adaptive Web-Based Learning Environment. Available online: https://www.cedtech.net/article/perspectives-on-the-design-and-evaluation-of-adaptive-web-based-learning-environments-5971.

[48]

(2021, July 03). ALEKS 2021. Available online: www.aleks.com.

[49]

Albelbisi "Factors influencing learners’ self-regulated learning skills in a massive open online course (MOOC) environment" Turk. Online J. Distance Educ. (2019) 10.17718/tojde.598191

[50]

Winters "Self-regulation of Learning within computer-based learning environments: A critical analysis" Educ. Psychol. Rev. (2008) 10.1007/s10648-008-9080-9

Showing 50 of 51 references

Cited By

49

Digital learning in the 21st century: trends, challenges, and innovations in technology integration

Yumei Zou, Florence Kuek · 2025

Frontiers in Education

Artificial intelligence in adaptive education: a systematic review of techniques for personalized learning

Hariyanto, Francisca Xaveria Diah Kristianingsih · 2025

Discover Education

Metrics

49

Citations

51

References

Details

Published: Oct 01, 2021
Vol/Issue: 11(10)
Pages: 603
License: View

Authors

H

Hoda Harati

Department of Educational Specialties, Northern Arizona University, Flagstaff, AZ 86011, USA

L

Laura Sujo-Montes

Department of Educational Specialties, Northern Arizona University, Flagstaff, AZ 86011, USA

C

Chih-Hsiung Tu

Department of Educational Specialties, Northern Arizona University, Flagstaff, AZ 86011, USA

S

Shadow Armfield

Department of Educational Specialties, Northern Arizona University, Flagstaff, AZ 86011, USA

C

Cherng-Jyh Yen

Department of Educational Foundations and Leadership, Old Dominion University, Norfolk, VA 23529, USA

Cite This Article

Hoda Harati, Laura Sujo-Montes, Chih-Hsiung Tu, et al. (2021). Assessment and Learning in Knowledge Spaces (ALEKS) Adaptive System Impact on Students’ Perception and Self-Regulated Learning Skills. Education Sciences, 11(10), 603. https://doi.org/10.3390/educsci11100603

Assessment and Learning in Knowledge Spaces (ALEKS) Adaptive System Impact on Students’ Perception and Self-Regulated Learning Skills

You May Also Like