Javascript must be enabled to continue!
GenAI and the Mirage of Personalised Learning for All
View through CrossRef
Generative artificial intelligence (GenAI) is gaining attention in education, particularly for its potential to personalise learning. However, studies have yet to assess its effectiveness and identify its limitations within controlled educational contexts across various disciplines and GenAI models. This study aims to help fill this gap by evaluating ‘SmartTest’, a GenAI chatbot designed by the authors to prompt questions, offer immediate feedback, and stimulate critical thinking through conversational nudges. Over five test cycles, SmartTest was used in a criminal law course at an Australian university. The results revealed SmartTest struggled with complex structured problem-solving exercises. While SmartTest showed some promise in aiding short-answer question learning, it remained limited and prone to inaccuracies. These findings highlight concerns that inflated expectations of GenAI could mislead educators and investors about its capabilities to deliver economically viable and quality personalised learning.
Title: GenAI and the Mirage of Personalised Learning for All
Description:
Generative artificial intelligence (GenAI) is gaining attention in education, particularly for its potential to personalise learning.
However, studies have yet to assess its effectiveness and identify its limitations within controlled educational contexts across various disciplines and GenAI models.
This study aims to help fill this gap by evaluating ‘SmartTest’, a GenAI chatbot designed by the authors to prompt questions, offer immediate feedback, and stimulate critical thinking through conversational nudges.
Over five test cycles, SmartTest was used in a criminal law course at an Australian university.
The results revealed SmartTest struggled with complex structured problem-solving exercises.
While SmartTest showed some promise in aiding short-answer question learning, it remained limited and prone to inaccuracies.
These findings highlight concerns that inflated expectations of GenAI could mislead educators and investors about its capabilities to deliver economically viable and quality personalised learning.
Related Results
Personalized Learning in Higher Education for Health Sciences: A Scoping Review Protocol
Personalized Learning in Higher Education for Health Sciences: A Scoping Review Protocol
Abstract
Background
Personalised learning, an educational approach that tailors teaching and learning to individual needs and preferences, has gained attention in recent y...
What does current GenAI actually mean for student learning?
What does current GenAI actually mean for student learning?
Many genAI (generative Artificial Intelligence) enthusiasts and much of the broader public see genAI as a substantial force for good within education. Unfortunately, some of those ...
PREPARING AI SUPER USERS THROUGH GENERATIVE AI INTEGRATION IN EDUCATION
PREPARING AI SUPER USERS THROUGH GENERATIVE AI INTEGRATION IN EDUCATION
Peningkatan pesat Kecerdasan Buatan Generatif (GenAI) menghadirkan peluang dan tantangan bagi pendidikan tinggi, khususnya dalam mempersiapkan mahasiswa untuk menggunakan perangkat...
Understanding the Ethics of Generative AI: Established and New Ethical Principles
Understanding the Ethics of Generative AI: Established and New Ethical Principles
This scoping review develops a conceptual synthesis of the ethics principles of generative artificial intelligence (GenAI) and large language models (LLMs). In regard to the emergi...
From Simulation to Strategy: Integrating Generative AI and Digital Twins in the Downstream Oil And Gas Sector
From Simulation to Strategy: Integrating Generative AI and Digital Twins in the Downstream Oil And Gas Sector
There is growing pressure on the downstream oil and gas and City Gas Distribution (CGD) sectors to increase efficiency, safety, and sustainability—issues that traditional tools str...
EXPRESS: Generative AI and the Social Fabric of Organizations
EXPRESS: Generative AI and the Social Fabric of Organizations
The rapid rise of Generative Artificial Intelligence (GenAI) tools is provoking intense debate about their potential to boost productivity, stimulate creativity, or disrupt employm...
Scaffolding GenAI Literacy and Fluency at Scale: A Practical Self-Assessment Framework for Personalised Learning
Scaffolding GenAI Literacy and Fluency at Scale: A Practical Self-Assessment Framework for Personalised Learning
As generative AI (genAI) tools become increasingly embedded in higher education and professionalcontexts, there is a growing need for scalable, theoretically grounded instruments t...
Scaffolding GenAI Literacy and Fluency at Scale: A Practical Self-Assessment Framework for Personalised Learning
Scaffolding GenAI Literacy and Fluency at Scale: A Practical Self-Assessment Framework for Personalised Learning
As generative AI (genAI) tools become increasingly embedded in higher education and professional contexts, there is a growing need for scalable, theoretically grounded instruments ...

