AI tutoring can safely and effectively support students: An exploratory RCT in UK classrooms LearnLM Team, Google & Eedi One-to-one tutoring is widely considered the gold standard for personalized education, yet it remainsprohibitively expensive to scale. To evaluate whether generative AI might help expand access to thisresource, we conducted an exploratory randomized controlled trial (RCT) […]
A Study to Evaluate the Effectiveness of Eedi on Raising Attainment in Mathematics at KS3 (Year 7)
A study to evaluate the effectiveness of Eedi on raising attainment in mathematics at KS3 (Year 7) Executive Summary This report evaluates the impact of Eedi, a digital mathematics platform, on raising maths attainment among Key Stage 3 students (Year 7). Eedi is an innovative EdTech platform offering over 60,000 diagnostic maths questions and engaging […]
Designing Safe and Relevant Generative Chats for Math Learning in Intelligent Tutoring Systems
Designing Safe and Relevant Generative Chats for Math Learning in Intelligent Tutoring Systems Abstract Large language models (LLMs) are flexible, personalizable, and available, which makes their use within Intelligent Tutoring Systems (ITSs) appealing. However, their flexibility creates risks: inaccuracies, harmful content, and non-curricular material. Ethically deploying LLM-backed ITSs requires designing safeguards that ensure positive experiences […]
Improving Hybrid Human-AI Tutoring by Differentiating the Human Tutor’s Role Based on Student Need
Improving Hybrid Human-AI Tutoring by Differentiating the Human Tutor’s Role Based on Student Need Hybrid human-AI tutoring research highlights the promise of scaling personalized learning by combining adaptive AI tutor support with personalized instructional and motivational guidance from human tutors. However, emerging evidence suggests that human-AI tutoring is more beneficial for lower-performing students than higher-performing […]
Improving the Validity of Automatically Generated Feedback via Reinforcement Learning
Improving the Validity of Automatically Generated Feedback via Reinforcement Learning Abstract Automatically generating feedback via large language models (LLMs) in intelligent tutoring systems and online learning platformshas the potential to improve the learning outcomes of many students.However, both feedback generation and evaluation are challenging: feedback content has to be valid especially in subjects like math, […]
Development of a Generative AI-powered Teachable Agent for Middle School Mathematics Learning: A Design-based Research Study
Development of a Generative AI-powered Teachable Agent for Middle School Mathematics Learning: A Design-based Research Study Abstract This paper reports on a design-based research (DBR) study that aims to devise an artificial intelligence (AI)-powered teachable agent that supports secondary school students’ learning- by-teaching practices of mathematics learning content. A long-standing pedagogical practice of learning-by-teaching is […]
Students’ Perceived Roles, Opportunities, and Challenges of a Generative AI-Powered Teachable Agent: A Case of Middle School Math Class
Students’ Perceived Roles, Opportunities, and Challenges of a Generative AI-powered Teachable Agent: A Case of Middle School Math Class Abstract Ongoing advancements in Generative AI (GenAI) have boosted the potential of applying long-standing “learning-by-teaching” practices in the form of a teachable agent (TA). Despite the recognized roles and opportunities of TAs, less is known about […]
Effective and Scalable Math Support: Experimental Evidence on the Impact of an AI- Math Tutor in Ghana
Effective and Scalable Math Support: Experimental Evidence on the Impact of an AI- Math Tutor in Ghana Abstract This study is a preliminary evaluation of the impact of receiving extra math instruction provided by Rori, an AI-powered math tutor accessible via WhatsApp, on the math performance of approximately 500 students in Ghana. Students assigned to […]
Math Multiple Choice Question Generation via Human-Large Language Model Collaboration
Math Multiple Choice Question Generation via Human-Large Language Model Collaboration Abstract Multiple choice questions (MCQs) are a popular method for evaluating students’ knowledge due to their efficiency in administration and grading. Crafting high-quality math MCQs is a labor-intensive process that requires educators to formulate precise stems and plausible distractors. Recent advances in large language models […]
The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities
The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities Abstract Incorporating human tutoring with AI holds promise for supporting diverse math learners. In the U.S., approximately 15% of students receive special education services, with limited previous research within AIED on the impact of AI-assisted learning among students with disabilities. Previous work […]