A study to evaluate the effectiveness of Eedi on raising attainment in mathematics at KS3 (Year 7)

Executive Summary

This report evaluates the impact of Eedi, a digital mathematics platform, on raising maths attainment among Key Stage 3 students (Year 7). Eedi is an innovative EdTech platform offering over 60,000 diagnostic maths questions and engaging approximately 15,500 monthly users through its school and tutoring services. Enhanced by AI and video explanations, Eedi helps learners identify and address misconceptions while providing targeted additional support. Premium users also benefit from live, one-on-one tutoring, enabling students to request and receive assistance through the platform’s chat function.

The impact evaluation included 20 schools, with randomisation conducted at the school level. The Eedi programme was implemented in intervention schools from Autumn 2023 to June 2024 to supplement classroom teaching, while control schools did not use the programme. Teachers assigned Eedi activities for completion either during lesson time or as additional homework tasks. The evaluation also incorporated a light-touch implementation and process review, drawing on online teacher surveys and Eedi usage data.

Keywords

large language models, intelligent tutoring systems, safety, system design
Generalization, Natural language processing, CollaborationMultiple Choice Question, Large Language Models, Humanin-the-loop.-