Education technology applications are continually being invented, and recent AI innovations have only increased that rate of innovation. While there are widely-accepted approaches to evaluate stable, late-stage products (e.g., Randomized Controlled Trials), there is much less clarity about how to conduct these evaluations at earlier stages of development. Given the potential risks in AI-powered solutions due to potential hallucinations and concerns about fairness, early evaluations are more important than ever.
Five New Tools From The AI LEVI Lab
The Learning Engineering Virtual Institute (LEVI) created an AI Lab to help develop new ChatGPT-based tools. LEVI is supported by the Walton Family Foundation, and through an extensive collaboration with educators, students, and parents, the AI Lab developed five new pilot tools that address critical issues in education.
CMU PLUS: Using Tutoring And AI To Overcome Math Anxiety
PLUS, part of the Learning Engineering Virtual Institute, is currently used in 13 schools in four states, reaching an estimated 2,800 students. Researchers have determined that students who use the platform improve their math skills and may even double their rate of math learning. Read about how one student ALSO overcame his math anxiety by using PLUS.
Unlocking AI’s Potential: How Educators Are Actively Engaging And Experimenting With New Technologies
I’ve had the opportunity to learn from and work with some amazing teachers over my career, first in the Obama White and then at Schmidt Futures. One of the things that almost all of them had was a deep curiosity and a love for life-long learning.
Carnegie Mellon University’s PLUS: Personalized math tutoring at scale
By discussing the measured impact of PLUS, this case study demonstrates that instead of replacing tutors and teachers, generative AI can supplement them to excel at a large scale. Specifically, this piece features Maerah Mahmood, a sophomore at Carnegie Mellon University, as she navigated using PLUS while teaching virtually at a school in California. With the help of PLUS’ human tutoring framework and AI-powered dashboard, Mahmood dramatically increased student engagement and improved their performance in a short period. Mahmood’s experience is a testament to the power of PLUS, and its ability to identify struggling students and help teachers initiate academic interventions and personal connections.
New LLMs for Math Education
The improvement of Large Language Models (LLMs) signifies great opportunities for enhancing AI-assisted math teaching and learning. Wanli and Neil’s teams have worked to accelerate the pre-training, fine-tuning, and evaluation of LLMs for math education. By leveraging the University of Florida’s supercomputer and Microsoft’s DeepSpeed while utilizing ASSISTments’ datasets, the teams came to important findings about LLMs – including how super-sized LLMs such as GPT-3.5 may not always be the best option for specific downstream tasks. Overall, the preliminary results showed an enhancement of multimodal LLM models in accurate scoring and alignment with teacher feedback.
Minimizing And Mitigating Bias With The Fairness Hub
Because artificial intelligence or machine learning models are trained on data from different contexts, they are also susceptible to biases introduced through the selection and processing of datasets. Ensuring that learned models do not introduce or amplify systematic biases against underrepresented or historically marginalized groups is critical. This guide from the Fairness Hub serves as a starting point for more contextualized examinations of bias and fairness by providing (1) a simple metric for measuring bias, (2) an overview of bias mitigation strategies, (3) an overview of bias analysis and mitigation toolkits, and (4) a quick demonstration of how to measure and mitigate bias with the help of a toolkit.
Carnegie Learning’s MATHstream: Merging the hottest trends in tech to engage math students
Born out of Carnegie Mellon University 25 years ago, Carnegie Learning has been on the cusp of cutting-edge educational technology for nearly a quarter-century, fine-tuning products to help students learn mathematics best via years of data analytics and software improvements.