DeepMind, in collaboration with Fab AI and the Sierra Leone Ministry of Education, conducted a randomized controlled trial to assess the impact of Guided Learning in Gemini on math progress. Over eight weeks, the study evaluated how the AI tool affected the learning outcomes of 1,763 junior secondary students across 12 schools in Port Loko District. The results indicated that AI can be a powerful pedagogical partner, supporting teachers rather than replacing them, and enhancing student learning through structured, conceptual interactions.
The trial revealed that students using Guided Learning demonstrated a significant improvement in math scores, with a gain of +0.258 standard deviations compared to a control group. In classrooms where teachers integrated Gemini into about half their lessons, students achieved even higher gains, equivalent to 1.8 to 2.5 years of typical learning progress. Engagement was notably high, with 69% of students meeting or exceeding usage targets, far surpassing the typical 5% engagement rate for educational technology. Students also reported enjoying math more and engaging in learning beyond regular instruction.
Conrad Sackey, Minister of Basic and Senior Secondary Education of Sierra Leone, emphasized the importance of rigorous study in evaluating AI innovations, stating, "We look to be innovative and improve service delivery, but we must also rigorously study the results of our innovations." The study highlights the potential of AI to support teachers and enhance student learning through structured, conceptual interactions. The findings underscore the need for tools that deliver the strongest gains for students who need it most, while also highlighting the challenges of the "achievement gap."
Source: deepmind
