Systematic Review with Meta-Analysis: Understanding Quality Characteristics of EdTech Interventions and Implementation for Disadvantaged Pupils

This report presents the findings of a comprehensive systematic review and meta-analysis commissioned by the Education Endowment Foundation (EEF) to identify how educational technology (EdTech) interventions impact pupil attainment, particularly for disadvantaged learners. The study addresses a critical need for clarity amidst growing EdTech usage and mixed evidence on effectiveness, especially following increased reliance on digital learning during and after the Covid-19 pandemic. The research was conducted in three sequential phases. Phase 1 involved stakeholder engagement with educators and researchers to shape a conceptual framework grounded in practical experience. Phase 2 synthesised global research through systematic review and meta-analysis to assess the impact of EdTech interventions across varied educational contexts. Phase 3 included a structured community review where practitioners validated and refined the findings, ensuring alignment with real-world implementation. Nine high-potential mechanisms were identified as central to effective EdTech use, including aligning technology with pedagogy, creating dynamic feedback loops, supporting adaptive teaching, fostering self-regulation, and ensuring inclusive, accessible design. These mechanisms were synthesised into “building blocks” that underpin effective EdTech models and interventions. Importantly, the review found that while EdTech can benefit all students, disadvantaged pupils may derive disproportionately greater benefit when interventions are well-designed and contextually implemented—though barriers to access and implementation risks remain. This mixed-methods review uniquely integrates quantitative evidence with practitioner insights, offering a practical and nuanced framework for designing, implementing, and evaluating EdTech interventions. The report concludes with actionable guidance for educators, policymakers, and EdTech developers and highlights the need for future research to deepen understanding of contextual factors, mechanisms of change, and sustainable implementation practices. An output of the Open Development & Education, https://opendeved.net/