Tag: Meta-analysis

Categories
Educational Administration and Leadership Effective Teaching Approach K-12 Education

What kind of gamified learning is working: evidence from 37 studies

Gamification (adding game-like elements to lessons) can boost student engagement and learning. Studies show it works best when activities have clear rules, challenges that get harder over time, and fun surprises to spark curiosity. Research suggests that well-designed gamification can enhance academic performance and foster positive emotional experiences, such as increased confidence and enjoyment. However, designing effective gamified tasks requires careful planning, as poorly implemented elements—such as excessive competition or overly complex rules—may inadvertently demotivate learners or distract from core content.

A recent meta-analysis by Dai and colleagues, synthesizing 37 studies, offered actionable insights. The study found that gamified learning had a moderate positive impact on student outcomes (d = 0.57), with the strongest results seen in activities that included clear rules, challenges, and unexpected scenarios designed to stimulate curiosity at the same time—for example, mystery-solving tasks or narrative-driven quests.

Notably, effects varied by subject. Disciplines with structured knowledge systems, such as mathematics and engineering, showed greater benefits compared to humanities or arts, suggesting that gamification works best when aligned with concrete, step-by-step learning objectives. Practical recommendations for teachers include a) introduce simple gamified elements like point systems or progress badges to complement existing lessons, ensuring rules are easy to understand; b) regularly assess whether gamification enhances learning or causes distractions and c) embed storytelling or mystery elements to align challenges with learning goals.

 

Source: Dai, W.-A., Xu, W., & Xing, Q.-W. (2025). Gamified learning impact: A meta-analysis of game element combinations on students’ learning outcomes. Educational Technology Research and Development. https://doi.org/10.1007/s11423-025-10493-y… Read the rest

Categories
K-12 Education Maths and Science Learning

The effects of integrated STEM education in K12

Integrated STEM education, which combines science, technology, engineering, and mathematics into interdisciplinary learning, has gained growing attention for its potential to prepare students for real-world challenges. A recent meta-analysis by Chen and colleagues synthesized 109 studies (experimental or quasi-experimental designs) conducted between 2010-2022 to examine its effectiveness in K-12 settings. The researchers examined the effects of integrated STEM education through three primary types of interventions:

  1. Comparing integrated STEM education to non-integrated approaches in STEM programs (70 studies)
  2. Implementing extra teaching and learning (T&L) strategies (like guided prompts and process modelling) versus not using them in integrated STEM programs (23 studies)
  3. Incorporating specific learning technologies (e.g., simulations, virtual reality) versus not using them in integrated STEM programs (16 studies)

The findings reveal that all three approaches yielded positive effects. Integrated STEM education showed large effects on cognitive skills (g=0.94), knowledge acquisition (g=0.62) and perceptions (g=0.37). Notably, quasi-experimental studies demonstrated larger effects compared to randomized controlled trials. Programs with shorter duration and smaller sample size tended to obtain relatively larger effect sizes. Design-based tasks enhanced student perception but were less effective for knowledge acquisition compared to inquiry-based tasks.

Extra T&L strategies exhibited small to medium effects on cognitive skills (g=0.71), problem-solving task (g=0.52), and perceptions (g=0.34). Using technologies in integrated STEM showed medium effects on knowledge acquisition (g= 0.61), social skills (g=0.54) and perception (g=0.47).

The authors discussed several practice implications that may benefit integrated STEM education. While quasi-experimental studies showed larger effects, the variation in effect sizes between research designs suggests the need for more rigorous randomized controlled trials to validate these findings.

 

Source: Chen, B., Chen, J., Wang, M., Tsai, C.-C., & Kirschner, P. A. (2025). The effects of integrated STEM education on K12 students’ achievements: A meta-analysis. Review of Educational Research, 00346543251318297. https://doi.org/10.3102/00346543251318297… Read the rest

Categories
Effective Teaching Approach K-12 Education

Strategies for facilitating productive dialogue in collaborative learning

Collaboration is more than just a 21st-century skill—it’s a powerful teaching strategy that helps students grow cognitively, socially, and emotionally. While group work is common in classrooms, simply putting students together doesn’t guarantee success. As with adults in professional settings, young learners benefit from clear guidance and practice to collaborate effectively. Without structured support, group tasks can lead to frustration or off-task behavior rather than meaningful learning.

Recent research underscores the transformative power of well-guided collaboration. A 2024 review of 24 studies by Hu and Chen found that when students elaborate on their own ideas and respond to the ideas of others, known as “productive peer talk moves,” they experience better learning outcomes. These strategies led to strong improvements in the quality of student interactions (Hedge’s g = 1.27), boosted subject-specific knowledge (g = 0.96), and strengthened general skills like critical thinking (g = 1.02). Even problem-solving abilities saw moderate gains (g = 0.70). These findings highlight that when students engage in meaningful dialogue, they don’t just master content—they also learn to work together more effectively.

To foster effective collaboration, teachers can start by embedding proven effective “talk moves” into everyday instruction. For example, follow-up questions like “Can you explain why you think that?” or “How does your idea connect to what we learned yesterday?” promote reasoning and help students build on one another’s ideas. Equally important is combining explicit training with in-the-moment support. Before group work, teachers can model how to ask constructive questions (“I wonder if…” or “What if we tried…?”) and explain their purpose (“Questions help us dig deeper!”). During activities, tools like sentence starters (“I agree because…” or “Another perspective is…”) can keep discussions productive. Teachers should circulate the room to gently redirect off-task groups (“Let’s revisit our main goal…”), ensuring conversations stay focused, respectful, and inclusive.

 

Source: Hu, L., & Chen, G. (2024). A systematic review and meta-analysis of productive peer talk moves. Journal of Behavioral Education, 33(4), 798–830. https://doi.org/10.1007/s10864-023-09513-9… Read the rest

Categories
Educational Administration and Leadership K-12 Education Programme Evaluation

Cross-age tutoring: Are adult tutors better than student tutors?

A meta-analysis published in Educational Psychology Review by Chang and colleagues provides comprehensive evidence on the effectiveness of cross-age tutoring in educational settings. Cross-age tutoring involves pairing an older tutor with a younger tutee at different developmental stages, with the expectation that both participants benefit. This meta-analysis analyzed 31 experimental studies (RCT or quasi experimental design) involving147 effect sizes of academic outcomes. Of these, 28 studies (117 effect sizes) involved tutees, while 14 studies (30 effect sizes) examined the impact on tutors. The tutors ranged from older students in grades 5 through 12 to adult tutors, including university students and community volunteers.

The researchers found that cross-age tutoring generated positive academic outcomes for both tutors and tutees, with an overall effect size of 0.34. Specifically, tutees showed significant academic improvement (ES=0.33), while tutors also demonstrated considerable learning gains (ES=0.39). Importantly, the analysis revealed that student tutors (ES = 0.37) were as effective as adult tutors (ES = 0.25) on tutees, and the intervention proved beneficial for both typically developing students and those with learning difficulties. The positive effects were consistent across both reading and mathematics subjects.

The findings have some implications for educational practice and policy decisions. For instance, the schools can effectively utilize older students as tutors, which offers both economic advantages and feasibility. However, the researchers note several areas requiring further investigation, including cost-effectiveness analysis comparing peer tutoring with adult tutoring, optimal tutoring duration and frequency.

 

Source (Open Access): Chang, A., Mauer, E., Wanzek, J., Kim, S., Scammacca, N., & Swanson, E. (2025). Examining the academic effects of cross-age tutoring: A meta-analysis. Educational Psychology Review, 37(1), 19. https://doi.org/10.1007/s10648-025-09997-z… Read the rest

Categories
Achievement Educational Administration and Leadership K-12 Education

24 years of evidence on the impacts of Teach for America

As teacher shortages persist in many school districts, alternative certification routes like Teach for America (TFA) remain relevant policy considerations. A meta-analysis from AIR (American Institutes for Research), led by Martyna Citkowicz, reviewed data from 23 studies (either RCTs or QEDs) of TFA corps members over the program’s first 24 years (2000-2024).

The authors found that TFA had no impact on students’ achievement in English Language Arts, but a significant positive impact in Math (ES = +0.05) and Science (ES = +0.16). These impacts varied significantly by grade level and differed between corps members during their service and alumni after their service. This brief report noted but did not investigate regional variation in impacts, a growing area of focus for the TFA program.

 

Source (Open Access): Citkowicz, M., Chen, C., Castro M., Arellano, B. (2024) A Meta-analysis of Teach For America Teacher Impacts.  Retrieved from https://www.air.org/sites/default/files/2024-11/TFA-meta-analysis_memo.pdf.… Read the rest

Categories
Language Development Primary School Education Programme Evaluation Secondary School Education

Optimizing reading comprehension intervention : A Bayesian network meta-analysis

Peng and colleagues conducted a Bayesian network meta-analysis (BNMA) to evaluate the effectiveness of various reading comprehension strategies for students with reading difficulties (RD) in grades 3 to 12. They included 52 experimental/quasi-experimental studies which examined strategies including main idea (or summarizing), inference, text structure, retell, prediction, self-monitoring, and graphic organizers, along with their combinations. The researchers explored potential moderators like background knowledge instruction, age, text type, RD status, assessment type, intervention dosage, and study quality.

Unlike traditional meta-analysis, network meta-analysis can compare multiple interventions simultaneously and rank their effectiveness, even when some interventions haven’t been directly compared in individual studies, based on both direct and indirect evidence. The study found that the most effective strategy combination was the main idea-text structure-retell (MTR) combination (ES =+1.72, SUCRA = 0.89). Other effective strategies included the main idea-text structure-self-monitoring-graphic organizers (MTSG) combination (ES =+1.13, SUCRA = 0.76) and the main idea strategy alone (ES =+1.07, SUCRA=0.77). Background knowledge (vocabulary / content knowledge) was the only significant moderator that enhanced the effectiveness of these strategies. Without it, no strategies or combinations showed significant efficacy. The number of strategies in a combination did not influence the reading comprehension outcome, suggesting that teaching too many strategies could increase cognitive load, making it difficult for struggling readers to apply them effectively.

These insights can help educators design more effective reading interventions by focusing on optimal strategy combinations and incorporating background knowledge instruction to enhance comprehension for struggling readers.

 

Note: SUCRA = the surface under the cumulative ranking curve scores, which indicates how likely an intervention strategy would be evaluated as the most efficacious (the worst 0% to the best 100%).

 

Source (Open Access): Peng, P., Wang, W., Filderman, M. J., Zhang, W., & Lin, L. (2024). The Active Ingredient in Reading Comprehension Strategy Intervention for Struggling Readers: A Bayesian Network Meta-analysis. Review of Educational Research, 94(2), 228–267. https://doi.org/10.3102/00346543231171345… Read the rest