Categories
Achievement Higher Education Primary School Education Secondary School Education

The impact of test preparation on performance in large-scale educational tests: A meta-analysis of experimental studies

A recent meta-analysis examines whether test preparation improves performance in large-scale educational tests. Although schools, commercial institutions, and students invest heavily in preparation courses and materials, existing studies have reported inconsistent effects. Earlier reviews were also concentrated on US college admission and cognitive ability tests and often relied on evidence published before 2000. This study therefore estimates the overall effect of test preparation and examines how it varies across intervention, test, student, and research-design characteristics.

The authors synthesized 28 experimental and quasi-experimental studies, including 92 effect sizes and 16,741 participants across primary, secondary, and tertiary education. The studies covered college admission tests, English proficiency tests, and other large-scale assessments. A hierarchical random-effects model with robust variance estimation was used, while moderator analyses examined intervention breadth, strategy and material use, test characteristics, previous test experience, and study design.

Test preparation produced a significant positive overall effect on test performance (g=.26, 95% CI [.10,.42], p<.001), but heterogeneity was high (I^2=82.44%). Test-specific and narrowly focused interventions were more effective (g=.33) and (g=.32) than broad programs aimed at general knowledge or transferable skills (g=-.04). Interventions teaching test-taking strategies also showed stronger effects (g=.35) than those without such instruction (g=.05). Students with previous testing experience benefited substantially more (g=.69) than those without it (g=.06). However, preparation effects did not transfer significantly to other tests in the same domain (g=.06, p=.502).

Taken together, the findings suggest that test preparation can improve large-scale test scores, but its effectiveness mainly reflects alignment with the target test rather than broader learning gains. The limited transfer effect raises concerns about whether score improvement represents genuine development in the abilities being assessed. Future research should use stronger experimental designs, report intervention processes more clearly, and distinguish test-score gains from transferable learning.

Source (Open Access): Hao, Z., Baird, J. A., Masri, Y. E., & Double, K. (2025). The impact of test preparation on performance of large-scale educational tests: A meta-analysis of experimental studies. Review of Educational Research, 00346543251360775.

https://doi.org/10.3102/00346543251360775Read the rest

Categories
Effective Teaching Approach Primary School Education

Support for self-regulated learning in immersive virtual reality – An experimental design for science learning

Immersive virtual reality (IVR) enables users to engage with virtual environments in a highly immersive way. Past studies have found that immersive virtual reality (IVR) may increase students’ cognitive load, distract them from learning tasks, and hinder their knowledge acquisition. To address these challenges, Hsu and Lee (2026) explored the integration of self-regulated learning (SRL) strategies into IVR, and examined their impact on students’ cognitive load. An experimental design was employed, involving 105 students randomly assigned to either an SRL group (n=52) or a non-SRL (NSRL) group (n = 53). A two-way mixed-design ANOVA was conducted to identify differences in the science learning outcomes of the two groups. In addition, partial least squares structural equation modeling (PLS-SEM) was applied to examine the structural relationships among affective factors in IVR environments, cognitive load, and students’ learning outcomes within both the SRL and NSRL conditions.

The findings confirm that, while learning with IVR, extraneous cognitive load exerted negative effects on both SRL gains and science knowledge, whereas germane cognitive load positively influenced these outcomes. First, interactive extraneous cognitive load predicted both lower- and higher-level science knowledge in the NSRL group. Second, environmental extraneous cognitive load negatively predicted SRL gains across both IVR conditions.  Third, a finding common to both the SRL and NSRL groups was that increased student control and active learning significantly enhanced perceived germane cognitive load.

As IVR technology becomes increasingly accessible and user-friendly, it is no longer confined to professional instructional designers; teachers now need the capacity to independently create VR-based learning materials. This shift highlights the importance of preparing teachers not only to use VR tools but also to design pedagogically meaningful IVR content, such as the incorporation of SRL strategies. Accordingly, teachers must recognize the benefits of presence and interaction while remaining cautious of their limitations and potential pitfalls. They should also be mindful that less optimal instructional designs may impose extraneous cognitive load, which can undermine learning outcomes. Most importantly, teachers should foster learners’ autonomy and agency, as these are critical for effective IVR-based learning.

Source (Open Access): Hsu, Y. T., & Lee, S. W. Y. (2026). Support for self-regulated learning in immersive virtual reality–An experimental design for science learning. Education and Information Technologies31(1), 269-300.

https://doi.org/10.1007/s10639-025-13807-yRead the rest

Categories
Language Development Primary School Education Secondary School Education

The Effects of Interventions for Students With Reading Difficulties in Grades 4–12

Killingly and colleagues conducted a systematic review and meta-analysis of school-based interventions for students with reading difficulties in Grades 4–12 published between 2011 and 2023. The study examined the overall effectiveness of these interventions and further tested whether study characteristics, sample characteristics, and intervention characteristics moderated their effects. A total of 104 publications and 586 effect sizes were included, representing 97,114 participants. Methodologically, the authors used a Correlated and Hierarchical Effects model combined with robust variance estimation to address dependency among multiple outcomes and effect sizes within the same study, while also estimating effects across overall reading performance and specific reading domains.

The results showed that, overall, reading interventions had a small but significant positive effect for students with reading difficulties in Grades 4–12, with an overall effect size of g = 0.212 (95% CI [0.163, 0.261], p < .001). This suggests that although the gains were not large, these interventions did produce reliable improvements in students’ reading performance. Across specific reading domains, the strongest effects were found for vocabulary (g = 0.422), followed by decoding/word recognition (g = 0.199) and reading comprehension (g = 0.187). Fluency showed only a very small but significant effect (g = 0.080), spelling was not significant (g = 0.015), and phonological processing, although showing a larger effect size on the surface (g = 0.531), did not reach significance and was therefore considered unstable. Overall heterogeneity was very high (I² = 89.71%), indicating that differences in study design and sample characteristics had a substantial influence on intervention effectiveness. GRADE assessment further suggested that the overall quality of evidence ranged from moderate to high, with the strongest evidence for fluency, moderate evidence for vocabulary, and moderate-to-low evidence for phonological processing.

Moderator analyses showed that intervention effects varied according to both study and sample conditions. Overall, more recently published studies showed stronger effects (β = 0.015), and journal articles produced significantly larger effects (g = 0.268) than research reports (g = 0.062). In terms of sample characteristics, low socioeconomic status was not significantly related to overall effects, but a higher proportion of students with learning disabilities was associated with slightly stronger effects (β = 0.006). For students from a language background other than English, overall differences were not significant, but in the vocabulary domain, a greater proportion of such students was associated with stronger effects (β = 0.016), suggesting that vocabulary instruction may be particularly important for this group. Regarding intervention design, intervention focus, duration, and measurement type were all significant moderators. Comprehension-focused interventions showed relatively strong overall effects (g = 0.313), multicomponent interventions showed stable effects (g = 0.178), and word study interventions had smaller effects (g = 0.096), whereas vocabulary-focused interventions, though fewer in number, showed the largest effect (g = 0.716). Shorter interventions were actually associated with stronger effects, with effect sizes of g = 0.405 for 0–5 hours and g = 0.409 for 6–15 hours. In addition, researcher-developed measures yielded significantly larger effects (g = 0.542) than standardized measures (g = 0.127). Although there was no significant overall difference between interventions delivered by teachers and those delivered by researchers, in vocabulary interventions teacher-led delivery produced stronger effects (g = 0.733) than researcher-led delivery (g = 0.249), suggesting that classroom teachers may hold particular advantages in providing vocabulary support.

Overall, this study shows that reading interventions for older students with reading difficulties are indeed effective, although the magnitude of their effects depends on the reading domain being targeted and on the design of the intervention. Vocabulary and reading comprehension appear to be the most promising focuses, while multicomponent interventions also demonstrate stable benefits. By … Read the rest

Categories
Primary School Education Programme Evaluation

The effects of a school-based leadership program on student leaders and their peers: A cluster randomized controlled trial

Student leadership is widely recognized as an important life skill associated with academic, psychological, and social benefits. However, school-based leadership opportunities are often offered to students who already display leadership qualities, while those who may benefit most from such opportunities are less likely to participate. Existing leadership research has also focused mainly on adults, leaving limited evidence on how leadership skills can be developed among young students. To address this gap, this study evaluated Learning to Lead, a peer-led, school-based leadership and fundamental movement skills program grounded in transformational leadership theory.

The study used a two-arm cluster randomized controlled trial design involving 20 elementary schools in Australia. A total of 1,898 students participated, including 952 older students as Leaders and 946 younger students as Peers. Schools were randomized to either the intervention group or a wait-list control group after baseline assessment. The intervention consisted of teacher professional development, six leadership lessons delivered by trained teachers to student Leaders, and twelve peer-led fundamental movement skill sessions delivered by Leaders to younger Peers. Outcomes were assessed at baseline and immediately after the intervention. Leader outcomes included teacher-reported leadership effectiveness, self-reported leadership ability, leadership self-efficacy, wellbeing, and classroom time on-task. Peer outcomes included physical activity, perceived and actual motor competence, cardiorespiratory fitness, and muscular fitness.

The results showed that the L2L program produced significant benefits for both Leaders and Peers. For Leaders, teacher-reported leadership effectiveness improved significantly in the intervention group compared with the control group, with an adjusted between-group difference of 0.56 units and an effect size of d = 0.39. The intervention also produced positive spillover effects: Leaders showed significantly greater wellbeing, with an adjusted difference of 0.77 units, and their classroom time on-task increased by approximately 7 percentage points. However, the program did not significantly improve Leaders’ self-reported leadership ability or leadership self-efficacy. For Peers, the intervention significantly improved perceived motor competence, with an adjusted difference of 1.12 units, increased daily moderate-to-vigorous physical activity by 3.02 minutes per day, and improved cardiorespiratory fitness by 2.57 laps. Moderator analysis showed that the effect on perceived motor competence was significant for both boys and girls, but stronger among boys. However, the program did not significantly improve Peers’ actual motor competence or muscular fitness.

Taken together, the findings suggest that peer-led leadership programs can improve student leaders’ observable leadership effectiveness and generate broader benefits for their wellbeing and classroom engagement. The program also benefited younger peers by improving their perceived motor competence, physical activity, and cardiorespiratory fitness. These findings indicate that school-based peer-led interventions can meaningfully integrate leadership development with physical activity promotion. Nevertheless, the study has several limitations, including short-term outcome assessment, possible teacher expectancy effects in ratings of student leadership, possible awareness of group allocation among video coders, and the challenge of relying on student Leaders who were still developing their own leadership and movement skills. Future research should examine the long-term effects of such programs and consider providing stronger instructional support for student Leaders.

Source (Open Access): Wade, L., Beauchamp, M. R., Nathan, N., Smith, J. J., Leahy, A. A., Bao, R., Kennedy, S. G., Boyer, J., Diallo, T. M. O., Beacroft, S., & Lubans, D. R. (2026). Effects of a school-based leadership program on student leaders and their peers: The Learning to Lead cluster randomized controlled trial. Contemporary Educational Psychology, 102444.

https://doi.org/10.1016/j.cedpsych.2026.102444Read the rest

Categories
Maths and Science Learning Primary School Education

Generative AI and Multimodal Data for Educational Feedback: Insights from Embodied Math Learning

Cosentino et al. (2025) explore the role of generative AI (GenAI) in providing formative feedback within embodied mathematics learning environments. Building on embodied cognition theory and advances in multimodal learning technologies, the study examines whether AI-generated feedback can effectively support students’ learning processes compared to traditional teacher feedback. The research focuses on children learning integer operations through a body-scale digital number line, where physical movement is integrated into mathematical reasoning.

Using a between-group experimental design, 34 students aged 11-13 were assigned to either a GenAI feedback condition or a human teacher feedback condition. Students interacted with a multisensory learning environment (MOVES), where their movements were tracked and used to generate real-time, adaptive feedback through a GPT-4–based system. Multimodal data, including eye-tracking, system logs, and behavioral measures, were collected to assess task performance, cognitive load, and information processing patterns.

Results show no significant differences in task-based learning performance between the GenAI and teacher feedback conditions. However, students receiving GenAI feedback demonstrated significantly lower cognitive load and more balanced information processing strategies, as indicated by eye-tracking metrics such as pupil dilation and the Information Processing Index (IPI). In contrast, students in the teacher feedback condition exhibited higher cognitive load and more frequent attention shifts toward irrelevant or incorrect options, suggesting less efficient processing.

Overall, the findings highlight the potential of GenAI as an effective tool for delivering structured, adaptive feedback that enhances learning efficiency without compromising learning outcomes. Rather than replacing teachers, the study emphasizes the value of hybrid intelligence approaches that integrate AI and human feedback to optimize learning experiences. The results provide important implications for designing AI-enhanced, multimodal learning environments that support cognitive engagement and personalized learning in mathematics education.

Source (Open Access): Cosentino, G., Anton, J., Sharma, K., Gelsomini, M., Giannakos, M., & Abrahamson, D. (2025). Generative AI and multimodal data for educational feedback: Insights from embodied math learning. British Journal of Educational Technology56(5), 1686-1709.

https://doi.org/10.1111/bjet.13587Read the rest

Categories
Language Development Primary School Education

Inference Training for Homonyms: Evidence from Two Randomized Controlled Trials in Primary Schools

A recent study by Booton and colleagues, investigated whether a brief lexical inference intervention could support children aged 7–8 years in learning the multiple meanings of homonyms, words that share the same spelling but carry distinct meanings (e.g., bat, bank, bark). Despite the prevalence of homonyms in everyday English and their well-documented challenge for young readers, no effective targeted intervention had previously been identified in the literature.

The researchers conducted two separate randomized controlled trials (RCTs) across English state primary schools. In Study 1, 180 children from six schools were randomly assigned to either an inference training condition (n = 60) or a spatial reasoning active control condition (n = 120). Participants attended four 30-minute intervention sessions delivered in small groups of four over a two-week period. In Study 2, 76 children, including 37 with English as an Additional Language (EAL) and 39 with English as a first language (EL1), were assigned through stratified randomisation to either the inference training (n = 40) or an implicit exposure control involving contextualised reading (n = 36). This second study also incorporated pre-registered methodology and measured metacognitive and inference skills alongside homonym knowledge.

The inference intervention, referred to as “Word Detectives,” trained children to use contextual clues within sentences to deduce the intended meaning of a homonym. Children were taught to notice, question, and infer meanings in a structured, experimenter-led format. The control groups received time-matched activities of a different nature—either spatial reasoning tasks (Study 1) or implicit reading exposure to the same target vocabulary without explicit inference instruction (Study 2). Receptive knowledge of both taught and untaught homonyms was assessed before and after the intervention using a researcher-developed homonym recognition task, while Study 2 additionally employed the York Assessment of Reading for Comprehension (YARC) to measure standardised reading comprehension.

Results from both RCTs consistently demonstrated that children in the inference training conditions made significantly greater gains in receptive homonym knowledge than their counterparts in the control groups. In Study 2, trained children also showed improved performance on the inference task itself. Importantly, while children with EAL displayed a specific baseline disadvantage in receptive homonym knowledge relative to their EL1 peers, the intervention proved equally effective for both language groups, suggesting its broad applicability across diverse classroom populations. Furthermore, receptive knowledge of homonyms and inference ability each predicted unique variance in reading comprehension scores beyond other vocabulary measures, highlighting the educational significance of homonym understanding for broader literacy outcomes.

The study did, however, identify notable limitations. Transfer of learning to untaught homonyms was limited, although error analysis suggested emergent generalisation of the inferencing strategy. The intervention window was brief (approximately two weeks), and follow-up data beyond the immediate post-test were not collected, leaving questions about the durability of gains unanswered. The researchers call for future studies with longer intervention periods, delayed follow-up assessments, and investigations into whether the intervention could be scaled for classroom delivery by teachers rather than trained researchers.

These findings carry meaningful implications for educational practice. Explicitly teaching lexical inference as a skill, rather than relying on incidental vocabulary acquisition through reading alone, may represent an efficient and equitable approach to bolstering both vocabulary and reading comprehension in the primary years, particularly in linguistically diverse classrooms where English language learners are present.

 

Source (Open Access): Booton, S. A., Birchenough, J. M., Gilligan‐Lee, K., Jelley, F., & Murphy, V. A. (2026). Lexical inference training for homonyms: Two randomized controlled trials for children with English as a first and an additional language. British Journal of Educational Psychology.

https://doi.org/10.1111/bjep.70056Read the rest