Category: Programme Evaluation

Categories
Higher Education Programme Evaluation

Unequal Access, Equal Outcomes? Gender Differences in University-Led STEM Programs

Guo et al. (2025) investigate whether university-led STEM programs function as gender equalizers in shaping undergraduates’ career commitment in STEM. Grounded in Social Cognitive Career Theory, the study examines how four program factors (i.e., course resources, research opportunities, mentoring quality, and peer interactions) relate to students’ STEM career commitment, and whether these relationships differ by gender through the mediating roles of STEM professional self-efficacy and perceptions of STEM professionals. Data were drawn from a nationwide survey of 19,108 undergraduates from 39 leading Chinese universities participating in the Strong Foundation Program, a large-scale initiative designed to cultivate elite STEM talent.

Using t-tests, regression analyses, and multi-group structural equation modeling, the authors compared gender differences among both program participants and non-participants. Results show that although men reported higher overall STEM career commitment in the full sample, this gender gap disappeared among students enrolled in the university-led STEM program. Women participants even reported more favorable experiences in course resources, research opportunities, and mentoring quality, whereas men reported stronger peer interactions. These findings suggest that structured university programs may substantially reduce gender disparities in STEM career commitment.

Regression results further indicate that all four program factors positively predicted STEM career commitment. Course resources and research opportunities were particularly influential for women students, while peer interactions exerted a stronger effect for men students. Mentoring quality showed comparable effects across genders. These patterns highlight gender-differentiated sensitivities to specific institutional supports within STEM programs.

Multi-group mediation analyses revealed distinct gender-specific pathways. For women students, course resources and research opportunities enhanced STEM career commitment primarily through STEM professional self-efficacy and positive perceptions of STEM professionals. In contrast, men students’ career commitment was shaped more strongly by peer interactions via perceptions of STEM professionals. Mentoring quality demonstrated similar indirect effects for both groups. Together, these findings underscore that equal access does not imply identical developmental mechanisms.

Overall, the study demonstrates that thoughtfully structured university-led STEM programs can act as effective gender equalizers in career commitment outcomes, even when women remain numerically under-represented in participation. By revealing gender-specific psychological and contextual pathways, the research extends Social Cognitive Career Theory and provides important implications for designing targeted STEM policies and support systems in higher education.

Source (Open Access): Guo, C., Wu, W., Hu, T., & Gao, T. (2025). Unequal access, equal outcomes? Gender differences in the relationship between university-led STEM program factors and undergraduates’ career commitment in STEM. International Journal of STEM Education, 12(1), 46.

https://doi.org/10.1186/s40594-025-00569-9… Read the rest

Categories
Effective Teaching Approach Programme Evaluation Secondary School Education

Linking Classrooms and Museums for Self-Regulated STEM Learning

Lewalter et al. (2025) examine how school-based factors shape students’ self-regulated STEM learning during and after a museum visit. The study addresses an important challenge in STEM education: how to connect classroom learning with meaningful real-world contexts beyond school. Focusing on a museum exhibition about mobility and traffic, the authors investigate whether students’ learning strategy knowledge, prior knowledge, prior interest, and classroom preparation or follow-up activities predict their learning processes during the visit and their learning outcomes three months later.

The study used a pretest–posttest–follow-up design with 409 Grade 10 students from 21 classes in 12 German high schools. Students visited the Deutsches Museum München and explored a tablet-supported exhibition programme titled Mobility Transition—What Moves Us in the Future? Traffic and Mobility Challenges of the 21st Century. During the 90-minute visit, students worked in small groups and engaged in self-guided exploration of selected exhibits. Questionnaire data were collected one week before the visit, immediately after the visit, and approximately three months later to measure learning strategy knowledge, preparation and follow-up activities, situational interest, basic psychological needs, perceived content relevance, engagement, knowledge, and individual interest.

Results show that most students did not experience systematic classroom integration of the museum visit: 75% reported no classroom preparation, and 60.4% reported no follow-up activities after the visit. Students’ metacognitive and motivational learning strategy knowledge positively predicted several aspects of the learning process, including perceived content relevance, basic need satisfaction, situational interest, and engagement. However, when prior individual interest was included in the model, it became the strongest predictor of learning process variables, suggesting that students’ existing interest plays a central role in shaping museum-based STEM learning.

For medium-term learning outcomes, follow-up activities in the classroom were especially important. Three months after the museum visit, students who experienced classroom follow-up showed higher self-perceived and objective knowledge. Knowledge of learning strategies also contributed to self-perceived knowledge, whereas students’ later individual interest was mainly predicted by their prior individual interest. Overall, the findings highlight that museum visits should not be treated as isolated field trips. Instead, their educational value depends on stronger links between classroom teaching and out-of-school learning, particularly through helping students develop self-regulated learning strategies and providing meaningful follow-up activities after the visit.

Source (Open Access): Lewalter, D., Neubauer, K., & Moser, S. (2025). Self-regulated STEM learning in museums—the role of learner characteristics and visit-related activities in school. International Journal of STEM Education, 12(1), 56.

https://doi.org/10.1186/s40594-025-00577-9… Read the rest

Categories
K-12 Education Programme Evaluation

The Effects of Integrated STEM Education on K12 Students’ Achievements: A Meta-Analysis

Integrated STEM education refers to T&L of scientific, technological, engineering, and mathematical knowledge and skills in integrative ways, emphasizing the connection between abstract knowledge and real-world problems. Integrated STEM education is characterized by four core features: multidisciplinary integration, real-world application, authentic inquiry or design-based practice, and active student learning. Based on 124 extracted and coded studies (2010-2022), Chen et al.’s (2025) meta-analysis reports on the effects of integrated STEM education based on three main types of interventions: (1) adopting integrated STEM education, (2) using extra teaching and learning strategies to enhance integrated STEM education, and (3) using specific learning technologies to support integrated STEM education.

All three types of interventions yielded a medium effect on knowledge acquisition and a small effect on student perceptions. Besides, adopting integrated STEM education had a large effect on cognitive skills; using extra teaching and learning strategies in integrated STEM programs produced a medium effect on cognitive skills and problem-solving task performance; using specific learning technologies had a small effect on problem-solving task performance. Some factors, such as task type (inquiry or design-based task) and program duration, may influence STEM learning outcomes.

To maximize the efficacy of integrated STEM education, practitioners should embed its four core characteristics into curriculum design while favoring short-to-medium duration programs (one month to a semester). Educators must carefully balance hands-on design and minds-on inquiry tasks by providing necessary scaffolding tailored to students’ prior knowledge. Furthermore, deploying targeted instructional strategies and learning technologies can enhance engagement with complex, real-world problems. Ultimately, evaluating these programs requires a multidimensional approach that prioritizes skill development and practical problem-solving performance alongside traditional knowledge acquisition.

Source (Open Access): Chen, B., Chen, J., Wang, M., Tsai, C. C., & Kirschner, P. A. (2026). The effects of integrated STEM education on K12 students’ achievements: A meta-analysis. Review of Educational Research, 96(2), 619-668.

https://doi.org/10.3102/00346543251318297… Read the rest

Categories
Primary School Education Programme Evaluation

The effects of a school-based leadership program on student leaders and their peers: A cluster randomized controlled trial

Student leadership is widely recognized as an important life skill associated with academic, psychological, and social benefits. However, school-based leadership opportunities are often offered to students who already display leadership qualities, while those who may benefit most from such opportunities are less likely to participate. Existing leadership research has also focused mainly on adults, leaving limited evidence on how leadership skills can be developed among young students. To address this gap, this study evaluated Learning to Lead, a peer-led, school-based leadership and fundamental movement skills program grounded in transformational leadership theory.

The study used a two-arm cluster randomized controlled trial design involving 20 elementary schools in Australia. A total of 1,898 students participated, including 952 older students as Leaders and 946 younger students as Peers. Schools were randomized to either the intervention group or a wait-list control group after baseline assessment. The intervention consisted of teacher professional development, six leadership lessons delivered by trained teachers to student Leaders, and twelve peer-led fundamental movement skill sessions delivered by Leaders to younger Peers. Outcomes were assessed at baseline and immediately after the intervention. Leader outcomes included teacher-reported leadership effectiveness, self-reported leadership ability, leadership self-efficacy, wellbeing, and classroom time on-task. Peer outcomes included physical activity, perceived and actual motor competence, cardiorespiratory fitness, and muscular fitness.

The results showed that the L2L program produced significant benefits for both Leaders and Peers. For Leaders, teacher-reported leadership effectiveness improved significantly in the intervention group compared with the control group, with an adjusted between-group difference of 0.56 units and an effect size of d = 0.39. The intervention also produced positive spillover effects: Leaders showed significantly greater wellbeing, with an adjusted difference of 0.77 units, and their classroom time on-task increased by approximately 7 percentage points. However, the program did not significantly improve Leaders’ self-reported leadership ability or leadership self-efficacy. For Peers, the intervention significantly improved perceived motor competence, with an adjusted difference of 1.12 units, increased daily moderate-to-vigorous physical activity by 3.02 minutes per day, and improved cardiorespiratory fitness by 2.57 laps. Moderator analysis showed that the effect on perceived motor competence was significant for both boys and girls, but stronger among boys. However, the program did not significantly improve Peers’ actual motor competence or muscular fitness.

Taken together, the findings suggest that peer-led leadership programs can improve student leaders’ observable leadership effectiveness and generate broader benefits for their wellbeing and classroom engagement. The program also benefited younger peers by improving their perceived motor competence, physical activity, and cardiorespiratory fitness. These findings indicate that school-based peer-led interventions can meaningfully integrate leadership development with physical activity promotion. Nevertheless, the study has several limitations, including short-term outcome assessment, possible teacher expectancy effects in ratings of student leadership, possible awareness of group allocation among video coders, and the challenge of relying on student Leaders who were still developing their own leadership and movement skills. Future research should examine the long-term effects of such programs and consider providing stronger instructional support for student Leaders.

Source (Open Access): Wade, L., Beauchamp, M. R., Nathan, N., Smith, J. J., Leahy, A. A., Bao, R., Kennedy, S. G., Boyer, J., Diallo, T. M. O., Beacroft, S., & Lubans, D. R. (2026). Effects of a school-based leadership program on student leaders and their peers: The Learning to Lead cluster randomized controlled trial. Contemporary Educational Psychology, 102444.

https://doi.org/10.1016/j.cedpsych.2026.102444… Read the rest

Categories
Programme Evaluation Secondary School Education

Teaching Quality in STEM Enrichment Programs: Gifted Students’ Perceptions of In-School and Out-of-School Learning Environments

Jaggy et al. (2025) investigate how gifted students perceive teaching quality in specialized STEM enrichment programs compared with their regular school classrooms. Previous research has shown that high-ability students often experience learning environments differently from their peers, yet little is known about how participation in extracurricular enrichment programs influences students’ evaluation of teaching quality in both in-school and out-of-school settings. To address this gap, the study examines students attending the Hector Seminar, a specialized STEM enrichment program for gifted secondary school students in Germany and compares their perceptions of teaching quality across learning contexts.

The study uses cross-sectional data from a large-scale talent development project including academically advanced sixth- and seventh-grade students in the German state of Baden-Württemberg. Teaching quality was assessed using student reports on six indicators derived from the three-basic-dimensions model of instructional quality: effective classroom management, cognitive activation, student support, adaptivity, interestingness, and motivational climate. Two research questions guided the analysis: whether gifted students evaluate teaching quality in the enrichment program higher than in regular school classes, and whether students attending the program perceive regular classroom teaching differently from comparable students who do not participate in the program.

Results show that students attending the specialized STEM enrichment program rated teaching quality significantly higher in the program than in their regular school classes across most indicators, particularly in interestingness, motivational climate, and adaptivity. These findings suggest that enrichment programs provide highly stimulating and supportive learning environments for gifted students. Importantly, however, participation in the enrichment program did not lead students to evaluate their regular school teaching more negatively compared with non-participants, indicating that potential reference effects between learning contexts were limited.

Overall, the study highlights the importance of specialized enrichment programs as high-quality learning environments for gifted students while showing that such programs do not necessarily undermine students’ perceptions of regular classroom instruction. The findings contribute to research on gifted education and teaching quality by demonstrating that macro-level adaptations, such as structured STEM enrichment programs, can enhance learning experiences without producing negative comparison effects. The results also underscore the need for teacher professional development and more individualized instruction to better support diverse student needs across learning settings.

 

Source (Open Access): Jaggy, A. K., Wagner, W., Fütterer, T., Göllner, R., & Trautwein, U. (2025). Teaching quality in STEM education: Differences between in-and out-of-school contexts from the perspective of gifted students. International Journal of STEM Education, 12(1), 53.

https://doi.org/10.1186/s40594-025-00576-w… Read the rest

Categories
K-12 Education Programme Evaluation

Gender Disparity in Computational Thinking Pedagogy and Assessment: A Three-Level Meta-Analysis

Gender disparities in computational thinking (CT) education are widely acknowledged, but few meta-analyses have investigated how particular instructional approaches and assessment settings shape these differences. To address this research gap, Liu et al. (2025) conducted a meta-analysis of 53 empirical studies, covering 100 effect sizes and a total sample of 15,454 participants, to examine the overall magnitude of gender differences in CT education and the factors that may shape them. The findings show a small but statistically significant overall gender difference (g = 0.106, 95% CI [0.024, 0.188], p < .05), suggesting a slight advantage for males.

Regarding moderation effects, neither general study features (e.g., publication type, geographic region, and educational level) nor CT assessment contexts (e.g., the instrument used and the learning outcome measured) significantly altered the effect sizes. In contrast, pedagogical approaches did matter: technology-integrated strategies such as mixed and plugged approaches were linked to larger gender gaps favoring boys, whereas unplugged approaches tended to narrow the gap and sometimes even shifted the advantage toward girls. In terms of assessment, gender differences were not significant when CT concepts were measured, but they became significant when outcomes involved authentic practices (such as programming tasks) and identity-related dimensions (such as motivation, learning interest, and self-efficacy).

The results highlight clear implications for improving equity in CT education. Support should start early in K–12, with a particular focus on developing students’ CT practices and perspectives so that small gender gaps do not become persistent over time. Unplugged activities can serve as a low-barrier entry point, strengthening basic understanding and confidence, especially for girls. In addition, technology use should be introduced progressively: when digital and AI tools are scaffolded within supportive, culturally relevant learning settings, students may feel less anxious about technology and experience more inclusive participation.

 

Source (Open Access): Liu, S., Dai, Y., Ng, O. L., & Cai, Z. (2025). Gender Disparity in Computational Thinking Pedagogy and Assessment: A Three-Level Meta-Analysis. Educational Psychology Review, 37(4), 114.

https://doi.org/10.1007/s10648-025-10095-3… Read the rest