卓越實證概述 Best Evidence in Brief

Programme Evaluation

Effects of language comprehension interventions on language and literacy outcomes

Language comprehension is an important component of reading that allows readers to derive meaning from oral or written language. Instructions on the components of language comprehension, including vocabulary, semantics, morphology, and syntax, may support language and reading comprehension. A meta-analysis published in Reading Research Quarterly investigated the effects of language comprehension interventions on K-5 students’ language and literacy outcomes. Three experimental designs, including RCTs, quasi-experimental control group designs, and within-subjects designs, were included in this analysis. 43 unique studies were identified and coded for design, outcome, participant (e.g., sample size, demographics, and grade levels), and intervention characteristics (e.g., duration, strategies, and components). To avoid biased estimates, effect sizes of multiple outcomes were aggregated – one synthesized effect size for each study. Findings showed that: Intervention effects were statistically significant and large for vocabulary (ES=+0.85), while modest to listening comprehension (ES=+0.10) and reading comprehension (ES =+0.19). However, the positive effects were...

05 11 2021
Impact of video-based professional development on student learning

Professional development (PD) programs using video are not uncommon to facilitate teacher learning and allow teachers to reflect on their lessons. With appropriate add-on information they can help teachers make better use of video. Chen and colleagues conducted a randomized control trial examining the efficacy of a year-long video-based PD program, using the classroom discourse analyzer (CDA) tool. CDA is a tool promoted by the authors for video-based PD, embedding data and visual information for teachers to review and reflect on classroom discourse. A sample of 46 mathematics teachers (intervention group: n=24; comparison group: n = 22) from 15 schools in Shanghai teaching 6th or 7th grade students (intervention = 882; comparison = 625) participated in the program. Teachers in both groups learned and enacted academically productive talk (APT) in the classroom discussion, and had their lessons recorded every 1-2 months throughout a year. APT is a framework that consists...

05 11 2021
The importance of monitoring the success of an intervention program

Although integrating technology into education has been found to be effective means in helping students, it may fail to produce impacts because of poor implementation. A recent cluster-random controlled trial study conducted by Mo and colleagues investigated the effect of a computer-assisted learning (CAL) program on English achievement and compared the differences in implementation of the program between institutions. The CAL program was designed to provide remedial tutoring for learning English during computer class sessions organized by a computer teacher. A balanced cohort of 120 primary schools in one of China's poorest provinces was randomized into three groups: CAL implemented by a government agency, the same program implemented by a non-government organization (NGO), and no CAL program (control schools). A total of 5,253 Grade 4 students completed the program. Both treatment groups adopted the same software packages for the tutoring, and both the government agency and the NGO conducted implementation,...

15 10 2021
Efforts to improve teacher feedback

Evaluation administrators within the Boston Public School (BPS) system received a total of 15 hours training in one of four semesters across 2013-14 to 2014-15 school years. The content focused training aimed on improving the quality and frequency of providing teacher feedback.  BPS worked in conjunction with Kraft and Christian, who recently published the results of their randomized field experiment, to evaluate the effectiveness of the training.  The researchers utilized randomized block design to assign school-based evaluation teams to one of the four training sessions. Schools assigned to fall or spring of the 2013-2014 school year served as treatment group while those trained during the fall or spring of the 2014-2015 school year served as control group. While a survey of the evaluators attending the training revealed favorable reviews of the content and an intent to implement the content in practice, surveys of teachers receiving the feedback indicated only about...

15 10 2021
Effectiveness of instructional coaching on student academic engagement

A recent randomized evaluation conducted by researchers at Rutgers University investigated the effects of Classroom Strategies Coaching Mode (CSC) on teacher outcomes and student engagement. CSC is a coaching program for teachers with the aim to increase the use of evidence-based practices in teaching and classroom management. After the identification of practice needs the coaches provide teachers with formative assessments and feedback to support implementation of practices useful to respond to their needs. The study involved 106 elementary school teachers in 14 high-poverty schools in United States. Teachers were randomly assigned to receive the intervention over 12 weeks or to a waiting list. The authors evaluated the effects of CSC on teacher outcomes, quality of instruction, and behavioral management strategies. This summary does not report teacher outcomes because they were evaluated using measures made by the researchers, which can lead to inflated results. However, student engagement in academic activities is...

15 10 2021
Effects of SWPBS Undetectable in the Long-Term

Interventions that focus on the reduction of problem behaviors and support of emotional well-being and social relationships have become increasingly popular around the globe over the past two decades. One such program, School Wide Positive Behavior Supports (SWPBS) has a solid base of evidence for improving social, emotional, and academic outcomes in the short-term. However, there is still little evidence regarding the long-term effects of this popular intervention. Borgen and colleagues examined the long-term effects of SWPBS on students’ academic failure and marginalization. Specifically, they examined short-term test scores and long-term academic grades, high school dropout, school behavior, and youth crime using population-wide Norwegian register data (N = 964,924). All Norwegian primary schools (grades 1–7) were included in the study (N = 2,366), where 216 of the schools in our sample (9%) had implemented SWPBS. The authors compared these individual-level variables between students who had attended SWPBS schools with those...

15 10 2021
Early childhood science experiences and later science achievement

While much attention centers around the impact of science instruction on achievement in middle and high school, less research focuses on early elementary exposure to inquiry science and its long-term impact on academic outcomes. As such, Kaderavek and colleagues at the University of Toledo embarked on a longitudinal investigation of one science framework-aligned intervention targeted towards students in grades 1-3. The NURTURES program covers two distinct aspects of a child’s early science experience: classroom-based science inquiry instruction and informal science practice at home. NURTURES teachers take part in a summer institute as well as academic-year professional development to better facilitate inquiry-based science practice and discussion with students. Additionally, to engage students’ families, NURTURES teachers give grade-specific family packs to students four times throughout the academic year. These packs further develop students’ use of science practices (such as hypothesis forming, experimental design, and data collection) while at home.  As a final...

01 10 2021
The importance of parental involvement in enhancing children’s literacy level

Children’s home reading under parental supervision can supplement in-class reading. A paper published in the Journal of Research on Educational Effectiveness investigated the effects of a one-year parental involvement intervention on the development of primary school children’s reading skills. The researchers adopted school-level cluster randomization and recruited 600 grade 2 students from Tanzania (12 experimental schools, 264 students; 12 control schools, 336 students). Groups were similar in terms of child’s gender, parent’s gender, parental educational level, and parental income. The intervention incorporated four parts: training sessions for teachers and parents; parents’ and children’s shared reading at home; partnership between parents and teachers; and parental involvement in children’s homework. Outcomes of interest included three dimensions of reading achievement: word decoding, reading fluency, and reading comprehension. Results showed significant enhancement in word decoding, reading fluency, and reading comprehension at the end of the one-year intervention. A follow-up assessment 8 months after the...

01 10 2021
The effect of pairs one-on-one tutoring on early grade literacy

SPARK (now renamed Future Forward), developed by the Boys & Girls Clubs of Greater Milwaukee (BGCGM) in 2005, is an early grade literacy intervention for students in high-poverty schools. As a school-community-family partnership strategy, this program seeks to improve K-3 students’ literacy skills through in-school one-on-one tutoring provided by AmeriCorps volunteers or college students with family engagement. Jones and Christian evaluated the effect of SPARK in 7 public schools in Milwaukee serving primarily low-income students of color. They randomly assigned 576 participating students in grades K-2 into either the intervention or the comparison groups. Most students were African American (79.7 %), and 95.3% qualified for free or reduced-price lunch. For those eligible to participate, most of them (85%) were not proficient in reading at baseline. After 2 years of implementation, the results indicated that: SPARK was found to have significantly positive effect on foundational literacy skills (PALS: ES = +0.23)...

01 10 2021