Yan et al. (2025) examine whether integrating large language models (LLMs) into collaborative programming can enhance students’ computational thinking, self-efficacy, and learning processes. Recognizing that traditional collaborative programming is often constrained by uneven skill levels among students, the study proposes an LLM-supported collaborative framework in which AI acts as a learning partner, transforming the conventional human–human interaction into a human–human–AI collaboration model. A quasi-experimental design was conducted with 82 sixth- and seventh-grade students in China, who were randomly assigned to either an LLM-supported collaborative programming group (experiment group) or a traditional collaborative programming group (control group).
The intervention lasted five weeks and included 12 programming sessions (90 min each) using C++ as the instructional language. Students in both groups worked in teams, but the experimental group used an LLM-based platform that provided structured, problem-based, and knowledge-based scaffolding throughout the programming process, including problem analysis, coding, debugging, and evaluation. Pre- and post-tests measured students’ computational thinking and self-efficacy, while cognitive load was assessed through questionnaires, complemented by semi-structured interviews.
Results indicate that students in the LLM-supported collaborative programming group achieved significantly higher gains in computational thinking compared to those in the traditional group, though the effect size was relatively small. In addition, students in the experimental group reported significantly lower cognitive load, particularly in mental load, suggesting that LLMs can reduce the cognitive burden associated with complex programming tasks. However, no statistically significant differences were found in self-efficacy between the two groups. Both groups showed a decline in self-efficacy over time, likely due to the transition from graphical programming to more abstract text-based coding, though the decline was less pronounced in the LLM-supported group.
Qualitative findings further reveal that LLM integration enhanced students’ learning experiences by increasing interest, improving problem-solving efficiency, and supporting collaboration. Students reported that LLMs provided immediate feedback, multiple solution strategies, and personalized guidance, enabling more effective engagement in programming tasks. Overall, the study demonstrates that LLMs can function as effective scaffolding tools in collaborative learning, reducing cognitive load and enhancing higher-order thinking. While their impact on self-efficacy remains inconclusive, the findings highlight the potential of AI-supported collaborative learning environments as a promising approach for programming education in K–12 contexts.
Source (Open Access): Yan, Y. M., Chen, C. Q., Hu, Y. B., & Ye, X. D. (2025). LLM-based collaborative programming: Impact on students’ computational thinking and self-efficacy. Humanities and Social Sciences Communications, 12(1), 149.https://doi.org/10.1057/s41599-025-04471-1… Read the rest