Enhancing critical thinking in introductory programming through artificial intelligence and socratic metacognitive inquiry-based learning environment

The National Science Foundation awarded The Research Foundation for the State University of New York, operating as Farmingdale State College, $164,178 on January 1, 2026, under the STEM Education program to develop and evaluate the Socratic Metacognitive Inquiry-Based Learning Environment (SMILE), a framework designed to enhance critical thinking and metacognitive skills among undergraduate computer science students through structured use of artificial intelligence and large language models.

The project will implement and assess SMILE's effectiveness in promoting critical thinking by comparing guided AI use within the framework against unguided AI use in introductory programming courses. Research will employ mixed-methods design including interviews and structured observational studies to examine how the framework develops long-term metacognitive development in computer science. The work will generate validated rubrics, instructional exercises, and evidence-based guidelines for integrating AI into computing education, along with publicly available instructional materials and faculty training resources aligned with workforce needs in an AI-augmented economy.

Performance takes place in Farmingdale, New York, with a period of performance running through December 31, 2028. The award is classified as a Project Grant under the Engaged Student Learning track of NSF's IUSE: EDU program, which supports research and development to improve STEM education effectiveness.

Abstract

This project aims to serve the national interest by strengthening critical thinking and independent learning among undergraduate students through the responsible use of artificial intelligence (AI) in computer science classes. As large language models (LLMS) become increasingly integrated into education, there is a pressing need to support students in using these tools thoughtfully, rather than relying on them passively. This level 1 engaged student learning project will implement and evaluate the socratic metacognitive inquiry-based learning environment (SMILE), an innovative framework that guides students in developing deeper programming and critical thinking skills by combining structured socratic questioning with metacognitive reflection. Broader impacts include publicly available instructional materials that develop analytical reasoning skills, faculty training, and alignment with workforce needs in an AI-augmented economy. The project plans to investigate the impact of unguided AI use on student critical thinking and compare IT to SMILE-guided approaches. Using a mixed-methods design, which includes interviews and structured observational studies, the research examines the SMILE framework's effectiveness in promoting critical thinking and long-term metacognitive development in computer science, advancing the understanding of structured frameworks as an effective AI-driven pedagogy. Expected outcomes include validated rubrics, instructional exercises, and evidence-based guidelines for integrating AI into computing education. The NSF iuse: EDU program supports research and development projects to improve the effectiveness of stem education for all students. Through the engaged student learning track, the program supports the creation, exploration, and implementation of promising practices and tools. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the foundation's intellectual merit and broader impacts review criteria.- subawards are not planned for this award.