BEYOND GRADES TO LEARNING ENHANCEMENT: DEVELOPMENT, IMPLEMENTATION, AND EVALUATION OF A CONVERSATIONAL AI AGENT IN MEDICAL EDUCATION
Date
2026-05-12
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Deanship of Scientific Research - Al-Quds University
Abstract
Background: Artificial intelligence (AI) is transforming medical education by offering personalized, interactive learning. However, evidence on their educational impact remains limited. Objective: To evaluate the educational impact of a custom GPT agent for undergraduate medical students. Methodology: The intervention involved the development and deployment of a curriculum-aligned custom GPT-4 conversational agent supporting individualized learning in a 4-week pharmacology block in Year 2 of MBBS program at the College of Medicine, Sulaiman Alrajhi University in 2024-2025 academic year. A mixed-
Methods: A sequential-explanatory design was conducted for its evaluation after the block. Phase 1 included a survey with the enrolled students (n=58) assessing usage, perceptions, and satisfaction, alongside a comparative analysis with two historical cohorts (2022–2023, n=33; 2023–2024, n=37). Phase 2 involved semi-structured interviews with nine volunteers. Quantitative data were analyzed using SPSS v28, and qualitative data via thematic analysis. Ethical approval was obtained prior to the start of the block. Informed consent was also obtained from all the students at the start of the block.