Evaluating the Impact of Data Analytics Training in Health Professions Education: A Pretest-Posttest Analysis

Background: In health professions education, data analytics is increasingly recognized as a critical skill for educators to enhance decision-making and improve student outcomes. A session on data analytics was conducted as part of a Postgraduate Certificate in Health Professions Education (PGCHPE) program to equip educators with foundational skills in data analysis and interpretation. Immediate effectiveness of educational interventions is critical for justifying delivery of a course or workshop to readjust the learning outcomes. Pretest-posttest data analytics offers an evidence-based approach to evaluate short-term learning gains. Aims and Objectives: This evaluation aimed to determine whether the training effectively improved participants’ understanding of core data analytics concepts and their ability to apply these skills in educational settings. The objective of this study was to determine the immediate impact of the session using a pretest-posttest design to assess participants’ knowledge and confidence before and after the session. Methods: A one-group pretest-posttest design was employed. Participants (n = 22) enrolled in the Postgraduate Certificate Programme of Health Profession Education (PGCHPE) completed a knowledge-based assessment immediately before and after the intervention. Descriptive statistics, paired sample t-tests, and effect size (Cohen’s d) were used to analyse the data. Results: Mean pretest score was 70.90 (11.72), which increased to 86.34 (11.58) in the posttest. The difference was statistically significant, t = 3.18 (9), p < 0.05). The effect size (Cohen’s d = 1.009) indicated a large immediate impact of the intervention. Conclusions: The pretest-posttest data analytics confirmed a statistically significant immediate improvement in learners’ knowledge. This supports the intervention’s effectiveness and provides justification for its continued or expanded use. Keywords: Data analytics, Educational intervention, Effect size, Immediate impact, Pretest-posttest. Shahid Hassan1, Sonia Jaiswal2, Gauhar Hassan3 1Department of Anatomy, American University of Barbados School of Medicine, School of Medicine, Barbados. 2Department of Medical Education, American University of Barbados School of Medicine, School of Medicine, Barbados. 3Department of Anatomy, Era's Lucknow Medical College and Hospital, Era University, Lucknow, UP, India

Download PDF View in XML View in DOI