Piloting Standardized Immediate Student Evaluation of Lectures in Pre-Clinical Years

Abstract

Background: In the first and second years at the University of Massachusetts Medical school, students assess a faculty member’s lecture weeks to months after it was given. Students may not recall details of the lecture due to the delay. The timing of this feedback may impact the faculty member’s ability to institute change for their current students, as well as for the subsequent year’s students. Objective: The purpose of the pilot was to assess the feasibility and perceived usefulness of a specific method for obtaining immediate student feedback after every lecture, and providing this feedback to faculty within days after delivering a lecture. Methods: 34 second year students self-identified to participate after email solicitation to the whole class (140 students, yielding 24.2%). A questionnaire to solicit immediate post-lecture feedback was developed based on a sample from the published educational literature and reviewed by a student focus group. This group assessed time to complete the questionnaire, clarity of questions, and provided suggestions of unaddressed topics. For a two- week period, the self-identified students completed the questionnaire after each lecture. The questionnaire consisted of twenty questions using a 4-point likert scale plus three short answer questions. These questions were based on five components/elements of an effective lecture -- clarity, interaction, task orientation, enthusiasm, and organization. Completed questionnaires were sent by interoffice mail directly to the lecturer on the same day. Both students and faculty were asked to complete an online survey using Survey Monkey regarding their experience in this pilot evaluation process (data collection ongoing). Likert data from the questionnaire was entered into excel, and then analyzed using SPSS version 18. Data reported will focus on characteristics of the survey and process. Results: Data analysis is ongoing. The student response rate was on average 12 completed questionnaires for a given lecture with a range of 2 to 23. Conclusion: Preliminary data is currently being analyzed with a goal of informing and providing direction for the design and institution of a new feedback process. Such a process, where faculty receive timely student feedback, may enhance and improve teaching and learning during the pre-clinical years and promote an evolving curriculum. Presented as part of the Senior Scholars Program at the University of Massachusetts Medical School, May 3, 2010.