Browsing by keyword "video interviews"
Now showing items 1-3 of 3
-
Applicant Reactions to the AAMC Standardized Video Interview During the 2018 Application CyclePURPOSE: This study examined applicant reactions to the Association of American Medical Colleges (AAMC) Standardized Video Interview (SVI) during its first year of operational use in emergency medicine (EM) residency program selection in order to identify strategies to improve applicants' SVI experience and attitudes. METHOD: Individuals who self-classified as EM applicants applying in the Electronic Residency Application Service 2018 cycle and completed the SVI in summer 2017 were invited to participate in two surveys. Survey 1, which focused on procedural issues, was administered immediately after SVI completion. Survey 2, which focused on applicants' SVI experience, was administered in fall 2017, after SVI scores were released. RESULTS: The response rates for surveys 1 and 2 were 82.3% (2,906/3,532) and 58.7% (2,074/3,532), respectively. Applicant reactions varied by aspect of the SVI studied and their SVI total scores. Most applicants were satisfied with most procedural aspects of the SVI, but most applicants were not satisfied with the SVI overall or with their total SVI scores. About 20-30% of applicants had neutral opinions about most aspects of the SVI. Negative reactions to the SVI were stronger for applicants who scored lower on the SVI. CONCLUSIONS: Applicants had generally negative reactions to the SVI. Most were skeptical of its ability to assess the target competencies and its potential to add value to the selection process. Applicant acceptance and appreciation of the SVI will be critical to the SVI's acceptance by the graduate medical education community.
-
Innovation in Residency Selection: The AAMC Standardized Video InterviewPURPOSE: Innovative tools are needed to help shift residency selection toward a more holistic process that balances academic achievement with other knowledge and skills important for success in residency. The authors evaluated the feasibility of the AAMC Standardized Video Interview (SVI) and evidence of the validity of SVI total scores. METHOD: The SVI, developed by the Association of American Medical Colleges, consists of six questions designed to assess applicants' interpersonal and communication skills and knowledge of professionalism. Study 1 was conducted in 2016 for research purposes. Study 2 was an operational pilot administration in 2017; SVI data were available for residency selection use by emergency medicine residency programs for the 2018 application cycle. Descriptive statistics, correlations, and standardized mean differences were used to examine data. RESULTS: Study 1 included 855 applicants; Study 2 included 3,532 applicants. SVI total scores were relatively normally distributed. There were small correlations between SVI total scores and United States Medical Licensing Examination Step exam scores, Alpha Omega Alpha Honor Medical Society membership, and Gold Humanism Honor Society membership. There were no-to-small group differences in SVI total scores by gender and race/ethnicity, and small-to-medium differences by applicant type. CONCLUSIONS: Findings provide initial evidence of the validity of SVI total scores and suggest these scores provide different information than academic metrics. Use of the SVI, as part of a holistic screening process, may help program directors widen the pool of applicants invited to in-person interviews and may signal that programs value interpersonal and communication skills and professionalism.
-
The AAMC Standardized Video Interview: Reactions and Use by Residency Programs During the 2018 Application CyclePURPOSE: To evaluate how emergency medicine (EM) residency programs perceived and used Association of American Medical Colleges (AAMC) SVI total scores and videos during the Electronic Residency Application Service (ERAS) 2018 cycle. METHOD: Study 1 (November 2017) used a program director survey to evaluate user reactions to the SVI following the first year of operational use. Study 2 (January 2018) analyzed program usage of SVI video responses using data collected through the AAMC Program Director's Workstation. RESULTS: Results from the survey (125/175 programs, 71% response rate) and video usage analysis suggested programs viewed videos out of curiosity and to understand the range of SVI total scores. Programs were more likely to view videos for attendees of U.S. MD-granting medical schools and applicants with higher United States Medical Licensing Examination Step 1 scores, but there were no differences by gender or race/ethnicity. More than half of programs that did not use SVI total scores in their selection processes were unsure of how to incorporate them (36/58, 62%) and wanted additional research on utility (33/58, 57%). More than half of programs indicated being at least somewhat likely to use SVI total scores (55/97; 57%) and videos (52/99; 53%) in the future. CONCLUSIONS: Program reactions on the utility and ease of use of SVI total scores were mixed. Survey results indicate programs used the SVI cautiously in their selection processes, consistent with AAMC recommendations. Future surveys of SVI users will help the AAMC gauge improvements in user acceptance and familiarity with the SVI.


