Improved Performance of ChatGPT-4 on the OKAP Exam: A Comparative Study with ChatGPT-3.5 [preprint]
Document Type
PreprintPublication Date
2023-04-03Keywords
ChatGPTartificial intelligence
Ophthalmology Knowledge Assessment Program (OKAP) examination
medical knowledge assessment
medical education
Metadata
Show full item recordAbstract
This study aims to evaluate the performance of ChatGPT-4, an advanced Artificial Intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5. Both models were tested on 180 OKAP practice questions covering various ophthalmology subject categories. Results showed that ChatGPT-4 significantly outperformed ChatGPT-3.5 (81% vs. 57%; p<0.001), indicating improvements in medical knowledge assessment. The superior performance of ChatGPT-4 suggests potential applicability in ophthalmologic education and clinical decision support systems. Future research should focus on refining AI models, ensuring a balanced representation of fundamental and specialized knowledge, and determining the optimal method of integrating AI into medical education and practice.Source
Improved Performance of ChatGPT-4 on the OKAP Exam: A Comparative Study with ChatGPT-3.5. Sean Teebagy, Lauren Colwell, Emma Wood, Antonio Yaghy, Misha Faustina. medRxiv 2023.04.03.23287957; doi: https://doi.org/10.1101/2023.04.03.23287957DOI
10.1101/2023.04.03.23287957Permanent Link to this Item
http://hdl.handle.net/20.500.14038/51914Notes
This article is a preprint. Preprints are preliminary reports of work that have not been certified by peer review.Funding and Acknowledgements
This study did not receive any funding.Rights
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.; Attribution-NoDerivatives 4.0 InternationalDistribution License
http://creativecommons.org/licenses/by-nd/4.0/Scopus Count
The following license files are associated with this item:
- Creative Commons
Except where otherwise noted, this item's license is described as The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.