Performance of <scp>ChatGPT</scp> in French language Parcours d'Accès Spécifique Santé test and in <scp>OBGYN</scp>-Reference-Cited by-同舟云学术

Performance of ChatGPT in French language Parcours d'Accès Spécifique Santé test and in OBGYN

Published:2023-09 Issue: Volume: Page:
ISSN:0020-7292
Container-title:International Journal of Gynecology & Obstetrics
language:en
Short-container-title:Intl J Gynecology & Obste

Author:

Guigue Paul‐Adrien¹²,Meyer Raanan³⁴⁵,Thivolle‐Lioux Gaetan¹⁶,Brezinov Yoav²,Levin Gabriel²⁷^ORCID

Affiliation:

1. University Claude Bernard Lyon I Lyon France

2. Lady Davis Institute for Cancer Research, Jewish General Hospital McGill University Montreal Quebec Canada

3. Department of Obstetrics and Gynecology Chaim Sheba Medical Center Ramat‐Gan Israel

4. Faculty of Medicine Tel‐Aviv University Tel‐Aviv Israel

5. Cedar‐Sinai Medical Center Los Angeles California USA

6. Centre de Recherche en Cancérologie de Lyon (CRCL) Lyon France

7. The Department of Gynecologic Oncology, Hadassah Medical Center, Faculty of Medicine Hebrew University of Jerusalem Jerusalem Israel

Abstract

AbstractObjectivesTo evaluate the performance of ChatGPT in a French medical school entrance examination.MethodsA cross‐sectional study using a consecutive sample of text‐based multiple‐choice practice questions for the Parcours d'Accès Spécifique Santé. ChatGPT answered questions in French. We compared performance of ChatGPT in obstetrics and gynecology (OBGYN) and in the whole test.ResultsOverall, 885 questions were evaluated. The mean test score was 34.0% (306; maximal score of 900). The performance of ChatGPT was 33.0% (292 correct answers, 885 questions). The performance of ChatGPT was lower in biostatistics (13.3% ± 19.7%) than in anatomy (34.2% ± 17.9%; P = 0.037) and also lower than in histology and embryology (40.0% ± 18.5%; P = 0.004). The OBGYN part had 290 questions. There was no difference in the test scores and the performance of ChatGPT in OBGYN versus the whole entrance test (P = 0.76 vs P = 0.10, respectively).ConclusionsChatGPT answered one‐third of questions correctly in the French test preparation. The performance in OBGYN was similar.

Publisher

Wiley

Subject

Obstetrics and Gynecology,General Medicine

Link

https://obgyn.onlinelibrary.wiley.com/doi/pdf/10.1002/ijgo.15083

Reference16 articles.

1. Numerus clausus et démographie médicale en France;Huguier M;Bull Acad Natl Med,2014

2. Country report: medical education in France;Segouin C;Med Educ,2007

3. The choice of a medical career in a population of 600 second‐cycle French medical students preparing the national‐ranking exam;Rouprêt M;Presse Med,2005

4. The keys to success in French Medical National Ranking Examination: integrated training activities in teaching hospital and medical school;Gillois P;Presse Med,2015

5. Predictive factors of success at the French National Ranking Examination (NRE): a retrospective study of the student performance from a French medical school;Lhuaire M;BMC Med Educ,2019

Cited by 7 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Language discrepancies in the performance of generative artificial intelligence models: an examination of infectious disease queries in English and Arabic;BMC Infectious Diseases;2024-08-08

2. Comparison of the Performance of ChatGPT, Claude and Bard in Support of Myopia Prevention and Control;Journal of Multidisciplinary Healthcare;2024-08

3. Comparative accuracy of ChatGPT-4, Microsoft Copilot and Google Gemini in the Italian entrance test for healthcare sciences degrees: a cross-sectional study;BMC Medical Education;2024-06-26

4. Performance of ChatGPT on Chinese Master’s Degree Entrance Examination in Clinical Medicine;PLOS ONE;2024-04-04

5. A scoping review of artificial intelligence in medical education: BEME Guide No. 84;Medical Teacher;2024-02-29