In American journal of obstetrics and gynecology
Natural Language Processing (NLP) - the branch of artificial intelligence (AI) concerned with the interaction between computers and human language - has advanced markedly in recent years with the introduction of sophisticated deep learning models. Improved performance in NLP tasks such as text and speech processing have fueled impressive demonstrations of these models' capabilities. Perhaps no demonstration has been more impactful to date than with the introduction of the publicly available online chatbot "ChatGPT" in November 2022 by OpenAI which is based on an NLP model known as a GPT (Generative Pretrained Transformer). Through a series of questions posed by the authors about Obstetrics and Gynecology to ChatGPT as prompts, we evaluated the model's ability to handle clinical related queries. Its answers demonstrate that in its current form, ChatGPT can be valuable for users who want preliminary information about virtually any topic in the field. As its educational role is being defined, we must recognize its limitations. While answers were generally eloquent, informed and lacked a significant degree of mistakes or misinformation, we also observed evidence of its weaknesses. A significant drawback is that the data on which the model has been trained are apparently not readily updated. The model assessed here seems to not reliably (if at all) source data after 2021. Users of ChatGPT who expect data to be more up to date need to be aware of this drawback. Inability to cite sources or truly understand what the user is asking suggests it has the capability to mislead. Responsible use of models like ChatGPT will be important in ensuring that they work to help but not harm users seeking information in Obstetrics and Gynecology.
Grünebaum Amos, Chervenak Joseph, Pollet Susan L, Katz Adi, Chervenak Frank A
2023-Mar-14
AI, ChatGPT, artificial Intelligence, cesarean, chatbots, ethics, gynecology, home birth, informed consent, maternal-fetal medicine, obstetrics, oncology, preeclampsia, prematurity, preterm birth, progesterone, reproductive medicine, short cervix, vaginal progesterone
