Let's chat about cervical cancer: Assessing the accuracy of ChatGPT responses to cervical cancer questions

Artificial Intelligence (AI) is a rapidly evolving field with significant applications across many professions, including medicine. ChatGPT is a next-generation large language model that utilizes training on an expansive data set to be able to generate human-like responses to user input on a wide range of topics [1]. Its capabilities have led to a viral phenomenon; within two months of its launch in November 2022 by OpenAI, it accumulated over 100 million users, and began generating over 1.5 billion visits per month. Its utility in the medical field is an area of active exploration; not only did ChatGPT achieve a passing score on the USMLE Step 1 exam [2], but when ChatGPT's answers to patient questions were compared with those of physicians, the ChatGPT responses were rated as higher quality and more empathetic [3]. It has also demonstrated accuracy in answering specialty-specific questions in bariatric surgery, cirrhosis and hepatocellular carcinoma, and cardiovascular disease [[4], [5], [6]].

There are no studies to date evaluating ChatGPT's proficiency in generating responses to commonly asked questions pertaining to cervical cancer. Since the majority of ChatGPT users are 18–44 years old, corresponding to the ages at which many patients may have questions regarding HPV vaccination, cervical dysplasia, and cervical cancer, we anticipate that ChatGPT will become a key resource for these women to turn for answers. Furthermore, well-documented disparities exist with regard to HPV vaccination, cervical cancer screening, and cervical cancer incidence and mortality [[7], [8], [9], [10]]. Given the widespread use of ChatGPT, if the information it provides were demonstrated to be accurate in addition to easily accessible, it could potentially serve as a tool to help combat these disparities. This study therefore aims to assess the accuracy of ChatGPT in answering commonly asked questions about cervical cancer prevention, diagnosis, treatment, and quality of life.

Comments (0)

No login
gif