ChatGPT and oral cancer: a study on informational reliability
Yazarlar (1)
Dr. Öğr. Üyesi Mesude ÇİTİR
Tokat Gaziosmanpaşa Üniversitesi, Türkiye
| Makale Türü |
Özgün Makale
|
| Makale Alt Türü | SSCI, AHCI, SCI, SCI-Exp dergilerinde yayınlanan tam makale |
| Dergi Adı | BMC Oral Health |
| Dergi ISSN | 1472-6831 Wos Dergi Scopus Dergi |
| Dergi Tarandığı Indeksler | SCI-Expanded |
| Dergi Grubu | Q1 |
| Makale Dili | İngilizce |
| Basım Tarihi | 01-2025 |
| Cilt No | 25 |
| Sayı | 1 |
| Sayfalar | 2 / 7 |
| DOI Numarası | 10.1186/s12903-025-05479-4 |
| Makale Linki | https://bmcoralhealth.biomedcentral.com/articles/10.1186/s12903-025-05479-4#citeas |
| Özet |
| Artificial intelligence (AI) and large language models (LLMs) like ChatGPT have transformed information retrieval, including in healthcare. ChatGPT, trained on diverse datasets, can provide medical advice but faces ethical and accuracy concerns. This study evaluates the accuracy of ChatGPT-3.5's answers to frequently asked questions about oral cancer, a condition where early diagnosis is crucial for improving patient outcomes. A total of 20 questions were asked to ChatGPT-3.5, selected from Google Trends and questions asked by patients in the clinic. The responses provided by ChatGPT were evaluated for accuracy by medical oncologists and oral and maxillofacial radiologists. Inter-rater agreement was assessed using Fleiss's and Cohen kappa tests. The scores given by the specialties were compared with the Mann-Whitney U test. The references provided by ChatGPT-3.5 were evaluated for authenticity. Of the 80 responses from 20 questions, 41 (51.25%) were rated as very good, 37 (46.25%) as good, 2 (2.50%) as acceptable. There was no significant difference between oral and maxillofacial radiologists and medical oncologists in all 20 questions. Of the 81 references to ChatGPT-3.5 answers, only 13 were scientific articles, 10 were fake, and the remaining references were data from websites. ChatGPT provided reliable information about oral cancer and did not provide incorrect information and suggestions. However, all information provided by ChatGPT is not based on real references. |
| Anahtar Kelimeler |
| Accuracy | Artifical intelligence | ChatGPT | Oral cancer |
BM Sürdürülebilir Kalkınma Amaçları
| Atıf Sayıları | |
| WoS | 5 |