The aim of this study is to assess the usability of the information generated by ChatGPT in oral and maxillofacial surgery. This assessment will have two components: Firstly, to measure the quality of patient information provided, and secondly, to measure the quality of educational information in this field.

Commonly asked questions by patients about oral and maxillofacial surgical procedures and technical questions for training purposes were selected to be posed to ChatGPT. The questions were divided into two categories, consisting of 60 Patient Questions and 60 Technical Questions. The specific topics covered were Impacted Teeth, Dental Implants, Temporomandibular Joint Diseases, and Orthognathic Surgery. ChatGPT provided responses to these questions on February 23, 2023. The answers were evaluated by oral and maxillofacial surgeons using a modified global quality scale.

The study involved 33 participating surgeons. The mean score for the answers to the Patient Questions was 4.62±0.78, while the mean score for answers to the Technical Questions was 3.1 ± 1.49. The difference in scores between the two question categories was found to be statistically significant (P<0.001). There was no significant difference between the quality of the answers given to the questions across the different topics (P>0.05).

ChatGPT has significant potential as a tool for patient information in oral and maxillofacial surgery. However, its use in training may not be completely safe at present. Surgeons should exercise caution when using ChatGPT and consider it as a supplement to their clinical knowledge and experience.