Comparing the Quality of ChatGPT- and Physician-Generated Responses to Patients' Dermatologic Questions in the Electronic Medical Record
September 2024
in “
Journal of the American Academy of Dermatology
”
TLDR Physician responses are better than ChatGPT for dermatology questions.
This study evaluated the quality of responses generated by ChatGPT compared to those from dermatology physicians for patient-submitted questions. Thirty-one messages were analyzed by ten blinded reviewers, including both physicians and non-physicians. The results showed a strong preference for physician-generated responses, which were rated higher in terms of readability and empathy. Despite the potential of AI tools like ChatGPT, the study concludes that physician responses are currently superior for patient inquiries in dermatology. The study's small sample size is noted as a limitation.