Prostatakarzinomforschung verständlich gemacht: ChatGPT-4 als Werkzeug zur Verbesserung der Laienkommunikation

Translated title of the contribution: Making prostate cancer research accessible: chatGPT-4 as a tool to enhance lay communication

Maximilian Haas, Veronika Saberi, Christopher Gossler, Anna Schmelzer, Anton Kravchuk, Johannes Breyer, Johannes Bründl, Simon Engelmann, Clemens Kirschner, Christian Gilfrich, Maximilian Burger, Dominik von Winning, Christian Wülfing, Hendrik Borgmann, Severin Rodler, Axel S. Merseburger, Emily Rinderknecht, Matthias May*

*Corresponding author for this work

Abstract

Background and objective: The abundant potential arising from various applications of artificial intelligence is gradually influencing academic and scientific communication. This study examines the suitability of ChatGPT‑4 for generating layperson’s summaries (LS) of scientific articles published in the four journals within the European Urology family and compares the quality of these newly generated LS with the original texts. Methods: A total of 327 articles on prostate cancer published between January 1, 2023, and June 30, 2024, were analyzed. ChatGPT‑4 generated patient summaries using both a basic and an advanced prompt, the latter specifically optimized for enhancing readability. Readability was assessed using established indices, while two blinded reviewers evaluated content quality on a 5-point Likert scale. Additionally, readability, content quality, and adherence to journal guidelines were combined into an overall scoring system. Results: The advanced prompt led to significantly improved readability compared to the basic prompt (p < 0.001) and the original LS (p < 0.001). Content quality was comparable between the two ChatGPT‑4 prompts (p = 0.665) but was higher than that of the original summaries (p = 0.001 and p = 0.002, respectively). Both prompts demonstrated superior adherence to journal guidelines (p < 0.001), with error-free LS rates of 29.4% (original), 76.1% (basic prompt), and 92% (advanced prompt) (p < 0.001). Conclusion: ChatGPT‑4 is a validated and effective tool for generating LS, offering superior readability and high compliance with editorial guidelines. It has the potential to assist researchers and scientific journals in enhancing the accessibility and comprehensibility of scientific content, thereby, improving patient engagement and understanding.

Translated title of the contributionMaking prostate cancer research accessible: chatGPT-4 as a tool to enhance lay communication
Original languageGerman
JournalUrologie
Volume64
Issue number6
Pages (from-to)574-583
Number of pages10
ISSN2731-7064
DOIs
Publication statusPublished - 01.2025

Research Areas and Centers

  • Research Area: Luebeck Integrated Oncology Network (LION)
  • Centers: Center for Artificial Intelligence Luebeck (ZKIL)

DFG Research Classification Scheme

  • 2.22-23 Reproductive Medicine, Urology
  • 4.43-04 Artificial Intelligence and Machine Learning Methods
  • 2.22-02 Public Health, Healthcare Research, Social and Occupational Medicine

Fingerprint

Dive into the research topics of 'Making prostate cancer research accessible: chatGPT-4 as a tool to enhance lay communication'. Together they form a unique fingerprint.

Cite this