Evaluating ChatGPT-5 for Detecting Potential Drug-Drug Interactions in Intensive Care: A Comparative Analysis With a Clinical Decision Support System

Evaluating ChatGPT-5 for Detecting Potential Drug-Drug Interactions in Intensive Care: A Comparative Analysis with a Clinical Decision Support System

Background:

Polypharmacy is a frequent challenge in intensive care units (ICUs), where critically ill patients are exposed to multiple concurrent medications. This situation significantly increases the risk of potential drug-drug interactions (pDDIs), which may contribute to adverse drug events, prolonged ICU stays, and higher morbidity and mortality rates. Ensuring timely and accurate detection of pDDIs is therefore a cornerstone of patient safety in critical care settings. Traditional rule-based clinical decision support systems (CDSSs), such as the UpToDate Drug Interaction Checker, provide standardized alerts but may have limitations in contextual interpretation and adaptability. Recently, large language models (LLMs), such as ChatGPT-4.0, have emerged as advanced tools with natural language processing capabilities, potentially offering a novel approach to medication safety.

Objective:

This study aims to compare the performance of ChatGPT-4.0 with the UpToDate Drug Interaction Checker in identifying, classifying, and interpreting potential drug-drug interactions within real ICU patient medication orders.

Methods:

A retrospective dataset of ICU patient orders will be systematically analyzed using both ChatGPT-4.0 and the UpToDate Drug Interaction Checker. Each potential interaction will be assessed for sensitivity, specificity, accuracy, and clinical relevance. Discrepancies between the two systems will be documented and evaluated by independent critical care experts. Statistical analysis will be performed to compare detection rates and the qualitative depth of interaction explanations provided by each tool.

Expected Outcomes:

The study is expected to determine whether ChatGPT-4.0, as an AI-based system, can enhance the detection of clinically meaningful drug-drug interactions compared to traditional CDSS. The results may inform future integration of generative AI into ICU clinical workflows and contribute to safer pharmacotherapy practices in critical care.

Conclusion:

By directly comparing a state-of-the-art LLM with a widely used rule-based system, this study seeks to highlight the strengths, weaknesses, and potential clinical implications of generative AI in the domain of drug safety.