Using Large Language Models Such As GPT-4 to Assess Guideline Adherence in Patients with Chronic Obstructive Pulmonary Disease

Not Applicable

Recruiting

• Conditions: COPD
• Interventions: Other: LLM

• Registration Number: NCT06410547
• Lead Sponsor: Charite University, Berlin, Germany

Brief Summary

According to studies in the US and the Netherlands, 33-40% of patients with chronic conditions receive care that does not follow guideline recommendations. These findings have also been demonstrated in the management of COPD. This leads to under- or over-treatment of patients and, in the case of COPD, to exacerbations and hospitalisations. These exacerbations are a significant clinical problem, affecting patient's lung function, quality of life and mortality. They are also a burden on the healthcare system. Technological advances in artificial intelligence offer the opportunity to address these issues in COPD management. In the past year, there have been remarkable innovations in the field of natural language processing, especially through large language models such as GPT-4 from OpenAI and Bard or Gemini from Google. These models offer an opportunity to improve the implementation of evidence-based care in clinical practice.

This study is a prospective, randomised trial that will compare therapy on discharge for patients with COPD. One arm will receive no intervention, while the other arm will receive a treatment recommendation from an LLM. The study will compare the percentage of patients treated according to the guideline.

Detailed Description

Not available

Study Timeline

• Study First Submitted: 2024-04-24
• Study First Submitted QC: 2024-05-07
• Study First Posted: 2024-05-13
• Study Start: 2024-05-15
• Status Verified: 2024-12
• Primary Completion: 2024-12-31
• Last Update Submitted: 2025-02-10
• Last Update Posted: 2025-02-12
• Study Completion: 2025-03-30

Recruitment & Eligibility

• Status: RECRUITING
• Sex: All
• Target Recruitment: 70

Inclusion Criteria

• Diagnosis of COPD
• Consent
• Discharge after hospitalization

Exclusion Criteria

• Lack of Consent

Study & Design

• Study Type: INTERVENTIONAL
• Study Design: PARALLEL

Arm && Interventions

Group	Intervention	Description
LLM Recommendation	LLM	On admission, an LLM is asked to indicate the guideline-concordant therapy that the patient should receive. The information is sent to the treating physician.

Primary Outcome Measures

Name	Time	Method
Percentage of patients treated in concordance with treatment guidelines at the time of hospital discharge	From date of admission (which is enrollment) to the date of discharge, assessed up to one month	This primary endpoint will assess the percentage of guideline-concordant treatments in each study arm.
Adherence to treatment guidelines at the time of hospital discharge	From date of admission (which is enrollment) to the date of discharge, assessed up to one month	The primary endpoint will assess whether the treatment at the time of discharge is consistent with the guidelines' recommendations. This is a binary outcome measure of yes or no.

Trial Locations

Locations (1)

Charité University; 🇩🇪 Berlin, Germany