The Evaluation of a Real-time Natural Language Processing Decision Support Tool for Screening Opioid Misuse With Addiction Consult Intervention for Hospitalized Adults

The clinical narrative in the electronic health record (EHR) carries valuable information for predictive analytics, but its free-text form is difficult to mine and analyze for clinical decision support (CDS). Large-scale clinical natural language processing (NLP) pipelines have focused on data warehouse applications for retrospective research efforts. There remains a paucity of evidence for implementing open-source NLP pipelines to provide interoperable and standardized CDS at the bedside for health operations.

Enterprise Analytics and Applied Data Science at UWHealth have helped the health system grow its IT infrastructure to support a data-driven Learning Health System (LHS) capable of Artificial Intelligence (AI)-augmented decision-making at the bedside.

This is a clinical study to implement and evaluate a hospital-wide, operational intervention for a real-time NLP-driven CDS tool, called Substance Misuse Algorithm for Referral to Treatment Using Artificial Intelligence (SMART-AI). The SMART-AI CDS tool will be evaluated via implementation in the UW Health electronic health record. The CDS tool is meant for screening inpatient adults for opioid misuse as part of a best practice alert to nurses and providers for addiction consult service needs. The tool is part of a quality improvement initiative with approvals from hospital committees, including the Clinical AI and Predictive Analytics Committee. The primary outcome was the percentage of inpatients who screened positive (or would have screened positive) based on the NLP CDS tool who received an addiction consult with any of the following interventions: (1) receipt of opioid use intervention or motivational interviewing (MI); (2) receipt of medication-assisted treatment (MAT); and/or (3) referral to substance use disorder treatment. The primary outcome will be reported as a percentage in the pre- and post-intervention periods and consisted of substance use screening and treatment service engagement for hospitalized patients screened for opioid misuse. Secondary outcomes included the 30-day unplanned hospital readmission rate. Criteria for unplanned hospital readmissions were adopted from the Centers for Medicare & Medicaid Services.

Substance misuse is a common problem in hospitalized patients associated with poor health outcomes, but it is not prioritized and frequently unaddressed during routine care. Current approaches for screening at UW are not done and other health systems use structured diagnostic interviews that require additional staffing and effort during clinical care. Important details about substance use are captured in the clinical notes of the electronic health record but the data are difficult to mine and analyze. Natural language processing and machine learning can be trained to identify relevant findings in the notes to automatically screen patients with substance misuse.

The Investigators trained a convolutional neural network to screen and identify alcohol misuse, opioid misuse, and non-opioid drug misuse with high accuracy using ICD diagnostic codes and admission notes collected during clinical care. The derived algorithm is called Substance Misuse Algorithm for Referral to Treatment Using Artificial Intelligence (SMART-AI). The screening tool uses methods in natural language processing to screen hospitalized patients to prioritize care focused on their substance misuse. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3922677