Automated, Machine Learning‐Based Alerts Increase Epilepsy Surgery Referrals: A Randomized Controlled Trial

Abstract

Objective

To determine whether automated, electronic alerts increased referrals for epilepsy surgery.

Methods

We conducted a prospective, randomized controlled trial of a natural language processing-based clinical decision support system embedded in the electronic health record (EHR) at 14 pediatric neurology outpatient clinic sites. Children with epilepsy and at least two prior neurology visits were screened by the system prior to their scheduled visit. Patients classified as a potential surgical candidate were randomized 2:1 for their provider to receive an alert or standard of care (no alert). The primary outcome was referral for a neurosurgical evaluation. Likelihood of referral was estimated using a Cox proportional hazards regression model.

Results

Between April 2017 and April 2019, 4,858 children were screened by the system, and 284 (5.8%) were identified as potential surgical candidates. 204 patients received an alert, and 96 patients received standard care. Median follow-up time was 24 (range: 12 to 36) months. Compared to the control group, patients whose provider received an alert were more likely to be referred for a presurgical evaluation (3.1% vs. 9.8%; adjusted HR = 3.21 [95% CI: 0.95 to 10.8]; one-sided p = 0.03). Nine patients (4.4%) in the alert group underwent epilepsy surgery, compared to none (0%) in the control group (one-sided p = 0.03).

Significance

Machine learning-based automated alerts may improve the utilization of referrals for epilepsy surgery evaluations.

0