Objectives: Many routine patient care items should be reviewed at least daily for intensive care unit (ICU) patients. These items are often incompletely performed, and dynamic clinical decision support tools (CDSTs) may improve attention to these daily items. We sought to evaluate the accuracy of institutionalized electronic health record (EHR) based custom dynamic CDST to support 22 ICU rounding quality metrics across 7 categories (hypoglycemia, venothromboembolism prophylaxis, stress ulcer prophylaxis, mechanical ventilation, sedation, nutrition, and catheter removal).

Design: The dynamic CDST evaluates patient characteristics and patient orders, then identifies gaps between active interventions and conditions with recommendations of evidence based clinical practice guidelines across 22 areas of care for each patient. The results of the tool prompt clinicians to address any identified care gaps. We completed a confusion matrix to assess the sensitivity, specificity, accuracy, positive predictive value (PPV), and negative predictive value (NPV) of the dynamic CDST and the individual metrics.

Setting: Tertiary academic medical center and community hospital ICUs.

Subject: Customized Clinical Decision Support Tool.

Measurements and main results: The metrics were evaluated 1421 times over 484 patients. The overall accuracy of the entire dynamic CDST is 0.979 with a sensitivity of 0.979, specificity of 0.978, PPV 0.969, and NPV 0.986.

Conclusions: A customized, EHR based dynamic CDST can be highly accurate. Integrating a comprehensive dynamic CDST into existing workflows could improve attention and actions related to routine ICU quality metrics.