Publication

Outcomes reported by the Vascular Quality Initiative and the National Surgical Quality Improvement Program are not comparable

Aiello, Francesco A.
Shue, Bing
Kini, Nisha
Rosen, Amy K.
Messina, Louis M.
Robinson, William P. III
Gona, Philimon
Schanzer, Andres
Embargo Expiration Date
Abstract

OBJECTIVE: The Vascular Quality Initiative (VQI) and National Surgical Quality Improvement Program (NSQIP) have emerged as the primary vascular surgery quality measurement tools with the purpose of evaluating perioperative outcomes and assessing hospital and physician quality. VQI uses self-reporting to capture all index vascular procedures during the inpatient period. NSQIP employs nurse abstractors to capture a sample of procedures and covers 30-day events. We hypothesize that patients undergoing lower extremity bypass (LEB) will exhibit high concordance for preoperative variables and low concordance for postoperative variables between these data sets.

METHODS: All patients undergoing LEB for peripheral arterial disease at the University of Massachusetts captured in both VQI and NSQIP databases were reviewed (2007-2012). Concordance between categorical variables was assessed by kappa correlation coefficient. All postoperative variables were compared during equivalent inpatient stay. Events between discharge and 30 days postoperatively were tabulated with use of the NSQIP data set.

RESULTS: We identified 240 patients undergoing LEB captured in both VQI and NSQIP. Comparison of this identical patient cohort between VQI and NSQIP revealed a moderate to strong agreement for most preoperative variables except for congestive heart failure (kappa = 0.14) and hypertension (kappa = 0.35), which showed poor agreement. Concordance for inpatient postoperative variables was high for mortality (kappa = 1.0) and myocardial infarction (kappa = 0.86) but moderate for pulmonary complications (kappa = 0.57) and poor for unplanned return to the operating room (kappa = 0.41), wound infection (kappa = -0.01), and change in renal function (kappa = -0.01). A majority of postoperative events (71%) occurred between discharge and 30 days postoperatively, with a significantly higher incidence of wound infections in the outpatient setting (4.2% vs 95.8%; P < .0001).

CONCLUSIONS: VQI and NSQIP demonstrate substantial concordance for most preoperative variables and poor concordance for most postoperative variables, even at identical collection periods. This discordance is a result of differences in data collection methods and variable definitions. On the basis of these findings, VQI and NSQIP data sets cannot be used to directly compare risk-adjusted patient outcomes between institutions. rights reserved.

Source

J Vasc Surg. 2014 Jul;60(1):152-9, 159.e1-3. doi: 10.1016/j.jvs.2014.01.046. Link to article on publisher's site.

Year of Medical School at Time of Visit
Sponsors
Dates of Travel
DOI
10.1016/j.jvs.2014.01.046
PubMed ID
24630871
Other Identifiers
Notes
Funding and Acknowledgements
Corresponding Author
Related Resources
Related Resources
Repository Citation
Rights
Distribution License