Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial
Kiefe, Catarina I. ; Allison, Jeroan J. ; Williams, O. Dale ; Person, Sharina D. ; Weaver, Michael T. ; Weissman, Norman W.
Citations
Student Authors
Faculty Advisor
Academic Program
UMass Chan Affiliations
Document Type
Publication Date
Keywords
Alabama
Ambulatory Care
*Benchmarking
Blood Glucose
Cholesterol
Diabetes Mellitus
Diabetic Foot
Education, Medical, Continuing
Fee-for-Service Plans
Feedback
Hematologic Tests
Humans
Influenza Vaccines
Medicare
Physical Examination
Physician's Practice Patterns
Total Quality Management
Triglycerides
Vaccination
Bioinformatics
Biostatistics
Epidemiology
Health Services Research
Subject Area
Embargo Expiration Date
Link to Full Text
Abstract
CONTEXT: Performance feedback and benchmarking, common tools for health care improvement, are rarely studied in randomized trials. Achievable Benchmarks of Care (ABCs) are standards of excellence attained by top performers in a peer group and are easily and reproducibly calculated from existing performance data.
OBJECTIVE: To evaluate the effectiveness of using achievable benchmarks to enhance typical physician performance feedback and improve care.
DESIGN: Group-randomized controlled trial conducted in December 1996, with follow-up through 1998.
SETTING AND PARTICIPANTS: Seventy community physicians and 2978 fee-for-service Medicare patients with diabetes mellitus who were part of the Ambulatory Care Quality Improvement Project in Alabama.
INTERVENTION: Physicians were randomly assigned to receive a multimodal improvement intervention, including chart review and physician-specific feedback (comparison group; n = 35) or an identical intervention plus achievable benchmark feedback (experimental group; n = 35).
MAIN OUTCOME MEASURE: Preintervention (1994-1995) to postintervention (1997-1998) changes in the proportion of patients receiving influenza vaccination; foot examination; and each of 3 blood tests measuring glucose control, cholesterol level, and triglyceride level, compared between the 2 groups.
RESULTS: The proportion of patients who received influenza vaccine improved from 40% to 58% in the experimental group (P<.001) vs from 40% to 46% in the comparison group (P =.02). Odds ratios (ORs) for patients of achievable benchmark physicians vs comparison physicians who received appropriate care after the intervention, adjusted for preintervention care and nesting of patients within physicians, were 1.57 (95% confidence interval [CI], 1.26-1.96) for influenza vaccination, 1.33 (95% CI, 1.05-1.69) for foot examination, and 1.33 (95% CI, 1.04-1.69) for long-term glucose control measurement. For serum cholesterol and triglycerides, the achievable benchmark effect was statistically significant only after additional adjustment for physician characteristics (OR, 1.40 [95% CI, 1.08-1.82] and OR, 1.40 [95% CI, 1.09-1.79], respectively).
CONCLUSION: Use of achievable benchmarks significantly enhances the effectiveness of physician performance feedback in the setting of a multimodal quality improvement intervention.
Source
JAMA. 2001 Jun 13;285(22):2871-9.