Measuring Hospital Quality: Can Medicare Data Substitute for All‐Payer Data?

Objectives. To assess whether adverse outcomes in Medicare patients can be used as a surrogate for measures from all patients in quality‐of‐care research using administrative datasets.Data Sources. Patient discharge abstracts from state data systems for 799 hospitals in 11 states. National MedPAR discharge data for Medicare patients from 3,357 hospitals. State hospital staffing surveys or financial reports. American Hospital Association Annual Survey.Study Design. We calculate rates for 10 adverse patient outcomes, examine the correlation between all‐patient and Medicare rates, and conduct negative binomial regressions of counts of adverse outcomes on expected counts, hospital nurse staffing, and other variables to compare results using all‐patient and Medicare patient data.Data Collection/Extraction. Coding rules were established for eight adverse outcomes applicable to medical and surgical patients plus two outcomes applicable only to surgical patients. The presence of these outcomes was coded for 3 samples: all patients in the 11‐state sample, Medicare patients in the 11‐state sample, and Medicare patients in the national Medicare MedPAR sample. Logistic regression models were used to construct estimates of expected counts of the outcomes for each hospital. Variables for teaching, metropolitan status, and bed size were obtained from the AHA Annual Survey.Principal Findings. For medical patients, Medicare rates were consistently higher than all‐patient rates, but the two were highly correlated. Results from regression analysis were consistent across the 11‐state all‐patient, 11‐state Medicare, and national Medicare samples. For surgery patients, Medicare rates were generally higher than all‐patient rates, but correlations of Medicare and all‐patient rates were lower, and regression results less consistent.Conclusions. Analyses of quality of care for medical patients using Medicare‐only and all‐patient data are likely to have similar findings. Measures applied to surgery patients must be used with more caution, as those tested only in Medicare patients may not provide results comparable to those from all‐patient samples or across different samples of Medicare patients.