Reliability and Validity of the Inpatient Rehabilitation Facility Discharge Mobility and Self-Care Quality Measures.

To describe the reliability and validity of the publicly reported facility-level quality measures Inpatient Rehabilitation Facility (IRF) Discharge Mobility Score for Medical Rehabilitation Patients ("Discharge mobility score") and IRF Discharge Self-Care Score for Medical Rehabilitation Patients ("Discharge self-care score"). Observational study using standardized patient assessment data to examine facility-level split-half reliability and construct validity of quality measure scores. All IRFs (n = 1117) in the United States with at least 20 Medicare stays. Facility-level quality measure scores were calculated from 2017 data on 428,192 Medicare (fee-for-service and Medicare Advantage) IRF patient stays. Using clinician-reported assessment data, we calculated facility-level mobility and self-care quality measure scores and examined reliability of these scores using split-half analysis and Pearson product-moment correlations, Spearman rank correlations, and intraclass correlation coefficients (ICC2,1). We examined construct validity of these scores by comparing facility-level quality measure scores by facility stroke disease-specific certification status. Reported as percentages meeting or exceeding expectations, IRF quality measure scores ranged from 8.3% to 90.1% for mobility and 9.0% to 90.3% for self-care. IRF scores, when split in half to examine reliability, showed strong, positive correlations for the mobility (Pearson = 0.898, Spearman = 0.898, ICC = 0.898) and self-care (Pearson = 0.886, Spearman = 0.874, ICC = 0.886) scores. When stratified by provider volume, ICCs remained strong. Construct validity analyses showed IRFs with stroke disease-specific certification had higher mean and median scores than IRFs without certification, and a greater proportion of IRFs that were certified had higher scores. Our results support the reliability and construct validity of the IRF quality measures Discharge mobility and Discharge self-care scores. Reported as percentages meeting or exceeding expectations, these quality measures are designed to be more consumer-friendly compared to change scores.

Deutsch A ，Palmer L ，Vaughan M ，McMullen T ，Kwon S ，Karmarkar A ，Ingber MJ ... -  《-》

Inpatient Rehabilitation Facility Change in Self-Care and Change in Mobility Quality Measures: Development and Reliability and Validity Testing.

To describe the development, implementation and reliability and validity testing of the inpatient rehabilitation facility (IRF) Change in Self-Care and Change in Mobility quality measures. We describe the activities involved in developing and implementing the 2 facility-level quality measures, including public comment opportunities. We examined facility-level reliability using split-half testing and Pearson product-moment correlations, Spearman rank correlations, and intraclass correlation coefficients (ICC2,1). We examined validity by comparing facility-level quality measure scores and facility disease-specific certification status. All 1117 IRFs in the United States with at least 20 Medicare stays that ended in 2017. Facility-level quality measure scores (N=1117) were derived from data from 427,517 (self-care) and 427,956 (mobility) Medicare fee-for-service and Medicare Advantage IRF patient stays in 2017. Not applicable. Facility-level Change in Self-Care and Change in Mobility quality measure scores and facility Disease-Specific Certification for Stroke Rehabilitation from The Joint Commission were used in validity analysis. The split-half quality measure scores showed strong, positive correlations for the facility-level self-care (Pearson=0.903, Spearman=0.884, ICC=0.903, P<.0001) and mobility (Pearson=0.903, Spearman=0.884, ICC= 0.903, P<.0001) quality measure scores, providing evidence of reliability. ICCs remained strong when stratifying by provider volume. IRFs with stroke certification had slightly higher mean and median quality measure scores than IRFs without certification, and IRFs with the higher quality measure scores tended to have a higher percentage of certified IRFs. Our analyses support the reliability and validity of the Change in Self-Care and Change in Mobility quality measure scores in IRFs.

Deutsch A ，Palmer L ，Vaughan M ，McMullen T ，Karmarkar A ，Kwon S ，Ingber MJ ... -  《-》

Measuring Inpatient Rehabilitation Facility Quality of Care: Discharge Self-Care Functional Status Quality Measure.

To describe the calculation and psychometric properties of the discharge self-care functional status quality measure implemented in the Centers for Medicare & Medicaid Services' (CMS) Inpatient Rehabilitation Facility (IRF) Quality Reporting Program on October 1, 2016. Medicare fee-for-service (FFS) patients from 38 IRFs that participated in the CMS Post-Acute Care Payment Reform Demonstration were included in this cohort study. Data came from the Continuity Assessment Record and Evaluation Item Set, IRF-Patient Assessment Instrument, and Medicare claims. For each patient, we calculated an expected discharge self-care score, risk-adjusted for demographic and baseline clinical characteristics. The performance score of each IRF equaled the percentage of patient stays where the observed discharge self-care score met or exceeded the expected score. We assessed the measure's discriminatory ability across IRFs and reliability. IRFs. Medicare FFS patients aged ≥21 years (N=4769). Not applicable. Facility-level discharge self-care quality measure performance score. A total of 4769 patient stays were included; 57% of stays were in women, and 12.1% were in patients aged <65 years. Stroke was the most common diagnosis (21.8%). The mean±SD performance score was 55.1%±16.6% (range, 25.8%-100%). About 54% of IRFs had scores significantly different from the percentage of stays that met or exceeded the expected discharge self-care score in the overall demonstration sample. The quality measure showed strong reliability, with intraclass correlation coefficients of .91. The discharge self-care quality measure showed strong discriminatory ability and reliability, representing an important initial step in evaluation of IRF self-care outcomes. A wide range in performance scores suggested a gap in quality of care across IRFs. Future work should include testing the measure with nationwide data from all IRFs.

Pardasaney PK ，Deutsch A ，Iriondo-Perez J ，Ingber MJ ，McMullen T ... -  《-》

Inpatient Rehabilitation Facility Patients' Functional Abilities and Validity Testing of the Standardized Self-Care and Mobility Data Elements.

To describe the abilities of Medicare patients in inpatient rehabilitation facilities (IRFs) at admission and discharge using the standardized self-care and mobility data elements and examine the validity of the data elements. These data are used in the Center for Medicare & Medicaid's IRF payment and quality reporting programs. Descriptive study reporting IRF patients' self-care and mobility scores. We also examined content validity and the associations between admission scores and length of stay (LOS), discharge scores and discharge destination, and change scores and the number of comorbidities. Patients discharged from 1129 IRFs in 2017. IRF Medicare fee-for-service and Medicare Advantage patient stays (N = 493,209). Not applicable. Self-care and mobility item scores, IRF LOS, discharge destination, and categories of the number of comorbidities. For each self-care and mobility activity, patients in IRFs overall made substantial improvements in function between admission and discharge. For example, the percentage of patients independent with eating and toilet transfers increased from 29.04% to 66.68% and 0.80% to 39.87%, respectively, between admission and discharge. Activities represented in the standardized data elements are included in other functional assessment instruments addressing content validity. Analyses showed a monotonic relationship between admission scores and LOS and between discharge scores and discharge to community percentages with only a few exceptions. Self-care and mobility scale change scores decreased as the number of comorbidities increased across categories. Patients in IRFs overall show functional improvement across each of the activities as defined by the standardized self-care and mobility data elements. The results showing the associations between patient functioning and 3 metrics (LOS, discharge to community rates, and number of comorbidities) support the validity of the data elements measuring functional abilities in the IRF Medicare population.

Deutsch A ，Palmer L ，Vaughan M ，Schwartz C ，McMullen T ... -  《-》

Change in Mobility Quality Measure for Inpatient Rehabilitation Facilities: Exclusion Criteria and the Risk Adjustment Model.

To describe the exclusion criteria and updated risk adjustment model developed for the Change in Mobility quality measure in the inpatient rehabilitation facility (IRF) quality reporting program. Facility-level quality measures focused on patient outcomes usually require risk adjustment to account for varied admission characteristics of patients across facilities. This cohort study analyzed admission demographic and clinical factors associated with mobility change scores using the Inpatient Rehabilitation Facility Patient Assessment Instrument (IRF-PAI) data for Medicare patients discharged from IRFs in calendar year 2017. A total of 1129 IRFs in the United States. A total of 493,209 (N=493, 209) Medicare fee-for-service and Medicare Advantage IRF patient stays discharged in calendar year 2017. Not applicable. Mobility change scores using admission and discharge standardized assessment data from the IRF-PAI. Approximately 53% of patients in the study were female, 67% were aged 65-84 years, and nearly 80% were White. In the final risk adjustment model, 105 covariates were included, explaining 20% of variance in mobility change scores. Key risk adjusters included IRF primary diagnosis group, prior indoor ambulation functioning, age older than 90 years, and 14 of the comorbidities. The model showed good calibration across the range of deciles of predicted IRF mobility change scores; the ratio of the average expected to observed change scores ranged from 0.93-1.03, with all but 1 within ±0.03. The updated risk adjustment model uses IRF patients' demographic and clinical characteristics to predict their mobility change scores. The exclusion criteria and resulting risk model are used to calculate the risk adjusted Change in Mobility quality measure scores, enabling comparisons of Change in Mobility scores across IRFs.

Vaughan M ，Deutsch A ，McMullen T ，Palmer L ，Kwon S ，Ingber MJ ... -  《-》