RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program.

The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process. We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM. Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need. The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.

Chasco EE ，Van Tiem J ，Johnson N ，Balkenende E ，Steffen M ，Jones D ，Friberg JE ，Steffensmeier K ，Moeckli J ，Arora K ，Rabin BA ，Reisinger HS ... -  《-》

Tracking implementation strategies in real-world settings: VA Office of Rural Health enterprise-wide initiative portfolio.

Reisinger HS ，Barron S ，Balkenende E ，Steffen M ，Steffensmeier K ，Richards C ，Ball D ，Chasco EE ，Van Tiem J ，Johnson NL ，Jones D ，Friberg JE ，Kenney R ，Moeckli J ，Arora K ，Rabin B ... -  《-》

Adopting the RE-AIM analytic framework for rural program evaluation: experiences from the Advance Care Planning via Group Visits (ACP-GV) national evaluation.

To support rigorous evaluation across a national portfolio of grants, the United States Department of Veterans Affairs (VA) Office of Rural Health (ORH) adopted an analytic framework to guide their grantees' evaluation of initiatives that reach rural veterans and to standardize the reporting of outcomes and impacts. Advance Care Planning via Group Visits (ACP-GV), one of ORH's Enterprise-Wide Initiatives, also followed the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. ACP-GV is a national patient-centered intervention delivered in a large, veterans integrated healthcare system. This manuscript describes how RE-AIM was used to evaluate this national program and lessons learned from ORH's annual reporting feedback to ACP-GV on their use of the framework to describe evaluation impacts. We used patient, provider, and site-level administrative health care data from the VA Corporate Data Warehouse and national program management databases for federal fiscal years (FY) spanning October 1, 2018-September 30, 2023. Measures included cumulative and past FY metrics developed to assess program impacts. RE-AIM constructs included the following cumulative and annual program evaluation results. ACP-GV reached 54,167 unique veterans, including 19,032 unique rural veterans between FY 2018 to FY 2023. During FY 2023, implementation adherence to the ACP-GV model was noted in 91.7% of program completers, with 55% of these completers reporting a knowledge increase and 14% reporting a substantial knowledge increase (effectiveness). As of FY 2023, 66 ACP-GV sites were active, and 1,556 VA staff were trained in the intervention (adoption). Of the 66 active sites in FY 2023, 27 were sites previously funded by ORH and continued to offer ACP-GV after the conclusion of three years of seed funding (maintenance). Lessons learned developing RE-AIM metrics collaboratively with program developers, implementers, and evaluators allowed for a balance of clinical and scientific input in decision-making, while the ORH annual reporting feedback provided specificity and emphasis for including both cumulative, annual, and rural specific metrics. ACP-GV's use of RE-AIM metrics is a key step towards improving rural veteran health outcomes and describing real world program impacts.

Matthieu MM ，Taylor LD ，Adkins DA ，Williams JS ，Hu B ，Oliver CM ，McCullough JA ，Mallory MJ ，Smith ID ，Painter JT ，Ounpraseuth ST ，Garner KK ... -  《-》

Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned.

Kenney RR ，Klocko RP ，Manheim CE ，Mog AC ，Young JP ... -  《-》

Evaluating an Enterprise-Wide Initiative to enhance healthcare coordination for rural women Veterans using the RE-AIM framework.

The Veterans Health Administration (VA) Office of Rural Health (ORH) and Office of Women's Health Services (OWH) in FY21 launched a three-year Enterprise-Wide Initiative (EWI) to expand access to preventive care for rural, women Veterans. Through this program, women's health care coordinators (WHCC) were funded to coordinate mammography, cervical cancer screening and maternity care for women Veterans at selected VA facilities. We conducted a mixed-methods evaluation using the RE-AIM framework to assess the program implementation. We collected quantitative data from the 14 program facilities on reach (i.e., Veterans served by the program), effectiveness (e.g., cancer screening compliance, communication), adoption, and maintenance of women's health care coordinators (WHCC) in FY2022. Implementation of the program was examined through semi-structured interviews with the facility WHCC funding initiator (e.g., the point of contact at facility who initiated the request for WHCC funding), WHCCs, and providers. Reach. The number of women Veterans and rural women Veterans served by the WHCC program grew (by 50% and 117% respectively). The program demonstrated effectiveness as screening rates increased for cervical and breast cancer screening (+0.9% and +.01%, respectively). Also, maternity care coordination phone encounters with Veterans grew 36%. Adoption: All facilities implemented care coordinators by quarter two of FY22. Implementation. Qualitative findings revealed facilitators and barriers to successful program implementation and care coordination. Maintenance: The EWI facilitated the recruitment and retention of WHCCs at respective VA facilities over time. In rural areas, WHCCs can play a critical role in increasing Reach and effectiveness. The EWI demonstrated to be a successful care coordination model that can be feasibly Adopted, Implemented, and Maintained at rural VA facilities.

Relyea MR ，Kinney RL ，DeRycke EC ，Haskell S ，Mattocks KM ，Bastian LA ... -  《-》