Outcomes of End-User Testing of a Care Coordination Mobile App With Families of Children With Special Health Care Needs: Simulation Study.
Care for children with special health care needs relies on a network of providers who work to address the medical, behavioral, developmental, educational, social, and economic needs of the child and their family. Family-directed, manually created visual depictions of care team composition (ie, care mapping) and detailed note-taking curated by caregivers (eg, care binders) have been shown to enhance care coordination for families of these children, but they are difficult to implement in clinical settings owing to a lack of integration with electronic health records and limited visibility of family-generated insights for care providers. Caremap is an electronic health record-integrated digital personal health record mobile app designed to integrate the benefits of care mapping and care binders. Currently, there is sparse literature describing end-user participation in the co-design of digital health tools. In this paper, we describe a project that evaluated the usability and proof of concept of the Caremap app through end-user simulation.
This study aimed to conduct proof-of-concept testing of the Caremap app to coordinate care for children with special health care needs and explore early end-user engagement in simulation testing. The specific aims included engaging end users in app co-design via app simulation, evaluating the usability of the app using validated measures, and exploring user perspectives on how to make further improvements to the app.
Caregivers of children with special health care needs were recruited to participate in a simulation exercise using Caremap to coordinate care for a simulated case of a child with complex medical and behavioral needs. Participants completed a postsimulation questionnaire adapted from 2 validated surveys: the Pediatric Integrated Care Survey (PICS) and the user version of the Mobile Application Rating Scale (uMARS). A key informant interview was also conducted with a liaison to Spanish-speaking families regarding app accessibility for non-English-speaking users.
A Caremap simulation was successfully developed in partnership with families of children with special health care needs. Overall, 38 families recruited from 19 different US states participated in the simulation exercise and completed the survey. The average rating for the survey adapted from the PICS was 4.1 (SD 0.82) out of 5, and the average rating for the adapted uMARS survey was 4 (SD 0.83) out of 5. The highest-rated app feature was the ability to track progress toward short-term, patient- and family-defined care goals.
Internet-based simulation successfully facilitated end-user engagement and feedback for a digital health care coordination app for families of children with special health care needs. The families who completed simulation with Caremap rated it highly across several domains related to care coordination. The simulation study results elucidated key areas for improvement that translated into actionable next steps in app development.
Wong W
,Ming D
,Pateras S
,Fee CH
,Coleman C
,Docktor M
,Shah N
,Antonelli R
... -
《-》
Feasibility of Implementation of a Mobile Digital Personal Health Record to Coordinate Care for Children and Youth With Special Health Care Needs in Primary Care: Protocol for a Mixed Methods Study.
Electronic health record (EHR)-integrated digital personal health records (PHRs) via Fast Healthcare Interoperability Resources (FHIR) are promising digital health tools to support care coordination (CC) for children and youth with special health care needs but remain widely unadopted; as their adoption grows, mixed methods and implementation research could guide real-world implementation and evaluation.
This study (1) evaluates the feasibility of an FHIR-enabled digital PHR app for CC for children and youth with special health care needs, (2) characterizes determinants of implementation, and (3) explores associations between adoption and patient- or family-reported outcomes.
This nonrandomized, single-arm, prospective feasibility trial will test an FHIR-enabled digital PHR app's use among families of children and youth with special health care needs in primary care settings. Key app features are FHIR-enabled access to structured data from the child's medical record, families' abilities to longitudinally track patient- or family-centered care goals, and sharing progress toward care goals with the child's primary care provider via a clinician dashboard. We shall enroll 40 parents or caregivers of children and youth with special health care needs to use the app for 6 months. Inclusion criteria for children and youth with special health care needs are age 0-16 years; primary care at a participating site; complex needs benefiting from CC; high hospitalization risk in the next 6 months; English speaking; having requisite technology at home (internet access, Apple iOS mobile device); and an active web-based EHR patient portal account to which a parent or caregiver has full proxy access. Digital prescriptions will be used to disseminate study recruitment materials directly to eligible participants via their existing EHR patient portal accounts. We will apply an intervention mixed methods design to link quantitative and qualitative (semistructured interviews and family engagement panels with parents of children and youth with special health care needs) data and characterize implementation determinants. Two CC frameworks (Pediatric Care Coordination Framework; Patient-Centered Medical Home) and 2 evaluation frameworks (Consolidated Framework for Implementation Research; Technology Acceptance Model) provide theoretical foundations for this study.
Participant recruitment began in fall 2022, before which we identified >300 potentially eligible patients in EHR data. A family engagement panel in fall 2021 generated formative feedback from family partners. Integrated analysis of pretrial quantitative and qualitative data informed family-centered enhancements to study procedures.
Our findings will inform how to integrate an FHIR-enabled digital PHR app for children and youth with special health care needs into clinical care. Mixed methods and implementation research will help strengthen implementation in diverse clinical settings. The study is positioned to advance knowledge of how to use digital health innovations for improving care and outcomes for children and youth with special health care needs and their families.
ClinicalTrials.gov NCT05513235; https://clinicaltrials.gov/study/NCT05513235.
DERR1-10.2196/46847.
Ming DY
,Wong W
,Jones KA
,Antonelli RC
,Gujral N
,Gonzales S
,Rogers U
,Ratliff W
,Shah N
,King HA
... -
《JMIR Research Protocols》
"Hey Siri, Help Me Take Care of My Child": A Feasibility Study With Caregivers of Children With Special Healthcare Needs Using Voice Interaction and Automatic Speech Recognition in Remote Care Management.
About 23% of households in the United States have at least one child who has special healthcare needs. As most care activities occur at home, there is often a disconnect and lack of communication between families, home care nurses, and healthcare providers. Digital health technologies may help bridge this gap.
We conducted a pre-post study with a voice-enabled medical note taking (diary) app (SpeakHealth) in a real world setting with caregivers (parents, family members) of children with special healthcare needs (CSHCN) to understand feasibility of voice interaction and automatic speech recognition (ASR) for medical note taking at home.
In total, 41 parents of CSHCN were recruited. Participants completed a pre-study survey collecting demographic details, technology and care management preferences. Out of 41, 24 participants completed the study, using the app for 2 weeks and completing an exit survey. The app facilitated caregiver note-taking using voice interaction and ASR. An exit survey was conducted to collect feedback on technology adoption and changes in technology preferences in care management. We assessed the feasibility of the app by descriptively analyzing survey responses and user data following the key focus areas of acceptability, demand, implementation and integration, adaptation and expansion. In addition, perceived effectiveness of the app was assessed by comparing perceived changes in mobile app preferences among participants. In addition, the voice data, notes, and transcriptions were descriptively analyzed for understanding the feasibility of the app.
The majority of the recruited parents were 35-44 years old (22, 53.7%), part of a two-parent household (30, 73.2%), white (37, 90.2%), had more than one child (31, 75.6%), lived in Ohio (37, 90.2%), used mobile health apps, mobile note taking apps or calendar apps (28, 68.3%) and patient portal apps (22, 53.7%) to track symptoms and health events at home. Caregivers had experience with voice technology as well (32, 78%). Among those completed the post-study survey (in Likert Scale 1-5), ~80% of the caregivers agreed or strongly agreed that using the app would enhance their performance in completing tasks (perceived usefulness; mean = 3.4, SD = 0.8), the app is free of effort (perceived ease of use; mean = 3.2, SD = 0.9), and they would use the app in the future (behavioral intention; mean = 3.1, SD = 0.9). In total, 88 voice interactive patient notes were generated with the majority of the voice recordings being less than 20 s in length (66%). Most noted symptoms and conditions, medications, treatment and therapies, and patient behaviors. More than half of the caregivers reported that voice interaction with the app and using transcribed notes positively changed their preference of technology to use and methods for tracking symptoms and health events at home.
Our findings suggested that voice interaction and ASR use in mobile apps are feasible and effective in keeping track of symptoms and health events at home. Future work is suggested toward using integrated and intelligent systems with voice interactions with broader populations.
Sezgin E
,Oiler B
,Abbott B
,Noritz G
,Huang Y
... -
《Frontiers in Public Health》
An Electronic Patient-Reported Outcome Mobile App for Data Collection in Type A Hemophilia: Design and Usability Study.
There is currently limited evidence on the level and intensity of physical activity in individuals with hemophilia A. Mobile technologies can offer a rigorous and reliable alternative to support data collection processes but they are often associated with poor user retention. The lack of longitudinal continuity in their use can be partly attributed to the insufficient consideration of stakeholder inputs in the development process of mobile apps. Several user-centered models have been proposed to guarantee that a thorough knowledge of the end user needs is considered in the development process of mobile apps.
The aim of this study is to design and validate an electronic patient-reported outcome mobile app that requires sustained active input by individuals during POWER, an observational study that aims at evaluating the relationship between physical activity levels and bleeding in patients with hemophilia A.
We adopted a user-centered design and engaged several stakeholders in the development and usability testing of this mobile app. During the concept generation and ideation phase, we organized a need-assessment focus group (FG) with patient representatives to elicit specific design requirements for the end users. We then conducted 2 exploratory FGs to seek additional inputs for the app's improvement and 2 confirmatory FGs to validate the app and test its usability in the field through the mobile health app usability questionnaire.
The findings from the thematic analysis of the need-assessment FG revealed that there was a demand for sense making, for simplification of app functionalities, for maximizing integration, and for minimizing the feeling of external control. Participants involved in the later stages of the design refinement contributed to improving the design further by upgrading the app's layout and making the experience with the app more efficient through functions such as chatbots and visual feedback on the number of hours a wearable device had been worn, to ensure that the observed data were actually registered. The end users rated the app highly during the quantitative assessment, with an average mobile health app usability questionnaire score of 5.32 (SD 0.66; range 4.44-6.23) and 6.20 (SD 0.43; range 5.72-6.88) out of 7 in the 2 iterative usability testing cycles.
The results of the usability test indicated a high, growing satisfaction with the electronic patient-reported outcome app. The adoption of a thorough user-centered design process using several types of FGs helped maximize the likelihood of sustained retention of the app's users and made it fit for data collection of relevant outcomes in the observational POWER study. The continuous use of the app and the actual level of engagement will be evaluated during the ongoing trial.
ClinicalTrials.gov NCT04165135; https://clinicaltrials.gov/ct2/show/NCT04165135.
Petracca F
,Tempre R
,Cucciniello M
,Ciani O
,Pompeo E
,Sannino L
,Lovato V
,Castaman G
,Ghirardini A
,Tarricone R
... -
《-》