The effects of virtual reality immersion on the content and structure of the narrative discourse of healthy adults.

Narrative discourse is central to effective participation in conversations. When discourse is assessed in people with communication disability, structured tasks (e.g., picture descriptions) provide experimental control, while unstructured tasks (e.g., personal narratives) represent more natural communication. Immersive virtual reality (VR) technology may provide a solution by creating standardized experiences for narrative retell, therefore balancing ecological validity and experimental control in discourse assessment. Research is needed to understand how VR immersion affects narrative retell, first for adults with no communication disability, before application with adults with aphasia or related communication disability. To assess (1) the effects of VR immersion on the linguistic content and structure of narrative retells in a healthy adult population; and (2) whether VR immersion can influence the way a narrative is retold so that the speaker conveys their own experience, rather than the experience of the characters they are watching. In this pilot cohort study, 13 healthy adult participants with no reported communication disability watched an animated short film and a comparable immersive VR short film in a randomized order. Participants were asked to retell the events of the story after each condition in as much detail as possible. Mean length of utterance (in morphemes) was significantly higher in the video condition compared with the VR condition. Significantly more first-person pronouns were used in the VR condition compared with the video condition. No other measures of linguistic content or structure were significantly different between the VR and video conditions. Increased morpho-syntactic length and complexity in the video condition may suggest effects of elicitation stimulus on the narrative produced. The larger number of first-person pronouns in the VR condition may reflect that participants experienced a sense of presence in the virtual environment, and therefore were able to retell their communication experience rather than narrating the experiences of characters from an external perspective. Given the increasing need for more functional assessment of discourse in people with communication disability, further research is needed to validate these findings. What is already known on this subject As an ecologically valid tool, discourse analysis is often used to assess daily communicative exchanges in adults with acquired communication disability. Clinicians and researchers using narrative discourse assessment must balance the experimental control and diagnostic reference sample capabilities of structured tasks with the ecological validity and real-life transferability of unstructured personal narratives. What this study adds to existing knowledge This study explores the use of immersive VR technologies to create standardized, replicable, immersive experiences as a foundation for narrative discourse assessment. It highlights how the 'sense of presence' in a virtual world can prompt healthy adult speakers to retell a narrative of a personal experience that can be replicated for many different participants. The results suggest that immersive VR narrative assessment for adults with communication disability may balance ecological validity with measurement reliability in discourse assessment. What are the potential or actual clinical observations of this work? Immersion in VR resulted in the production of narratives with morpho-syntactic features that aligned with typical narrative generation, rather than retell. Participants used more first-person pronouns, suggesting retelling of personal experience. Though further study is needed, these preliminary findings suggest clinicians can use immersive VR stimuli to generate structured story generations that balance experimental and diagnostic control with ecological validity in narrative discourse assessment for adults with communication disability.

Baker C ，Bryant L ，Power E 《-》

Virtual Reality Air Travel Training Using Apple iPhone X and Google Cardboard: A Feasibility Report with Autistic Adolescents and Adults.

Rapid rises in autism diagnoses are increasing the demand for effective services and straining service providers. When individuals on the autism spectrum turn 18, they are faced with even greater barriers to services, since many services are delivered in school settings. Thus, there is a need for more accessible tools that teach daily life and communication skills to autistic adolescents and young adults. The current project reports findings from a pilot study using virtual reality (VR) to teach air travel skills to autistic young adults. The authors repurposed a virtual airport environment previously used to treat fear of flying for this study. Seven participants on the autism spectrum viewed a 5-minute virtual airport simulation with an overlaid narrative script using an iPhone X® and Google Cardboard® device once per week for 3 weeks. Researchers collected measures of attentiveness, language function, activity comprehension, and clinical observations on how participants interacted with the technology. Analyses revealed improvements in attentiveness, certain language functions such as labeling vocabulary, and activity comprehension in most participants. Clinical observations revealed acceptability of this technology and its capability to serve as an appealing media to deliver interventions. Thus, it is feasible to apply mobile VR trainings with autistic adolescents and young adults. We discuss ways to improve the pedagogical approach of VR-enhanced interventions in light of these findings. In the future, we plan to develop and test more virtual environments that address the needs of young adults on the autism spectrum, such as interview training and independent living skills. Why was this virtual reality air travel training program developed?: Each year, more and more people travel via airplane. Long lines, unexpected changes and other stressors can make air travel overwhelming and difficult, particularly for autistic people. Our goal was to develop and pilot test a program to help autistic adults learn air travel skills without needing to physically enter an airport.What does the virtual reality air travel training program do?: Our virtual reality air travel training (VR-ATT) program presents a virtual simulation of the steps that travelers go through in an airport. It guides users through entering, checking in, navigating security, waiting at the departure gate, and boarding. VR-ATT also contains a narrative to guide users by highlighting important information such as: "Look, there's the ticket counter. Let's check in with the attendant." This script was based on social stories, which are often used to help individuals on the autism spectrum learn communication and social interaction strategies. Seven autistic adolescents and adults participated in our program. They watched the VR-ATT simulation on an iPhone X® and Google Cardboard® two to three times over the course of 3 weeks. Google Cardboard is an inexpensive virtual reality (VR) headset.How did the researchers evaluate the VR-ATT program?: We evaluated the program in three ways. First, we asked each participant to retell the sequence of events of the simulation. In other research studies, participants who retold what they watched showed a greater ability to apply the skill to the real world. Second, we tracked how and what types of language participants used. Third, we measured if participants could independently view the VR-ATT simulation without side effects such as dizziness or cybersickness (common side effects of VR viewing). This helps us understand the feasibility and acceptability of using VR with autistic individuals.What were the early findings?: Early findings suggest that autistic individuals are accepting of the iPhone and Google Cardboard VR viewing method. They also provide preliminary support for the ability of the program to promote improvements in functional language skills such as labeling vocabulary, which helps individuals interact and navigate busy environments, such as an airport. Finally, the findings suggest that participants can accurately retell the sequence of events in the virtual simulation.What were the weaknesses of this project?: One weakness was that researchers could not test how participants transferred the skills they learned in the virtual training to a real-world airport. Another weakness is the small sample of participants. Finally, not every participant completed all three training sessions, making it difficult to draw precise conclusions about the program's acceptability and success.What are the next steps?: Future studies should include a larger number of participants, a real-world test, changes to the virtual simulation to encourage more language use and interaction with virtual characters, and use more accurate measurement materials.How will this work help autistic adults now or in the future?: This air travel program may someday help autistic people learn what to expect and how to communicate in a busy airport setting. This program also highlights that new technology, such as VR, could potentially improve access to services and help more people in need in the future.

Miller IT ，Miller CS ，Wiederhold MD ，Wiederhold BK ... -  《-》

Neuroanatomical correlates of macrostructural receptive abilities in narrative discourse in unilateral left hemisphere stroke: A behavioural and voxel-based morphometry study.

Little is known about story retelling and comprehension abilities in groups with lower levels of education and socio-economic status (SES). A growing body of evidence suggests the role of an extended network supporting narrative comprehension, but few studies have been conducted in clinical populations, even less in developing countries. To extend our knowledge of the impact of a stroke on macrostructural aspects of discourse processes, namely main and complementary information, in individuals with middle-low to low SES and low levels of education. Relationships were tested between the performance in story retell and comprehension and reading and writing habits (RWH). Also, the associations between retelling and comprehension measures and their structural grey matter (GM) correlates were explored. A total of 17 adults with unilateral left hemisphere (LH) chronic ischaemic stroke without the presence of significant aphasia and 10 matched (age, education and SES) healthy controls (HC) participated in the study. Retell and comprehension tasks were performed after listening or reading narrative stories. Voxel-based morphometry (VBM) analysis was conducted on a subgroup of nine individuals with LH stroke and the 10 matched controls using structural magnetic resonance imaging (MRI). Retelling and comprehension abilities were not significantly different between LH and HC, nonetheless quantitively lower in LH. Exploratory correlations showed that retelling and comprehension abilities in both written and auditory modalities were correlated with naming abilities. At the neural level, written comprehension positively correlated with GM density of the LH, including areas in the temporal pole, superior and middle temporal gyrus as well as the orbitofrontal cortex, precentral and postcentral gyri. Auditory narrative comprehension was associated with GM density of the lingual gyrus in the right hemisphere. The present results suggest that retelling and comprehension of auditory and written narratives are relatively well-preserved in individuals with a LH stroke without significant aphasia, but poorer than in HC. The findings replicate previous studies conducted in groups with higher levels of education and SES both at the behavioural and neural levels. Considering that naming seems to be associated with narrative retell and comprehension in individuals with lower SES and education, this research provides evidence on the importance of pursuing further studies including larger samples with and without aphasia as well as with various SES and education levels. What is already known on this subject Story retell and comprehension of auditory and written discourse have been shown to be affected after stroke, but most studies have been conducted on individuals with middle to high SES and high educational levels. What this paper adds to existing knowledge The study reports on narrative retell and comprehension in both auditory and written modalities in groups of HC and individuals with LH brain damage, with low-to-middle SES and lower levels of education. What are the potential or actual clinical implications of this work? This study highlights the importance of taking into consideration the sociodemographic and RWH of patients when assessing discourse retell and comprehension in both auditory and written modalities. It also underlines the importance of including patients without significant aphasia following LH stroke to look at the effect of both stroke and aphasia on narrative comprehension and story retelling.

Townsend SAM ，Marcotte K ，Brisebois A ，Smidarle AD ，Schneider F ，Loureiro F ，Soder RB ，Franco ADR ，Marrone LCP ，Hübner LC ... -  《-》

Utilizing Virtual Reality for Gender-Affirming Voice Training: Surveying the Attitudes and Perspectives of Potential Consumers.

Undertaking voice and communication training is an important part of the gender-affirming journey for many trans, gender-diverse and non-binary individuals. Training supports the alignment of voice with gender identity helping to reduce gender dysphoria as individuals are better able to connect with their voices. However, for training to be effective, regular practice is needed and the demands of training can often be difficult to meet. To investigate the interest, attitudes and perspectives on the use of immersive virtual reality (VR) to support gender-affirming voice and communication training by transgender, gender non-binary and gender-diverse people, and speech-language pathologists providing gender-affirming voice and communication training. A mixed-methods survey (i.e., collecting quantitative data through multiple-choice question and qualitative data through free text questions) was hosted online from 23 August to 21 September 2021. A total of 17 questions asked about technology use, and attitudes and perspectives towards VR. The survey included video examples of three different voice-activated VR applications to prompt participant responses about the technology. A total of 70 survey responses were included in the analysis. All participants had previous experience using smart phones, but only 27.2% had previously used VR. Four key themes were identified relating to potential uptake of VR in gender-affirming voice and communication training: (1) general audience appeal, (2) perceived therapeutic value, (3) exposure to or protection from harm and (4) relatability to real life. VR games may represent a viable option to support practice of voice exercises. Gamification through VR is likely to motivate some to increase frequency of practice. VR applications that are used in voice training need to be fit-for-purpose, and detailed co-design is necessary to build appropriate applications for future use. This study provides a foundation to inform the design, development and implementation of VR applications to be used in gender-affirming voice training. What is already known on the subject? Speech-language pathologists work closely with transgender and gender-diverse individuals to help them achieve gender congruent voice and communication. Clients need to undertake regular and ongoing practice outside of training sessions to achieve and maintain their ideal voice. Motivation and adherence to regular practice sessions remain an ongoing challenge. What this study adds to the existing knowledge This study explores the use of immersive VR technologies to create safe, motivating and enjoyable environments to encourage regular practice of gender-affirming voice and communication exercises. It engages stakeholders in an early-stage participant-involved design to gauge interest in, and perspectives on, VR and technology-based training support tools. The results suggest that voice-activated VR applications would highly motivate some individuals if they were appropriately designed but would not be ideal for all. What are the actual and clinical implications of this work? Immersion in VR can be a highly motivating tool to enhance adherence to practice schedules for some individuals. However, tools need to be specifically designed with outcomes in mind to be fit-for-purpose, to support individual goals and to minimize the risk of harm. The few existing VR voice-activated applications that are available require further assessment, and redesign through co-design with users to functionally and safely support gender-affirming voice and communication training.

Smith C ，Gregory C ，Bryant L 《-》

Towards efficient, ecological assessment of interaction: A scoping review of co-constructed communication.

The complexity of communication presents challenges for clinical assessment, outcome measurement and intervention for people with acquired brain injury. For the purposes of assessment or treatment, this complexity is usually managed by isolating specific linguistic functions or speech acts from the interactional context. Separating linguistic functions from their interactional context can lead to discourse being viewed as a static entity comprised of discrete features, rather than as a dynamic process of co-constructing meaning. The ecological validity of discourse assessments which rely on the deconstruction of linguistic functions is unclear. Previous studies have reported assessment tasks that preserve some of the dialogic features of communication, but as yet, these tasks have not been identified as a distinct genre of assessment. We suggest the term 'co-constructed communication' to describe tasks which are specifically designed to capture the dynamic, jointly produced nature of communication within a replicable assessment task. To identify and summarize how co-constructed communication has been assessed with individuals with non-progressive acquired communication disability regarding task design, measures and psychometric robustness. A scoping review methodology was used to identity relevant studies. Systematic database searches were conducted on studies published before July 2021. Studies in the yield were assessed against eligibility criteria, with 37 studies identified as eligible for inclusion. This is the first time that co-constructed communication has been defined as a genre of discourse assessment for stroke and traumatic brain injury populations. Co-constructed communication has been assessed for 144 individuals with aphasia and 111 with cognitive-communication disability. Five categories of co-constructed communication tasks were identified, ranging in complexity. Variability exists in how these assessment tasks are labelled and measured. Assessment measures require further psychometric profiling, specifically regarding test-retest reliability and validity. Co-constructed communication is a discourse genre which offers researchers and clinicians a replicable method to assess language and communication in an experimentally rigorous way, within an ecologically valid context, bridging the gap between experimental and ecological assessment approaches. What is already known on this subject Standardized assessments of language skills and monologue offer reliable, replicable ways to measure language. However, isolating language from an interactional context fundamentally changes the behaviour under study. This raises questions about the ecological validity of the measures we routinely use to determine diagnoses, guide treatment planning and measure the success of treatment. What this study adds to the existing knowledge This review highlights studies that conceptualize, and often quantify, interaction by combining experimental rigour and aspects of everyday dialogue. This is the first time this genre of discourse assessment has been identified. We propose the term 'co-constructed communication' to describe this genre and provide an operational definition for the term. What are the practical and clinical implications of this study? Co-constructed communication assessment tasks require refinement, particularly regarding aspects of psychometric robustness. In the future, these tasks offer pragmatic, meaningful ways to capture the effect and impact of aphasia and cognitive-communication disability within interaction.

Carragher M ，Mok Z ，Steel G ，Conroy P ，Pettigrove K ，Rose ML ，Togher L ... -  《-》