-
Effectiveness of interventions for improving educational outcomes for people with disabilities in low- and middle-income countries: A systematic review.
People with disabilities are consistently falling behind in educational outcomes compared to their peers without disabilities, whether measured in terms of school enrolment, school completion, mean years of schooling, or literacy levels. These inequalities in education contribute to people with disabilities being less likely to achieve employment, or earn as much if they are employed, as people without disabilities. Evidence suggests that the gap in educational attainment for people with and without disabilities is greatest in low- and middle-income countries (LMICs). Exclusion of people with disabilities from mainstream education, and low rates of participation in education of any kind, are important issues for global equity. Interventions which might have a positive impact include those that improve educational outcomes for people with disabilities, whether delivered in specialist or inclusive education settings. Such interventions involve a wide range of initiatives, from those focused on the individual level - such as teaching assistance to make mainstream classes more accessible to children with specific learning needs - to those which address policy or advocacy.
The objectives of this review were to answer the following research questions: (1) What is the nature of the interventions used to support education for people with disabilities in LMICs? (2) What is the size and quality of the evidence base of the effectiveness of interventions to improve educational outcomes for people with disabilities in LMICs? (3) What works to improve educational outcomes for people with disabilities in LMICs? (4) Which interventions appear to be most effective for different types of disability? (5) What are the barriers and facilitators to the improvement of educational outcomes for people with disabilities? (6) Is there evidence of cumulative effects of interventions?
The search for studies followed two steps. Firstly, we conducted an electronic search of databases and sector-specific websites. Then, after initial screening, we examined the reference lists of all identified reviews and screened the cited studies for inclusion. We also conducted a forward search and an ancestral search. No restrictions in terms of date or format were placed on the search, but only English-language publications were eligible for inclusion.
In our review, we included studies on the basis that they were able to detect intervention impact. Descriptive studies of various designs and methodologies were not included. We also excluded any study with a sample size of fewer than five participants. We included studies which examined the impact of interventions for people with disabilities living in LMICs. There were no restrictions on comparators/comparison groups in included studies. However, to be eligible for inclusion, a study needed to have both an eligible intervention and an eligible outcome. Any duration of follow-up was eligible for inclusion.
We used EppiReviewer for bibliographic management, screening, coding, and data synthesis. Eligibility was assessed using a predesigned form based on the inclusion criteria developed by the authors. We piloted all coding sheets with at least five studies before use. The form allowed for coding of multiple intervention domains and multiple outcomes domains. The entire screening process was reported using a PRISMA flow chart. We screened all unique references from our search title and abstract, with two independent reviewers determining relevance, and repeated this process for full texts. Data was extracted from studies according to a coding sheet. Coding included: (1) extraction of basic study characteristics, (2) a narrative summary of procedures and findings (including recording of iatrogenic effects), (3) a summary of findings/results table, (4) an assessment of confidence in study findings, and (5) creation of a forest plot of effect sizes. A third data collector, a research associate, checked the results of this process. Confidence in study findings was assessed using a standardised tool. All coding categories were not mutually exclusive and so multiple coding was done where an intervention covered more than one category of intervention.
Twenty-eight studies were included in this review. Most studies (n = 25) targeted children with disabilities. Only two studies directly targeted family members, and the remaining three focused on service providers. Individuals with intellectual or learning and developmental impairments were most frequently targeted by interventions (n = 17). The category of interventions most represented across studies was 'Educational attainment support', for instance, a reading comprehension intervention that combined strategy instruction (graphic organisers, visual displays, mnemonic illustrations, computer exercises, predicting, inference, text structure awareness, main idea identification, summarisation, and questioning) for children with dyslexia. The second most common category of intervention was 'Accessible learning environments', for instance, programmes which aimed to improve social skills or to reduce rates of victimisation of children with disabilities in schools. Regarding intervention effects, included studies concerned with 'Conditions for inclusion of people with disabilities in education' showed a moderately significant effect, and one study concerned with teacher knowledge showed a significant effect size. Among the 18 studies included in the analysis of intervention effects on 'Skills for learning', 12 interventions had a significant effect. When considering the effect of interventions on different outcomes, we see that the effect on literacy, cognitive skills, handwriting, and numeracy are significant. All these effects are large but are based on a low number of studies. The studies concerned with speech and school behaviour show no significant effect of intervention. Across studies, heterogeneity is high, and risk of publication bias varies but was frequently high. All but one study received an overall rating of low confidence in study findings. However, this lack of confidence across studies was largely due to the use of low-rigour study designs and was not always reflective of multiple points of weakness within a given study.
Children with disabilities fall behind in educational outcomes as the current school systems are not set up to teach children with different impairment types. There is no one 'magic bullet' intervention which can equalise health outcomes for this group. A twin-track approach is needed, which both addresses the specific needs of children with disabilities but also ensures that they are included in mainstream activities (e.g., through improving the skills of teachers and accessibility of the classroom). However, currently most interventions included in this systematic review targeted individual children with disabilities in an attempt to improve their functioning, skills, and competencies, but did not focus on mainstreaming these children into the school by system-level or school-level changes. Consequently, a focus on evaluation of interventions which target not just the individual with a disability but also their broader environment, are needed.
Hunt X
,Saran A
,White H
,Kuper H
... -
《-》
-
Falls prevention interventions for community-dwelling older adults: systematic review and meta-analysis of benefits, harms, and patient values and preferences.
About 20-30% of older adults (≥ 65 years old) experience one or more falls each year, and falls are associated with substantial burden to the health care system, individuals, and families from resulting injuries, fractures, and reduced functioning and quality of life. Many interventions for preventing falls have been studied, and their effectiveness, factors relevant to their implementation, and patient preferences may determine which interventions to use in primary care. The aim of this set of reviews was to inform recommendations by the Canadian Task Force on Preventive Health Care (task force) on fall prevention interventions. We undertook three systematic reviews to address questions about the following: (i) the benefits and harms of interventions, (ii) how patients weigh the potential outcomes (outcome valuation), and (iii) patient preferences for different types of interventions, and their attributes, shown to offer benefit (intervention preferences).
We searched four databases for benefits and harms (MEDLINE, Embase, AgeLine, CENTRAL, to August 25, 2023) and three for outcome valuation and intervention preferences (MEDLINE, PsycINFO, CINAHL, to June 9, 2023). For benefits and harms, we relied heavily on a previous review for studies published until 2016. We also searched trial registries, references of included studies, and recent reviews. Two reviewers independently screened studies. The population of interest was community-dwelling adults ≥ 65 years old. We did not limit eligibility by participant fall history. The task force rated several outcomes, decided on their eligibility, and provided input on the effect thresholds to apply for each outcome (fallers, falls, injurious fallers, fractures, hip fractures, functional status, health-related quality of life, long-term care admissions, adverse effects, serious adverse effects). For benefits and harms, we included a broad range of non-pharmacological interventions relevant to primary care. Although usual care was the main comparator of interest, we included studies comparing interventions head-to-head and conducted a network meta-analysis (NMAs) for each outcome, enabling analysis of interventions lacking direct comparisons to usual care. For benefits and harms, we included randomized controlled trials with a minimum 3-month follow-up and reporting on one of our fall outcomes (fallers, falls, injurious fallers); for the other questions, we preferred quantitative data but considered qualitative findings to fill gaps in evidence. No date limits were applied for benefits and harms, whereas for outcome valuation and intervention preferences we included studies published in 2000 or later. All data were extracted by one trained reviewer and verified for accuracy and completeness. For benefits and harms, we relied on the previous review team's risk-of-bias assessments for benefit outcomes, but otherwise, two reviewers independently assessed the risk of bias (within and across study). For the other questions, one reviewer verified another's assessments. Consensus was used, with adjudication by a lead author when necessary. A coding framework, modified from the ProFANE taxonomy, classified interventions and their attributes (e.g., supervision, delivery format, duration/intensity). For benefit outcomes, we employed random-effects NMA using a frequentist approach and a consistency model. Transitivity and coherence were assessed using meta-regressions and global and local coherence tests, as well as through graphical display and descriptive data on the composition of the nodes with respect to major pre-planned effect modifiers. We assessed heterogeneity using prediction intervals. For intervention-related adverse effects, we pooled proportions except for vitamin D for which we considered data in the control groups and undertook random-effects pairwise meta-analysis using a relative risk (any adverse effects) or risk difference (serious adverse effects). For outcome valuation, we pooled disutilities (representing the impact of a negative event, e.g. fall, on one's usual quality of life, with 0 = no impact and 1 = death and ~ 0.05 indicating important disutility) from the EQ-5D utility measurement using the inverse variance method and a random-effects model and explored heterogeneity. When studies only reported other data, we compared the findings with our main analysis. For intervention preferences, we used a coding schema identifying whether there were strong, clear, no, or variable preferences within, and then across, studies. We assessed the certainty of evidence for each outcome using CINeMA for benefit outcomes and GRADE for all other outcomes.
A total of 290 studies were included across the reviews, with two studies included in multiple questions. For benefits and harms, we included 219 trials reporting on 167,864 participants and created 59 interventions (nodes). Transitivity and coherence were assessed as adequate. Across eight NMAs, the number of contributing trials ranged between 19 and 173, and the number of interventions ranged from 19 to 57. Approximately, half of the interventions in each network had at least low certainty for benefit. The fallers outcome had the highest number of interventions with moderate certainty for benefit (18/57). For the non-fall outcomes (fractures, hip fracture, long-term care [LTC] admission, functional status, health-related quality of life), many interventions had very low certainty evidence, often from lack of data. We prioritized findings from 21 interventions where there was moderate certainty for at least some benefit. Fourteen of these had a focus on exercise, the majority being supervised (for > 2 sessions) and of long duration (> 3 months), and with balance/resistance and group Tai Chi interventions generally having the most outcomes with at least low certainty for benefit. None of the interventions having moderate certainty evidence focused on walking. Whole-body vibration or home-hazard assessment (HHA) plus exercise provided to everyone showed moderate certainty for some benefit. No multifactorial intervention alone showed moderate certainty for any benefit. Six interventions only had very-low certainty evidence for the benefit outcomes. Two interventions had moderate certainty of harmful effects for at least one benefit outcome, though the populations across studies were at high risk for falls. Vitamin D and most single-component exercise interventions are probably associated with minimal adverse effects. Some uncertainty exists about possible adverse effects from other interventions. For outcome valuation, we included 44 studies of which 34 reported EQ-5D disutilities. Admission to long-term care had the highest disutility (1.0), but the evidence was rated as low certainty. Both fall-related hip (moderate certainty) and non-hip (low certainty) fracture may result in substantial disutility (0.53 and 0.57) in the first 3 months after injury. Disutility for both hip and non-hip fractures is probably lower 12 months after injury (0.16 and 0.19, with high and moderate certainty, respectively) compared to within the first 3 months. No study measured the disutility of an injurious fall. Fractures are probably more important than either falls (0.09 over 12 months) or functional status (0.12). Functional status may be somewhat more important than falls. For intervention preferences, 29 studies (9 qualitative) reported on 17 comparisons among single-component interventions showing benefit. Exercise interventions focusing on balance and/or resistance training appear to be clearly preferred over Tai Chi and other forms of exercise (e.g., yoga, aerobic). For exercise programs in general, there is probably variability among people in whether they prefer group or individual delivery, though there was high certainty that individual was preferred over group delivery of balance/resistance programs. Balance/resistance exercise may be preferred over education, though the evidence was low certainty. There was low certainty for a slight preference for education over cognitive-behavioral therapy, and group education may be preferred over individual education.
To prevent falls among community-dwelling older adults, evidence is most certain for benefit, at least over 1-2 years, from supervised, long-duration balance/resistance and group Tai Chi interventions, whole-body vibration, high-intensity/dose education or cognitive-behavioral therapy, and interventions of comprehensive multifactorial assessment with targeted treatment plus HHA, HHA plus exercise, or education provided to everyone. Adding other interventions to exercise does not appear to substantially increase benefits. Overall, effects appear most applicable to those with elevated fall risk. Choice among effective interventions that are available may best depend on individual patient preferences, though when implementing new balance/resistance programs delivering individual over group sessions when feasible may be most acceptable. Data on more patient-important outcomes including fall-related fractures and adverse effects would be beneficial, as would studies focusing on equity-deserving populations and on programs delivered virtually.
Not registered.
Pillay J
,Gaudet LA
,Saba S
,Vandermeer B
,Ashiq AR
,Wingert A
,Hartling L
... -
《Systematic Reviews》
-
Defining the optimum strategy for identifying adults and children with coeliac disease: systematic review and economic modelling.
Elwenspoek MM
,Thom H
,Sheppard AL
,Keeney E
,O'Donnell R
,Jackson J
,Roadevin C
,Dawson S
,Lane D
,Stubbs J
,Everitt H
,Watson JC
,Hay AD
,Gillett P
,Robins G
,Jones HE
,Mallett S
,Whiting PF
... -
《-》
-
The effectiveness of abstinence-based and harm reduction-based interventions in reducing problematic substance use in adults who are experiencing homelessness in high income countries: A systematic review and meta-analysis: A systematic review.
Homelessness is a traumatic experience, and can have a devastating effect on those experiencing it. People who are homeless often face significant barriers when accessing public services, and have often experienced adverse childhood events, extreme social disadvantage, physical, emotional and sexual abuse, neglect, low self-esteem, poor physical and mental health, and much lower life expectancy compared to the general population. Rates of problematic substance use are disproportionately high, with many using drugs and alcohol to deal with the stress of living on the street, to keep warm, or to block out memories of previous abuse or trauma. Substance dependency can also create barriers to successful transition to stable housing.
To understand the effectiveness of different substance use interventions for adults experiencing homelessness.
The primary source of studies for was the 4th edition of the Homelessness Effectiveness Studies Evidence and Gaps Maps (EGM). Searches for the EGM were completed in September 2021. Other potential studies were identified through a call for grey evidence, hand-searching key journals, and unpacking relevant systematic reviews.
Eligible studies were impact evaluations that involved some comparison group. We included studies that tested the effectiveness of substance use interventions, and measured substance use outcomes, for adults experiencing homelessness in high income countries.
Descriptive characteristics and statistical information in included studies were coded and checked by at least two members of the review team. Studies selected for the review were assessed for confidence in the findings. Standardised effect sizes were calculated and, if a study did not provide sufficient raw data for the calculation of an effect size, author(s) were contacted to obtain these data. We used random-effects meta-analysis and robust-variance estimation procedures to synthesise effect sizes. If a study included multiple effects, we carried out a critical assessment to determine (even if only theoretically) whether the effects are likely to be dependent. Where dependent effects were identified, we used robust variance estimation to determine whether we can account for these. Where effect sizes were converted from a binary to continuous measure (or vice versa), we undertook a sensitivity analysis by running an additional analysis with these studies omitted. We also assessed the sensitivity of results to inclusion of non-randomised studies and studies classified as low confidence in findings. All included an assessment of statistical heterogeneity. Finally, we undertook analysis to assess whether publication bias was likely to be a factor in our findings. For those studies that we were unable to include in meta-analysis, we have provided a narrative synthesis of the study and its findings.
We included 48 individual papers covering 34 unique studies. The studies covered 15, 255 participants, with all but one of the studies being from the United States and Canada. Most papers were rated as low confidence (n = 25, or 52%). By far the most common reason for studies being rated as low confidence was high rates of attrition and/or differential attrition of study participants, that fell below the What Works Clearinghouse liberal attrition standard. Eleven of the included studies were rated as medium confidence and 12 studies as high confidence. The interventions included in our analysis were more effective in reducing substance use than treatment as usual, with an overall effect size of -0.11 SD (95% confidence interval [CI], -0.27, 0.05). There was substantial heterogeneity across studies, and the results were sensitive to the removal of low confidence studies (-0.21 SD, 95% CI [-0.59, 0.17] - 6 studies, 17 effect sizes), the removal of quasi-experimental studies (-0.14 SD, 95% CI [-0.30, 0.02] - 14 studies, 41 effect sizes) and the removal of studies where an effect size had been converted from a binary to a continuous outcome (-0.08 SD, 95% CI [-0.31, 0.15] - 10 studies, 31 effect sizes). This suggests that the findings are sensitive to the inclusion of lower quality studies, although unusually the average effect increases when we removed low confidence studies. The average effect for abstinence-based interventions compared to treatment-as-usual (TAU) service provision was -0.28 SD (95% CI, -0.65, 0.09) (6 studies, 15 effect sizes), and for harm reduction interventions compared to a TAU service provision is close to 0 at 0.03 SD (95% CI, -0.08, 0.14) (9 studies, 30 effect sizes). The confidence intervals for both estimates are wide and crossing zero. For both, the comparison groups are primarily abstinence-based, with the exception of two studies where the comparison group condition was unclear. We found that both Assertative Community Treatment and Intensive Case Management were no better than treatment as usual, with average effect on substance use of 0.03 SD, 95% CI [-0.07, 0.13] and -0.47 SD, 95% CI [-0.72, -0.21] 0.05 SD, 95% CI [-0.28, 0.39] respectively. These findings are consistent with wider research, and it is important to note that we only examined the effect on substance use outcomes (these interventions can be effective in terms of other outcomes). We found that CM interventions can be effective in reducing substance use compared to treatment as usual, with an average effect of -0.47 SD, 95% CI (-0.72, -0.21). All of these results need to be considered in light of the quality of the underlying evidence. There were six further interventions where we undertook narrative synthesis. These syntheses suggest that Group Work, Harm Reduction Psychotherapy, and Therapeutic Communities are effective in reducing substance use, with mixed results found for Motivational Interviewing and Talking Therapies (including Cognitive Behavioural Therapy). The narrative synthesis suggested that Residential Rehabilitation was no better than treatment as usual in terms of reducing substance use for our population of interest.
Although our analysis of harm reduction versus treatment as usual, abstinence versus treatment as usual, and harm reduction versus abstinence suggests that these different approaches make little real difference to the outcomes achieved in comparison to treatment as usual. The findings suggest that some individual interventions are more effective than others. The overall low quality of the primary studies suggests that further primary impact research could be beneficial.
O'Leary C
,Ralphs R
,Stevenson J
,Smith A
,Harrison J
,Kiss Z
,Armitage H
... -
《-》
-
What is the volume, quality and characteristics of evidence relating to the effectiveness and cost-effectiveness of multi-disciplinary occupational health interventions aiming to improve work-related outcomes for employed adults? An evidence and gap map o
In the UK, tens of millions of working days are lost due to work-related ill health every year, costing billions of pounds. The role of Occupational Health (OH) services is vital in helping workers to maintain employment when they encounter injury or illness. OH providers traditionally rely on a clinical workforce to deliver these services, particularly doctors and nurses with OH qualifications. However, the increasing demand for OH services is unlikely to be met in the future using this traditional model, due to the declining number of OH-trained doctors and nurses in the UK. Multi-disciplinary models of OH delivery, including a more varied range of healthcare and non-healthcare professionals, could provide a way to meet this new demand for OH services. There is a need to identify collaborative models of OH service delivery and review their effectiveness on return-to work outcomes. There is an existing pool of systematic review evidence evaluating workplace based, multi-disciplinary OH interventions, but it is difficult to identify which aspects of the content and/or delivery of these interventions may be associated with improved work-related outcomes.
The aim of this evidence and gap map (EGM) was to provide an overview of the systematic review evidence that evaluates the effectiveness and cost-effectiveness of multi-disciplinary OH interventions intending to improve work-related outcomes.
In June 2021 we searched a selection of bibliographic databases and other academic literature resources covering a range of relevant disciplines, including health care and business studies, to identify systematic review evidence from a variety of sectors of employment. We also searched Google Search and a selection of topically relevant websites and consulted with stakeholders to identify reports already known to them. Searches were updated in February 2023.
Systematic reviews needed to be about adults (16 years or over) in employment, who have had absence from work for any medical reason. Interventions needed to be multi-disciplinary (including professionals from different backgrounds in clinical and non-clinical professions) and designed to support employees and employers to manage health conditions in the workplace and/or to help employees with health conditions retain and/or return to work following medical absence. Effectiveness needed to be measured in terms of return to work, work retention or measures of absence, or economic evaluation outcomes. These criteria were applied to the title and abstract and full text of each systematic review independently by two reviewers, with disagreements resolved through discussion. We awarded each systematic review a rating of 'High', 'Medium' or 'Low' relevance to indicate the extent to which the populations, interventions and their contexts synthesised within the review were consistent with our research question. We also recorded the number of primary studies included within each of the 'High' and 'Medium' reviews that were relevant to research question using the same screening process applied at review level.
Summary data for each eligible review was extracted. The quality of the systematic reviews, rated as 'High' or 'Medium' relevance following full text screening, was appraised using the AMSTAR-2 quality appraisal tool. All data were extracted by one reviewer and checked by a second, with disagreements being settled through discussion. Summary data for all eligible systematic reviews were tabulated and described narratively. The data extracted from reviews of 'High' and 'Medium' relevance was imported into EPPI-Mapper software to create an EGM.
We worked alongside commissioners and policy makers from the Department of Health and Social Care (DHSC) and Department of Work and Pensions (DWP), OH personnel, and people with lived experience of accessing OH services themselves and/or supporting employees to access OH services. Individuals contributed to decision making at all stages of the project. This ensured our EGM reflects the needs of individuals who will use it.
We identified 98 systematic reviews that contained relevant interventions, which involved a variety of professionals and workplaces, and which measured effectiveness in terms of return to work (RTW). Of these, we focused on the 30 reviews where the population and intervention characteristics within the systematic reviews were considered to be of high or medium relevance to our research questions. The 30 reviews were of varying quality, split evenly between High/Moderate quality and Low/Critically-Low quality ratings. We did not identify any relevant systematic review evidence on any other work-related outcome of interest. Interventions were heterogenous, both within and across included systematic reviews. The EGM is structured according to the health condition experienced by participants, and the effectiveness of the interventions being evaluated, as reported within the included systematic reviews. It is possible to view (i) the quality and quantity of systematic review evidence for a given health condition, (ii) how review authors assessed the effectiveness or cost-effectiveness of the interventions evaluated. The EGM also details the primary studies relevant to our research aim included within each review.
This EGM map highlights the array of systematic review evidence that exists in relation to the effectiveness or cost-effectiveness of multi-disciplinary, workplace-based OH interventions in supporting RTW. This evidence will allow policy makers and commissioners of services to determine which OH interventions may be most useful for supporting different population groups in different contexts. OH professionals may find the content of the EGM useful in identifying systematic review evidence to support their practice. The EGM also identifies where systematic review evidence in this area is lacking, or where existing evidence is of poor quality. These may represent areas where it may be particularly useful to conduct further systematic reviews.
Shaw E
,Nunns M
,Spicer SG
,Lawal H
,Briscoe S
,Melendez-Torres GJ
,Garside R
,Liabo K
,Coon JT
... -
《-》