Tracking health commodity inventory and notifying stock levels via mobile devices: a mixed methods systematic review.

Health systems need timely and reliable access to essential medicines and health commodities, but problems with access are common in many settings. Mobile technologies offer potential low-cost solutions to the challenge of drug distribution and commodity availability in primary healthcare settings. However, the evidence on the use of mobile devices to address commodity shortages is sparse, and offers no clear way forward. Primary objective To assess the effects of strategies for notifying stock levels and digital tracking of healthcare-related commodities and inventory via mobile devices across the primary healthcare system Secondary objectives To describe what mobile device strategies are currently being used to improve reporting and digital tracking of health commodities To identify factors influencing the implementation of mobile device interventions targeted at reducing stockouts of health commodities SEARCH METHODS: We searched CENTRAL, MEDLINE Ovid, Embase Ovid, Global Index Medicus WHO, POPLINE K4Health, and two trials registries in August 2019. We also searched Epistemonikos for related systematic reviews and potentially eligible primary studies. We conducted a grey literature search using mHealthevidence.org, and issued a call for papers through popular digital health communities of practice. Finally, we conducted citation searches of included studies. We searched for studies published after 2000, in any language. For the primary objective, we included individual and cluster-randomised trials, controlled before-after studies, and interrupted time series studies. For the secondary objectives, we included any study design, which could be quantitative, qualitative, or descriptive, that aimed to describe current strategies for commodity tracking or stock notification via mobile devices; or aimed to explore factors that influenced the implementation of these strategies, including studies of acceptability or feasibility. We included studies of all cadres of healthcare providers, including lay health workers, and others involved in the distribution of health commodities (administrative staff, managerial and supervisory staff, dispensary staff); and all other individuals involved in stock notification, who may be based in a facility or a community setting, and involved with the delivery of primary healthcare services. We included interventions aimed at improving the availability of health commodities using mobile devices in primary healthcare settings. For the primary objective, we included studies that compared health commodity tracking or stock notification via mobile devices with standard practice. For the secondary objectives, we included studies of health commodity tracking and stock notification via mobile device, if we could extract data relevant to our secondary objectives. For the primary objective, two authors independently screened all records, extracted data from the included studies, and assessed the risk of bias. For the analyses of the primary objectives, we reported means and proportions where appropriate. We used the GRADE approach to assess the certainty of the evidence, and prepared a 'Summary of findings' table. For the secondary objective, two authors independently screened all records, extracted data from the included studies, and applied a thematic synthesis approach to synthesise the data. We assessed methodological limitation using the Ways of Evaluating Important and Relevant Data (WEIRD) tool. We used the GRADE-CERQual approach to assess our confidence in the evidence, and prepared a 'Summary of qualitative findings' table. Primary objective For the primary objective, we included one controlled before-after study conducted in Malawi. We are uncertain of the effect of cStock plus enhanced management, or cStock plus effective product transport on the availability of commodities, quality and timeliness of stock management, and satisfaction and acceptability, because we assessed the evidence as very low-certainty. The study did not report on resource use or unintended consequences. Secondary objective For the secondary objectives, we included 16 studies, using a range of study designs, which described a total of eleven interventions. All studies were conducted in African (Tanzania, Kenya, Malawi, Ghana, Ethiopia, Cameroon, Zambia, Liberia, Uganda, South Africa, and Rwanda) and Asian (Pakistan and India) countries. Most of the interventions aimed to make data about stock levels and potential stockouts visible to managers, who could then take corrective action to address them. We identified several factors that may influence the implementation of stock notification and tracking via mobile device. These include challenges tied to infrastructural issues, such as poor access to electricity or internet, and broader health systems issues, such as drug shortages at the national level which cannot be mitigated by interventions at the primary healthcare level (low confidence). Several factors were identified as important, including strong partnerships with local authorities, telecommunication companies, technical system providers, and non-governmental organizations (very low confidence); availability of stock-level data at all levels of the health system (low confidence); the role of supportive supervision and responsive management (moderate confidence); familiarity and training of health workers in the use of the digital devices (moderate confidence); availability of technical programming expertise for the initial development and ongoing maintenance of the digital systems (low confidence); incentives, such as phone credit for personal use, to support regular use of the system (low confidence); easy-to-use systems built with user participation (moderate confidence); use of basic or personal mobile phones to support easier adoption (low confidence); consideration for software features, such as two-way communication (low confidence); and data availability in an easy-to-use format, such as an interactive dashboard (moderate confidence). We need more, well-designed, controlled studies comparing stock notification and commodity management via mobile devices with paper-based commodity management systems. Further studies are needed to understand the factors that may influence the implementation of such interventions, and how implementation considerations differ by variations in the intervention.

Agarwal S ，Glenton C ，Henschke N ，Tamrat T ，Bergman H ，Fønhus MS ，Mehl GL ，Lewin S ... -  《Cochrane Database of Systematic Reviews》

Birth and death notification via mobile devices: a mixed methods systematic review.

Ministries of health, donors, and other decision-makers are exploring how they can use mobile technologies to acquire accurate and timely statistics on births and deaths. These stakeholders have called for evidence-based guidance on this topic. This review was carried out to support World Health Organization (WHO) recommendations on digital interventions for health system strengthening. Primary objective: To assess the effects of birth notification and death notification via a mobile device, compared to standard practice. Secondary objectives: To describe the range of strategies used to implement birth and death notification via mobile devices and identify factors influencing the implementation of birth and death notification via mobile devices. We searched CENTRAL, MEDLINE, Embase, the Global Health Library, and POPLINE (August 2, 2019). We searched two trial registries (August 2, 2019). We also searched Epistemonikos for related systematic reviews and potentially eligible primary studies (August 27, 2019). We conducted a grey literature search using mHealthevidence.org (August 15, 2017) and issued a call for papers through popular digital health communities of practice. Finally, we conducted citation searches of included studies in Web of Science and Google Scholar (May 15, 2020). We searched for studies published after 2000 in any language.  SELECTION CRITERIA: For the primary objective, we included individual and cluster-randomised trials; cross-over and stepped-wedge study designs; controlled before-after studies, provided they have at least two intervention sites and two control sites; and interrupted time series studies. For the secondary objectives, we included any study design, either quantitative, qualitative, or descriptive, that aimed to describe current strategies for birth and death notification via mobile devices; or to explore factors that influence the implementation of these strategies, including studies of acceptability or feasibility. For the primary objective, we included studies that compared birth and death notification via mobile devices with standard practice. For the secondary objectives, we included studies of birth and death notification via mobile device as long as we could extract data relevant to our secondary objectives. We included studies of all cadres of healthcare providers, including lay health workers; administrative, managerial, and supervisory staff; focal individuals at the village or community level; children whose births were being notified and their parents/caregivers; and individuals whose deaths were being notified and their relatives/caregivers. For the primary objective, two authors independently screened all records, extracted data from the included studies and assessed risk of bias. For the analyses of the primary objective, we reported means and proportions, where appropriate. We used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to assess the certainty of the evidence and we prepared a 'Summary of Findings' table. For the secondary objectives, two authors screened all records, one author extracted data from the included studies and assessed methodological limitations using the WEIRD tool and a second author checked the data and assessments. We carried out a framework analysis using the Supporting the Use of Research Evidence (SURE) framework to identify themes in the data. We used the GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research) approach to assess our confidence in the evidence and we prepared a 'Summary of Qualitative Findings' table. For the primary objective, we included one study, which used a controlled before-after study design. The study was conducted in Lao People's Democratic Republic and assessed the effect of using mobile devices for birth notification on outcomes related to coverage and timeliness of Hepatitis B vaccination. However, we are uncertain of the effect of this approach on these outcomes because the certainty of this evidence was assessed as very low. The included study did not assess resource use or unintended consequences. For the primary objective, we did not identify any studies using mobile devices for death notification. For the secondary objective, we included 21 studies. All studies were conducted in low- or middle-income settings. They focussed on identification of births and deaths in rural, remote, or marginalised populations who are typically under-represented in civil registration processes or traditionally seen as having poor access to health services. The review identified several factors that could influence the implementation of birth-death notification via mobile device. These factors were tied to the health system, the person responsible for notifying, the community and families; and include: - Geographic barriers that could prevent people's access to birth-death notification and post-notification services - Access to health workers and other notifiers with enough training, supervision, support, and incentives - Monitoring systems that ensure the quality and timeliness of the birth and death data - Legal frameworks that allow births and deaths to be notified by mobile device and by different types of notifiers - Community awareness of the need to register births and deaths - Socio-cultural norms around birth and death - Government commitment - Cost to the system, to health workers and to families - Access to electricity and network connectivity, and compatibility with existing systems - Systems that protect data confidentiality We have low to moderate confidence in these findings. This was mainly because of concerns about methodological limitations and data adequacy. We need more, well-designed studies of the effect of birth and death notification via mobile devices and on factors that may influence its implementation.

Vasudevan L ，Glenton C ，Henschke N ，Maayan N ，Eyers J ，Fønhus MS ，Tamrat T ，Mehl GL ，Lewin S ... -  《Cochrane Database of Systematic Reviews》

Decision-support tools via mobile devices to improve quality of care in primary healthcare settings.

The ubiquity of mobile devices has made it possible for clinical decision-support systems (CDSS) to become available to healthcare providers on handheld devices at the point-of-care, including in low- and middle-income countries. The use of CDSS by providers can potentially improve adherence to treatment protocols and patient outcomes. However, the evidence on the effect of the use of CDSS on mobile devices needs to be synthesized. This review was carried out to support a World Health Organization (WHO) guideline that aimed to inform investments on the use of decision-support tools on digital devices to strengthen primary healthcare. To assess the effects of digital clinical decision-support systems (CDSS) accessible via mobile devices by primary healthcare providers in the context of primary care settings. We searched CENTRAL, MEDLINE, Embase, Global Index Medicus, POPLINE, and two trial registries from 1 January 2000 to 9 October 2020. We conducted a grey literature search using mHealthevidence.org and issued a call for papers through popular digital health communities of practice. Finally, we conducted citation searches of included studies. Study design: we included randomized trials, including full-text studies, conference abstracts, and unpublished data irrespective of publication status or language of publication.  Types of participants: we included studies of all cadres of healthcare providers, including lay health workers and other individuals (administrative, managerial, and supervisory staff) involved in the delivery of primary healthcare services using clinical decision-support tools; and studies of clients or patients receiving care from primary healthcare providers using digital decision-support tools. Types of interventions: we included studies comparing digital CDSS accessible via mobile devices with non-digital CDSS or no intervention, in the context of primary care. CDSS could include clinical protocols, checklists, and other job-aids which supported risk prioritization of patients. Mobile devices included mobile phones of any type (but not analogue landline telephones), as well as tablets, personal digital assistants, and smartphones. We excluded studies where digital CDSS were used on laptops or integrated with electronic medical records or other types of longitudinal tracking of clients. A machine learning classifier that gave each record a probability score of being a randomized trial screened all search results. Two review authors screened titles and abstracts of studies with more than 10% probability of being a randomized trial, and one review author screened those with less than 10% probability of being a randomized trial. We followed standard methodological procedures expected by Cochrane and the Effective Practice and Organisation of Care group. We used the GRADE approach to assess the certainty of the evidence for the most important outcomes. Eight randomized trials across varying healthcare contexts in the USA,. India, China, Guatemala, Ghana, and Kenya, met our inclusion criteria. A range of healthcare providers (facility and community-based, formally trained, and lay workers) used digital CDSS. Care was provided for the management of specific conditions such as cardiovascular disease, gastrointestinal risk assessment, and maternal and child health. The certainty of evidence ranged from very low to moderate, and we often downgraded evidence for risk of bias and imprecision. We are uncertain of the effect of this intervention on providers' adherence to recommended practice due to the very low certainty evidence (2 studies, 185 participants). The effect of the intervention on patients' and clients' health behaviours such as smoking and treatment adherence is mixed, with substantial variation across outcomes for similar types of behaviour (2 studies, 2262 participants). The intervention probably makes little or no difference to smoking rates among people at risk of cardiovascular disease but probably increases other types of desired behaviour among patients, such as adherence to treatment. The effect of the intervention on patients'/clients' health status and well-being  is also mixed (5 studies, 69,767 participants). It probably makes little or no difference to some types of health outcomes, but we are uncertain about other health outcomes, including maternal and neonatal deaths, due to very low-certainty evidence. The intervention may slightly improve patient or client acceptability and satisfaction (1 study, 187 participants). We found no studies that reported the time between the presentation of an illness and appropriate management, provider acceptability or satisfaction, resource use, or unintended consequences. We are uncertain about the effectiveness of mobile phone-based decision-support tools on several outcomes, including adherence to recommended practice. None of the studies had a quality of care framework and focused only on specific health areas.   We need well-designed research that takes a systems lens to assess these issues.

Agarwal S ，Glenton C ，Tamrat T ，Henschke N ，Maayan N ，Fønhus MS ，Mehl GL ，Lewin S ... -  《Cochrane Database of Systematic Reviews》

Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Description of the condition Malaria, an infectious disease transmitted by the bite of female mosquitoes from several Anopheles species, occurs in 87 countries with ongoing transmission (WHO 2020). The World Health Organization (WHO) estimated that, in 2019, approximately 229 million cases of malaria occurred worldwide, with 94% occurring in the WHO's African region (WHO 2020). Of these malaria cases, an estimated 409,000 deaths occurred globally, with 67% occurring in children under five years of age (WHO 2020). Malaria also negatively impacts the health of women during pregnancy, childbirth, and the postnatal period (WHO 2020). Sulfadoxine/pyrimethamine (SP), an antifolate antimalarial, has been widely used across sub-Saharan Africa as the first-line treatment for uncomplicated malaria since it was first introduced in Malawi in 1993 (Filler 2006). Due to increasing resistance to SP, in 2000 the WHO recommended that one of several artemisinin-based combination therapies (ACTs) be used instead of SP for the treatment of uncomplicated malaria caused by Plasmodium falciparum (Global Partnership to Roll Back Malaria 2001). However, despite these recommendations, SP continues to be advised for intermittent preventive treatment in pregnancy (IPTp) and intermittent preventive treatment in infants (IPTi), whether the person has malaria or not (WHO 2013). Description of the intervention Folate (vitamin B9) includes both naturally occurring folates and folic acid, the fully oxidized monoglutamic form of the vitamin, used in dietary supplements and fortified food. Folate deficiency (e.g. red blood cell (RBC) folate concentrations of less than 305 nanomoles per litre (nmol/L); serum or plasma concentrations of less than 7 nmol/L) is common in many parts of the world and often presents as megaloblastic anaemia, resulting from inadequate intake, increased requirements, reduced absorption, or abnormal metabolism of folate (Bailey 2015; WHO 2015a). Pregnant women have greater folate requirements; inadequate folate intake (evidenced by RBC folate concentrations of less than 400 nanograms per millilitre (ng/mL), or 906 nmol/L) prior to and during the first month of pregnancy increases the risk of neural tube defects, preterm delivery, low birthweight, and fetal growth restriction (Bourassa 2019). The WHO recommends that all women who are trying to conceive consume 400 micrograms (µg) of folic acid daily from the time they begin trying to conceive through to 12 weeks of gestation (WHO 2017). In 2015, the WHO added the dosage of 0.4 mg of folic acid to the essential drug list (WHO 2015c). Alongside daily oral iron (30 mg to 60 mg elemental iron), folic acid supplementation is recommended for pregnant women to prevent neural tube defects, maternal anaemia, puerperal sepsis, low birthweight, and preterm birth in settings where anaemia in pregnant women is a severe public health problem (i.e. where at least 40% of pregnant women have a blood haemoglobin (Hb) concentration of less than 110 g/L). How the intervention might work Potential interactions between folate status and malaria infection The malaria parasite requires folate for survival and growth; this has led to the hypothesis that folate status may influence malaria risk and severity. In rhesus monkeys, folate deficiency has been found to be protective against Plasmodium cynomolgi malaria infection, compared to folate-replete animals (Metz 2007). Alternatively, malaria may induce or exacerbate folate deficiency due to increased folate utilization from haemolysis and fever. Further, folate status measured via RBC folate is not an appropriate biomarker of folate status in malaria-infected individuals since RBC folate values in these individuals are indicative of both the person's stores and the parasite's folate synthesis. A study in Nigeria found that children with malaria infection had significantly higher RBC folate concentrations compared to children without malaria infection, but plasma folate levels were similar (Bradley-Moore 1985). Why it is important to do this review The malaria parasite needs folate for survival and growth in humans. For individuals, adequate folate levels are critical for health and well-being, and for the prevention of anaemia and neural tube defects. Many countries rely on folic acid supplementation to ensure adequate folate status in at-risk populations. Different formulations for folic acid supplements are available in many international settings, with dosages ranging from 400 µg to 5 mg. Evaluating folic acid dosage levels used in supplementation efforts may increase public health understanding of its potential impacts on malaria risk and severity and on treatment failures. Examining folic acid interactions with antifolate antimalarial medications and with malaria disease progression may help countries in malaria-endemic areas determine what are the most appropriate lower dose folic acid formulations for at-risk populations. The WHO has highlighted the limited evidence available and has indicated the need for further research on biomarkers of folate status, particularly interactions between RBC folate concentrations and tuberculosis, human immunodeficiency virus (HIV), and antifolate antimalarial drugs (WHO 2015b). An earlier Cochrane Review assessed the effects and safety of iron supplementation, with or without folic acid, in children living in hyperendemic or holoendemic malaria areas; it demonstrated that iron supplementation did not increase the risk of malaria, as indicated by fever and the presence of parasites in the blood (Neuberger 2016). Further, this review stated that folic acid may interfere with the efficacy of SP; however, the efficacy and safety of folic acid supplementation on these outcomes has not been established. This review will provide evidence on the effectiveness of daily folic acid supplementation in healthy and malaria-infected individuals living in malaria-endemic areas. Additionally, it will contribute to achieving both the WHO Global Technical Strategy for Malaria 2016-2030 (WHO 2015d), and United Nations Sustainable Development Goal 3 (to ensure healthy lives and to promote well-being for all of all ages) (United Nations 2021), and evaluating whether the potential effects of folic acid supplementation, at different doses (e.g. 0.4 mg, 1 mg, 5 mg daily), interferes with the effect of drugs used for prevention or treatment of malaria. To examine the effects of folic acid supplementation, at various doses, on malaria susceptibility (risk of infection) and severity among people living in areas with various degrees of malaria endemicity. We will examine the interaction between folic acid supplements and antifolate antimalarial drugs. Specifically, we will aim to answer the following. Among uninfected people living in malaria endemic areas, who are taking or not taking antifolate antimalarials for malaria prophylaxis, does taking a folic acid-containing supplement increase susceptibility to or severity of malaria infection? Among people with malaria infection who are being treated with antifolate antimalarials, does folic acid supplementation increase the risk of treatment failure? Criteria for considering studies for this review Types of studies Inclusion criteria Randomized controlled trials (RCTs) Quasi-RCTs with randomization at the individual or cluster level conducted in malaria-endemic areas (areas with ongoing, local malaria transmission, including areas approaching elimination, as listed in the World Malaria Report 2020) (WHO 2020) Exclusion criteria Ecological studies Observational studies In vivo/in vitro studies Economic studies Systematic literature reviews and meta-analyses (relevant systematic literature reviews and meta-analyses will be excluded but flagged for grey literature screening) Types of participants Inclusion criteria Individuals of any age or gender, living in a malaria endemic area, who are taking antifolate antimalarial medications (including but not limited to sulfadoxine/pyrimethamine (SP), pyrimethamine-dapsone, pyrimethamine, chloroquine and proguanil, cotrimoxazole) for the prevention or treatment of malaria (studies will be included if more than 70% of the participants live in malaria-endemic regions) Studies assessing participants with or without anaemia and with or without malaria parasitaemia at baseline will be included Exclusion criteria Individuals not taking antifolate antimalarial medications for prevention or treatment of malaria Individuals living in non-malaria endemic areas Types of interventions Inclusion criteria Folic acid supplementation Form: in tablet, capsule, dispersible tablet at any dose, during administration, or periodically Timing: during, before, or after (within a period of four to six weeks) administration of antifolate antimalarials Iron-folic acid supplementation Folic acid supplementation in combination with co-interventions that are identical between the intervention and control groups. Co-interventions include: anthelminthic treatment; multivitamin or multiple micronutrient supplementation; 5-methyltetrahydrofolate supplementation. Exclusion criteria Folate through folate-fortified water Folic acid administered through large-scale fortification of rice, wheat, or maize Comparators Placebo No treatment No folic acid/different doses of folic acid Iron Types of outcome measures Primary outcomes Uncomplicated malaria (defined as a history of fever with parasitological confirmation; acceptable parasitological confirmation will include rapid diagnostic tests (RDTs), malaria smears, or nucleic acid detection (i.e. polymerase chain reaction (PCR), loop-mediated isothermal amplification (LAMP), etc.)) (WHO 2010). This outcome is relevant for patients without malaria, given antifolate antimalarials for malaria prophylaxis. Severe malaria (defined as any case with cerebral malaria or acute P. falciparum malaria, with signs of severity or evidence of vital organ dysfunction, or both) (WHO 2010). This outcome is relevant for patients without malaria, given antifolate antimalarials for malaria prophylaxis. Parasite clearance (any Plasmodium species), defined as the time it takes for a patient who tests positive at enrolment and is treated to become smear-negative or PCR negative. This outcome is relevant for patients with malaria, treated with antifolate antimalarials. Treatment failure (defined as the inability to clear malaria parasitaemia or prevent recrudescence after administration of antimalarial medicine, regardless of whether clinical symptoms are resolved) (WHO 2019). This outcome is relevant for patients with malaria, treated with antifolate antimalarials. Secondary outcomes Duration of parasitaemia Parasite density Haemoglobin (Hb) concentrations (g/L) Anaemia: severe anaemia (defined as Hb less than 70 g/L in pregnant women and children aged six to 59 months; and Hb less than 80 g/L in other populations); moderate anaemia (defined as Hb less than 100 g/L in pregnant women and children aged six to 59 months; and less than 110 g/L in others) Death from any cause Among pregnant women: stillbirth (at less than 28 weeks gestation); low birthweight (less than 2500 g); active placental malaria (defined as Plasmodium detected in placental blood by smear or PCR, or by Plasmodium detected on impression smear or placental histology). Search methods for identification of studies A search will be conducted to identify completed and ongoing studies, without date or language restrictions. Electronic searches A search strategy will be designed to include the appropriate subject headings and text word terms related to each intervention of interest and study design of interest (see Appendix 1). Searches will be broken down by these two criteria (intervention of interest and study design of interest) to allow for ease of prioritization, if necessary. The study design filters recommended by the Scottish Intercollegiate Guidelines Network (SIGN), and those designed by Cochrane for identifying clinical trials for MEDLINE and Embase, will be used (SIGN 2020). There will be no date or language restrictions. Non-English articles identified for inclusion will be translated into English. If translations are not possible, advice will be requested from the Cochrane Infectious Diseases Group and the record will be stored in the "Awaiting assessment" section of the review until a translation is available. The following electronic databases will be searched for primary studies. Cochrane Central Register of Controlled Trials. Cumulative Index to Nursing and Allied Health Literature (CINAHL). Embase. MEDLINE. Scopus. Web of Science (both the Social Science Citation Index and the Science Citation Index). We will conduct manual searches of ClinicalTrials.gov, the International Clinical Trials Registry Platform (ICTRP), and the United Nations Children's Fund (UNICEF) Evaluation and Research Database (ERD), in order to identify relevant ongoing or planned trials, abstracts, and full-text reports of evaluations, studies, and surveys related to programmes on folic acid supplementation in malaria-endemic areas. Additionally, manual searches of grey literature to identify RCTs that have not yet been published but are potentially eligible for inclusion will be conducted in the following sources. Global Index Medicus (GIM). African Index Medicus (AIM). Index Medicus for the Eastern Mediterranean Region (IMEMR). Latin American & Caribbean Health Sciences Literature (LILACS). Pan American Health Organization (PAHO). Western Pacific Region Index Medicus (WPRO). Index Medicus for the South-East Asian Region (IMSEAR). The Spanish Bibliographic Index in Health Sciences (IBECS) (ibecs.isciii.es/). Indian Journal of Medical Research (IJMR) (journals.lww.com/ijmr/pages/default.aspx). Native Health Database (nativehealthdatabase.net/). Scielo (www.scielo.br/). Searching other resources Handsearches of the five journals with the highest number of included studies in the last 12 months will be conducted to capture any relevant articles that may not have been indexed in the databases at the time of the search. We will contact the authors of included studies and will check reference lists of included papers for the identification of additional records. For assistance in identifying ongoing or unpublished studies, we will contact the Division of Nutrition, Physical Activity, and Obesity (DNPAO) and the Division of Parasitic Diseases and Malaria (DPDM) of the CDC, the United Nations World Food Programme (WFP), Nutrition International (NI), Global Alliance for Improved Nutrition (GAIN), and Hellen Keller International (HKI). Data collection and analysis Selection of studies Two review authors will independently screen the titles and abstracts of articles retrieved by each search to assess eligibility, as determined by the inclusion and exclusion criteria. Studies deemed eligible for inclusion by both review authors in the abstract screening phase will advance to the full-text screening phase, and full-text copies of all eligible papers will be retrieved. If full articles cannot be obtained, we will attempt to contact the authors to obtain further details of the studies. If such information is not obtained, we will classify the study as "awaiting assessment" until further information is published or made available to us. The same two review authors will independently assess the eligibility of full-text articles for inclusion in the systematic review. If any discrepancies occur between the studies selected by the two review authors, a third review author will provide arbitration. Each trial will be scrutinized to identify multiple publications from the same data set, and the justification for excluded trials will be documented. A PRISMA flow diagram of the study selection process will be presented to provide information on the number of records identified in the literature searches, the number of studies included and excluded, and the reasons for exclusion (Moher 2009). The list of excluded studies, along with their reasons for exclusion at the full-text screening phase, will also be created. Data extraction and management Two review authors will independently extract data for the final list of included studies using a standardized data specification form. Discrepancies observed between the data extracted by the two authors will be resolved by involving a third review author and reaching a consensus. Information will be extracted on study design components, baseline participant characteristics, intervention characteristics, and outcomes. For individually randomized trials, we will record the number of participants experiencing the event and the number analyzed in each treatment group or the effect estimate reported (e.g. risk ratio (RR)) for dichotomous outcome measures. For count data, we will record the number of events and the number of person-months of follow-up in each group. If the number of person-months is not reported, the product of the duration of follow-up and the number of children evaluated will be used to estimate this figure. We will calculate the rate ratio and standard error (SE) for each study. Zero events will be replaced by 0.5. We will extract both adjusted and unadjusted covariate incidence rate ratios if they are reported in the original studies. For continuous data, we will extract means (arithmetic or geometric) and a measure of variance (standard deviation (SD), SE, or confidence interval (CI)), percentage or mean change from baseline, and the numbers analyzed in each group. SDs will be computed from SEs or 95% CIs, assuming a normal distribution of the values. Haemoglobin values in g/dL will be calculated by multiplying haematocrit or packed cell volume values by 0.34, and studies reporting haemoglobin values in g/dL will be converted to g/L. In cluster-randomized trials, we will record the unit of randomization (e.g. household, compound, sector, or village), the number of clusters in the trial, and the average cluster size. The statistical methods used to analyze the trials will be documented, along with details describing whether these methods adjusted for clustering or other covariates. We plan to extract estimates of the intra-cluster correlation coefficient (ICC) for each outcome. Where results are adjusted for clustering, we will extract the treatment effect estimate and the SD or CI. If the results are not adjusted for clustering, we will extract the data reported. Assessment of risk of bias in included studies Two review authors (KSC, LFY) will independently assess the risk of bias for each included trial using the Cochrane 'Risk of bias 2' tool (RoB 2) for randomized studies (Sterne 2019). Judgements about the risk of bias of included studies will be made according to the recommendations outlined in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2021). Disagreements will be resolved by discussion, or by involving a third review author. The interest of our review will be to assess the effect of assignment to the interventions at baseline. We will evaluate each primary outcome using the RoB2 tool. The five domains of the Cochrane RoB2 tool include the following. Bias arising from the randomization process. Bias due to deviations from intended interventions. Bias due to missing outcome data. Bias in measurement of the outcome. Bias in selection of the reported result. Each domain of the RoB2 tool comprises the following. A series of 'signalling' questions. A judgement about the risk of bias for the domain, facilitated by an algorithm that maps responses to the signalling questions to a proposed judgement. Free-text boxes to justify responses to the signalling questions and 'Risk of bias' judgements. An option to predict (and explain) the likely direction of bias. Responses to signalling questions elicit information relevant to an assessment of the risk of bias. These response options are as follows. Yes (may indicate either low or high risk of bias, depending on the most natural way to ask the question). Probably yes. Probably no. No. No information (may indicate no evidence of that problem or an absence of information leading to concerns about there being a problem). Based on the answer to the signalling question, a 'Risk of bias' judgement is assigned to each domain. These judgements include one of the following. High risk of bias Low risk of bias Some concerns To generate the risk of bias judgement for each domain in the randomized studies, we will use the Excel template, available at www.riskofbias.info/welcome/rob-2-0-tool/current-version-of-rob-2. This file will be stored on a scientific data website, available to readers. Risk of bias in cluster randomized controlled trials For the cluster randomized trials, we will be using the RoB2 tool to analyze the five standard domains listed above along with Domain 1b (bias arising from the timing of identification or recruitment of participants) and its related signalling questions. To generate the risk of bias judgement for each domain in the cluster RCTs, we will use the Excel template available at https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool/rob-2-for-cluster-randomized-trials. This file will be stored on a scientific data website, available to readers. Risk of bias in cross-over randomized controlled trials For cross-over randomized trials, we will be using the RoB2 tool to analyze the five standard domains listed above along with Domain 2 (bias due to deviations from intended interventions), and Domain 3 (bias due to missing outcome data), and their respective signalling questions. To generate the risk of bias judgement for each domain in the cross-over RCTs, we will use the Excel template, available at https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool/rob-2-for-crossover-trials, for each risk of bias judgement of cross-over randomized studies. This file will be stored on a scientific data website, available to readers. Overall risk of bias The overall 'Risk of bias' judgement for each specific trial being assessed will be based on each domain-level judgement. The overall judgements include the following. Low risk of bias (the trial is judged to be at low risk of bias for all domains). Some concerns (the trial is judged to raise some concerns in at least one domain but is not judged to be at high risk of bias for any domain). High risk of bias (the trial is judged to be at high risk of bias in at least one domain, or is judged to have some concerns for multiple domains in a way that substantially lowers confidence in the result). The 'risk of bias' assessments will inform our GRADE evaluations of the certainty of evidence for our primary outcomes presented in the 'Summary of findings' tables and will also be used to inform the sensitivity analyses; (see Sensitivity analysis). If there is insufficient information in study reports to enable an assessment of the risk of bias, studies will be classified as "awaiting assessment" until further information is published or made available to us. Measures of treatment effect Dichotomous data For dichotomous data, we will present proportions and, for two-group comparisons, results as average RR or odds ratio (OR) with 95% CIs. Ordered categorical data Continuous data We will report results for continuous outcomes as the mean difference (MD) with 95% CIs, if outcomes are measured in the same way between trials. Where some studies have reported endpoint data and others have reported change-from-baseline data (with errors), we will combine these in the meta-analysis, if the outcomes were reported using the same scale. We will use the standardized mean difference (SMD), with 95% CIs, to combine trials that measured the same outcome but used different methods. If we do not find three or more studies for a pooled analysis, we will summarize the results in a narrative form. Unit of analysis issues Cluster-randomized trials We plan to combine results from both cluster-randomized and individually randomized studies, providing there is little heterogeneity between the studies. If the authors of cluster-randomized trials conducted their analyses at a different level from that of allocation, and they have not appropriately accounted for the cluster design in their analyses, we will calculate the trials' effective sample sizes to account for the effect of clustering in data. When one or more cluster-RCT reports RRs adjusted for clustering, we will compute cluster-adjusted SEs for the other trials. When none of the cluster-RCTs provide cluster-adjusted RRs, we will adjust the sample size for clustering. We will divide, by the estimated design effects (DE), the number of events and number evaluated for dichotomous outcomes and the number evaluated for continuous outcomes, where DE = 1 + ((average cluster size 1) * ICC). The derivation of the estimated ICCs and DEs will be reported. We will utilize the intra-cluster correlation coefficient (ICC), derived from the trial (if available), or from another source (e.g., using the ICCs derived from other, similar trials) and then calculate the design effect with the formula provided in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2021). If this approach is used, we will report it and undertake sensitivity analysis to investigate the effect of variations in ICC. Studies with more than two treatment groups If we identify studies with more than two intervention groups (multi-arm studies), where possible we will combine groups to create a single pair-wise comparison or use the methods set out in the Cochrane Handbook to avoid double counting study participants (Higgins 2021). For the subgroup analyses, when the control group was shared by two or more study arms, we will divide the control group (events and total population) over the number of relevant subgroups to avoid double counting the participants. Trials with several study arms can be included more than once for different comparisons. Cross-over trials From cross-over trials, we will consider the first period of measurement only and will analyze the results together with parallel-group studies. Multiple outcome events In several outcomes, a participant might experience more than one outcome event during the trial period. For all outcomes, we will extract the number of participants with at least one event. Dealing with missing data We will contact the trial authors if the available data are unclear, missing, or reported in a format that is different from the format needed. We aim to perform a 'per protocol' or 'as observed' analysis; otherwise, we will perform a complete case analysis. This means that for treatment failure, we will base the analyses on the participants who received treatment and the number of participants for which there was an inability to clear malarial parasitaemia or prevent recrudescence after administration of an antimalarial medicine reported in the studies. Assessment of heterogeneity Heterogeneity in the results of the trials will be assessed by visually examining the forest plot to detect non-overlapping CIs, using the Chi2 test of heterogeneity (where a P value of less than 0.1 indicates statistical significance) and the I2 statistic of inconsistency (with a value of greater than 50% denoting moderate levels of heterogeneity). When statistical heterogeneity is present, we will investigate the reasons for it, using subgroup analysis. Assessment of reporting biases We will construct a funnel plot to assess the effect of small studies for the main outcome (when including more than 10 trials). Data synthesis The primary analysis will include all eligible studies that provide data regardless of the overall risk of bias as assessed by the RoB2 tool. Analyses will be conducted using Review Manager 5.4 (Review Manager 2020). Cluster-RCTs will be included in the main analysis after adjustment for clustering (see the previous section on cluster-RCTs). The meta-analysis will be performed using the Mantel-Haenszel random-effects model or the generic inverse variance method (when adjustment for clustering is performed by adjusting SEs), as appropriate. Subgroup analysis and investigation of heterogeneity The overall risk of bias will not be used as the basis in conducting our subgroup analyses. However, where data are available, we plan to conduct the following subgroup analyses, independent of heterogeneity. Dose of folic acid supplementation: higher doses (4 mg or more, daily) versus lower doses (less than 4 mg, daily). Moderate-severe anaemia at baseline (mean haemoglobin of participants in a trial at baseline below 100 g/L for pregnant women and children aged six to 59 months, and below 110 g/L for other populations) versus normal at baseline (mean haemoglobin above 100 g/L for pregnant women and children aged six to 59 months, and above 110 g/L for other populations). Antimalarial drug resistance to parasite: known resistance versus no resistance versus unknown/mixed/unreported parasite resistance. Folate status at baseline: Deficient (e.g. RBC folate concentration of less than 305 nmol/L, or serum folate concentration of less than 7nmol/L) and Insufficient (e.g. RBC folate concentration from 305 to less than 906 nmol/L, or serum folate concentration from 7 to less than 25 nmol/L) versus Sufficient (e.g. RBC folate concentration above 906 nmol/L, or serum folate concentration above 25 nmol/L). Presence of anaemia at baseline: yes versus no. Mandatory fortification status: yes, versus no (voluntary or none). We will only use the primary outcomes in any subgroup analyses, and we will limit subgroup analyses to those outcomes for which three or more trials contributed data. Comparisons between subgroups will be performed using Review Manager 5.4 (Review Manager 2020). Sensitivity analysis We will perform a sensitivity analysis, using the risk of bias as a variable to explore the robustness of the findings in our primary outcomes. We will verify the behaviour of our estimators by adding and removing studies with a high risk of bias overall from the analysis. That is, studies with a low risk of bias versus studies with a high risk of bias. Summary of findings and assessment of the certainty of the evidence For the assessment across studies, we will use the GRADE approach, as outlined in (Schünemann 2021). We will use the five GRADE considerations (study limitations based on RoB2 judgements, consistency of effect, imprecision, indirectness, and publication bias) to assess the certainty of the body of evidence as it relates to the studies which contribute data to the meta-analyses for the primary outcomes. The GRADEpro Guideline Development Tool (GRADEpro) will be used to import data from Review Manager 5.4 (Review Manager 2020) to create 'Summary of Findings' tables. The primary outcomes for the main comparison will be listed with estimates of relative effects, along with the number of participants and studies contributing data for those outcomes. These tables will provide outcome-specific information concerning the overall certainty of evidence from studies included in the comparison, the magnitude of the effect of the interventions examined, and the sum of available data on the outcomes we considered. We will include only primary outcomes in the summary of findings tables. For each individual outcome, two review authors (KSC, LFY) will independently assess the certainty of the evidence using the GRADE approach (Balshem 2011). For assessments of the overall certainty of evidence for each outcome that includes pooled data from included trials, we will downgrade the evidence from 'high certainty' by one level for serious (or by two for very serious) study limitations (risk of bias, indirectness of evidence, serious inconsistency, imprecision of effect estimates, or potential publication bias).

Crider K ，Williams J ，Qi YP ，Gutman J ，Yeung L ，Mai C ，Finkelstain J ，Mehta S ，Pons-Duran C ，Menéndez C ，Moraleda C ，Rogers L ，Daniels K ，Green P ... -  《Cochrane Database of Systematic Reviews》

Routine Health Information System (RHIS) improvements for strengthened health system management.

A well-functioning routine health information system (RHIS) can provide the information needed for health system management, for governance, accountability, planning, policy making, surveillance and quality improvement, but poor information support has been identified as a major obstacle for improving health system management. To assess the effects of interventions to improve routine health information systems in terms of RHIS performance, and also, in terms of improved health system management performance, and improved patient and population health outcomes. We searched the Cochrane Central Register of Controlled Trials (CENTRAL) in the Cochrane Library, MEDLINE Ovid and Embase Ovid in May 2019. We searched Global Health, Ovid and PsycInfo in April 2016. In January 2020 we searched for grey literature in the Grey Literature Report and in OpenGrey, and for ongoing trials using the International Clinical Trials Registry Platform (ICTRP) and ClinicalTrials.gov. In October 2019 we also did a cited reference search using Web of Science, and a 'similar articles' search in PubMed. Randomised and non-randomised trials, controlled before-after studies and time-series studies comparing routine health information system interventions, with controls, in primary, hospital or community health care settings. Participants included clinical staff and management, district management and community health workers using routine information systems. Two authors independently reviewed records to identify studies for inclusion, extracted data from the included studies and assessed the risk of bias. Interventions and outcomes were too varied across studies to allow for pooled risk analysis. We present a 'Summary of findings' table for each intervention comparisons broadly categorised into Technical and Organisational (or a combination), and report outcomes on data quality and service quality. We used the GRADE approach to assess the certainty of the evidence. We included six studies: four cluster randomised trials and two controlled before-after studies, from Africa and South America. Three studies evaluated technical interventions, one study evaluated an organisational intervention, and two studies evaluated a combination of technical and organisational interventions. Four studies reported on data quality and six studies reported on service quality. In terms of data quality, a web-based electronic TB laboratory information system probably reduces the length of time to reporting of TB test results, and probably reduces the overall rate of recording errors of TB test results, compared to a paper-based system (moderate certainty evidence). We are uncertain about the effect of the electronic laboratory information system on the recording rate of serious (misidentification) errors for TB test results compared to a paper-based system (very low certainty evidence). Misidentification errors are inaccuracies in transferring test results between an electronic register and patients' clinical charts. We are also uncertain about the effect of the intervention on service quality (timeliness of starting or changing a patient's TB treatment) (very low certainty evidence). A hand-held electronic device probably improves the length of time to report TB test results, and probably reduces the total frequency of recording errors in TB test results between the laboratory notebook and the electronic information record system, compared to a paper-based system (moderate-certainty evidence). We are, however, uncertain about the effect of the intervention on the frequency of serious (misidentification) errors in recording between the laboratory notebook and the electronic information record, compared to a paper-based system (very low certainty evidence). We are uncertain about the effect of a hospital electronic health information system on service quality (length of time outpatients spend at hospital, length of hospital stay, and hospital revenue collection), compared to a paper-based system (very low certainty evidence). High-intensity brief text messaging (SMS) may make little or no difference to data quality (in terms of completeness of documentation of pregnancy outcomes), compared to low-intensity brief text messaging (low-certainty evidence). We are uncertain about the effect of electronic drug stock notification (with either data management support or product transfer support) on service quality (in terms of transporting stock and stock levels), compared to paper-based stock notification (very low certainty evidence). We are uncertain about the effect of health information strengthening (where it is part of comprehensive service quality improvement intervention) on service quality (health worker motivation, receipt of training by health workers, health information index scores, quality of clinical observation of children and adults) (very low certainty evidence). The review indicates mixed effects of mainly technical interventions to improve data quality, with gaps in evidence on interventions aimed at enhancing data-informed health system management. There is a gap in interventions studying information support beyond clinical management, such as for human resources, finances, drug supply and governance. We need to have a better understanding of the causal mechanisms by which information support may affect change in management decision-making, to inform robust intervention design and evaluation methods.

Leon N ，Balakrishna Y ，Hohlfeld A ，Odendaal WA ，Schmidt BM ，Zweigenthal V ，Anstey Watkins J ，Daniels K ... -  《Cochrane Database of Systematic Reviews》