Challenges for assessing replicability in preclinical cancer biology.

We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication - it is hard to assess whether reported findings are credible.

Errington TM ，Denis A ，Perfito N ，Iorns E ，Nosek BA ... -  《eLife》

Experiments from unfinished Registered Reports in the Reproducibility Project: Cancer Biology.

As part of the Reproducibility Project: Cancer Biology, we published Registered Reports that described how we intended to replicate selected experiments from 29 high-impact preclinical cancer biology papers published between 2010 and 2012. Replication experiments were completed and Replication Studies reporting the results were submitted for 18 papers, of which 17 were accepted and published by eLife with the rejected paper posted as a preprint. Here, we report the status and outcomes obtained for the remaining 11 papers. Four papers initiated experimental work but were stopped without any experimental outcomes. Two papers resulted in incomplete outcomes due to unanticipated challenges when conducting the experiments. For the remaining five papers only some of the experiments were completed with the other experiments incomplete due to mundane technical or unanticipated methodological challenges. The experiments from these papers, along with the other experiments attempted as part of the Reproducibility Project: Cancer Biology, provides evidence about the challenges of repeating preclinical cancer biology experiments and the replicability of the completed experiments.

Errington TM ，Denis A ，Allison AB ，Araiza R ，Aza-Blanc P ，Bower LR ，Campos J ，Chu H ，Denson S ，Donham C ，Harr K ，Haven B ，Iorns E ，Kwok J ，McDonald E ，Pelech S ，Perfito N ，Pike A ，Sampey D ，Settles M ，Scott DA ，Sharma V ，Tolentino T ，Trinh A ，Tsui R ，Willis B ，Wood J ，Young L ... -  《eLife》

Investigating the replicability of preclinical cancer biology.

Replicability is an important feature of scientific research, but aspects of contemporary research culture, such as an emphasis on novelty, can make replicability seem less important than it should be. The Reproducibility Project: Cancer Biology was set up to provide evidence about the replicability of preclinical research in cancer biology by repeating selected experiments from high-impact papers. A total of 50 experiments from 23 papers were repeated, generating data about the replicability of a total of 158 effects. Most of the original effects were positive effects (136), with the rest being null effects (22). A majority of the original effect sizes were reported as numerical values (117), with the rest being reported as representative images (41). We employed seven methods to assess replicability, and some of these methods were not suitable for all the effects in our sample. One method compared effect sizes: for positive effects, the median effect size in the replications was 85% smaller than the median effect size in the original experiments, and 92% of replication effect sizes were smaller than the original. The other methods were binary - the replication was either a success or a failure - and five of these methods could be used to assess both positive and null effects when effect sizes were reported as numerical values. For positive effects, 40% of replications (39/97) succeeded according to three or more of these five methods, and for null effects 80% of replications (12/15) were successful on this basis; combining positive and null effects, the success rate was 46% (51/112). A successful replication does not definitively confirm an original finding or its theoretical interpretation. Equally, a failure to replicate does not disconfirm a finding, but it does suggest that additional investigation is needed to establish its reliability.

Errington TM ，Mathur M ，Soderberg CK ，Denis A ，Perfito N ，Iorns E ，Nosek BA ... -  《eLife》

Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Description of the condition Malaria, an infectious disease transmitted by the bite of female mosquitoes from several Anopheles species, occurs in 87 countries with ongoing transmission (WHO 2020). The World Health Organization (WHO) estimated that, in 2019, approximately 229 million cases of malaria occurred worldwide, with 94% occurring in the WHO's African region (WHO 2020). Of these malaria cases, an estimated 409,000 deaths occurred globally, with 67% occurring in children under five years of age (WHO 2020). Malaria also negatively impacts the health of women during pregnancy, childbirth, and the postnatal period (WHO 2020). Sulfadoxine/pyrimethamine (SP), an antifolate antimalarial, has been widely used across sub-Saharan Africa as the first-line treatment for uncomplicated malaria since it was first introduced in Malawi in 1993 (Filler 2006). Due to increasing resistance to SP, in 2000 the WHO recommended that one of several artemisinin-based combination therapies (ACTs) be used instead of SP for the treatment of uncomplicated malaria caused by Plasmodium falciparum (Global Partnership to Roll Back Malaria 2001). However, despite these recommendations, SP continues to be advised for intermittent preventive treatment in pregnancy (IPTp) and intermittent preventive treatment in infants (IPTi), whether the person has malaria or not (WHO 2013). Description of the intervention Folate (vitamin B9) includes both naturally occurring folates and folic acid, the fully oxidized monoglutamic form of the vitamin, used in dietary supplements and fortified food. Folate deficiency (e.g. red blood cell (RBC) folate concentrations of less than 305 nanomoles per litre (nmol/L); serum or plasma concentrations of less than 7 nmol/L) is common in many parts of the world and often presents as megaloblastic anaemia, resulting from inadequate intake, increased requirements, reduced absorption, or abnormal metabolism of folate (Bailey 2015; WHO 2015a). Pregnant women have greater folate requirements; inadequate folate intake (evidenced by RBC folate concentrations of less than 400 nanograms per millilitre (ng/mL), or 906 nmol/L) prior to and during the first month of pregnancy increases the risk of neural tube defects, preterm delivery, low birthweight, and fetal growth restriction (Bourassa 2019). The WHO recommends that all women who are trying to conceive consume 400 micrograms (µg) of folic acid daily from the time they begin trying to conceive through to 12 weeks of gestation (WHO 2017). In 2015, the WHO added the dosage of 0.4 mg of folic acid to the essential drug list (WHO 2015c). Alongside daily oral iron (30 mg to 60 mg elemental iron), folic acid supplementation is recommended for pregnant women to prevent neural tube defects, maternal anaemia, puerperal sepsis, low birthweight, and preterm birth in settings where anaemia in pregnant women is a severe public health problem (i.e. where at least 40% of pregnant women have a blood haemoglobin (Hb) concentration of less than 110 g/L). How the intervention might work Potential interactions between folate status and malaria infection The malaria parasite requires folate for survival and growth; this has led to the hypothesis that folate status may influence malaria risk and severity. In rhesus monkeys, folate deficiency has been found to be protective against Plasmodium cynomolgi malaria infection, compared to folate-replete animals (Metz 2007). Alternatively, malaria may induce or exacerbate folate deficiency due to increased folate utilization from haemolysis and fever. Further, folate status measured via RBC folate is not an appropriate biomarker of folate status in malaria-infected individuals since RBC folate values in these individuals are indicative of both the person's stores and the parasite's folate synthesis. A study in Nigeria found that children with malaria infection had significantly higher RBC folate concentrations compared to children without malaria infection, but plasma folate levels were similar (Bradley-Moore 1985). Why it is important to do this review The malaria parasite needs folate for survival and growth in humans. For individuals, adequate folate levels are critical for health and well-being, and for the prevention of anaemia and neural tube defects. Many countries rely on folic acid supplementation to ensure adequate folate status in at-risk populations. Different formulations for folic acid supplements are available in many international settings, with dosages ranging from 400 µg to 5 mg. Evaluating folic acid dosage levels used in supplementation efforts may increase public health understanding of its potential impacts on malaria risk and severity and on treatment failures. Examining folic acid interactions with antifolate antimalarial medications and with malaria disease progression may help countries in malaria-endemic areas determine what are the most appropriate lower dose folic acid formulations for at-risk populations. The WHO has highlighted the limited evidence available and has indicated the need for further research on biomarkers of folate status, particularly interactions between RBC folate concentrations and tuberculosis, human immunodeficiency virus (HIV), and antifolate antimalarial drugs (WHO 2015b). An earlier Cochrane Review assessed the effects and safety of iron supplementation, with or without folic acid, in children living in hyperendemic or holoendemic malaria areas; it demonstrated that iron supplementation did not increase the risk of malaria, as indicated by fever and the presence of parasites in the blood (Neuberger 2016). Further, this review stated that folic acid may interfere with the efficacy of SP; however, the efficacy and safety of folic acid supplementation on these outcomes has not been established. This review will provide evidence on the effectiveness of daily folic acid supplementation in healthy and malaria-infected individuals living in malaria-endemic areas. Additionally, it will contribute to achieving both the WHO Global Technical Strategy for Malaria 2016-2030 (WHO 2015d), and United Nations Sustainable Development Goal 3 (to ensure healthy lives and to promote well-being for all of all ages) (United Nations 2021), and evaluating whether the potential effects of folic acid supplementation, at different doses (e.g. 0.4 mg, 1 mg, 5 mg daily), interferes with the effect of drugs used for prevention or treatment of malaria. To examine the effects of folic acid supplementation, at various doses, on malaria susceptibility (risk of infection) and severity among people living in areas with various degrees of malaria endemicity. We will examine the interaction between folic acid supplements and antifolate antimalarial drugs. Specifically, we will aim to answer the following. Among uninfected people living in malaria endemic areas, who are taking or not taking antifolate antimalarials for malaria prophylaxis, does taking a folic acid-containing supplement increase susceptibility to or severity of malaria infection? Among people with malaria infection who are being treated with antifolate antimalarials, does folic acid supplementation increase the risk of treatment failure? Criteria for considering studies for this review Types of studies Inclusion criteria Randomized controlled trials (RCTs) Quasi-RCTs with randomization at the individual or cluster level conducted in malaria-endemic areas (areas with ongoing, local malaria transmission, including areas approaching elimination, as listed in the World Malaria Report 2020) (WHO 2020) Exclusion criteria Ecological studies Observational studies In vivo/in vitro studies Economic studies Systematic literature reviews and meta-analyses (relevant systematic literature reviews and meta-analyses will be excluded but flagged for grey literature screening) Types of participants Inclusion criteria Individuals of any age or gender, living in a malaria endemic area, who are taking antifolate antimalarial medications (including but not limited to sulfadoxine/pyrimethamine (SP), pyrimethamine-dapsone, pyrimethamine, chloroquine and proguanil, cotrimoxazole) for the prevention or treatment of malaria (studies will be included if more than 70% of the participants live in malaria-endemic regions) Studies assessing participants with or without anaemia and with or without malaria parasitaemia at baseline will be included Exclusion criteria Individuals not taking antifolate antimalarial medications for prevention or treatment of malaria Individuals living in non-malaria endemic areas Types of interventions Inclusion criteria Folic acid supplementation Form: in tablet, capsule, dispersible tablet at any dose, during administration, or periodically Timing: during, before, or after (within a period of four to six weeks) administration of antifolate antimalarials Iron-folic acid supplementation Folic acid supplementation in combination with co-interventions that are identical between the intervention and control groups. Co-interventions include: anthelminthic treatment; multivitamin or multiple micronutrient supplementation; 5-methyltetrahydrofolate supplementation. Exclusion criteria Folate through folate-fortified water Folic acid administered through large-scale fortification of rice, wheat, or maize Comparators Placebo No treatment No folic acid/different doses of folic acid Iron Types of outcome measures Primary outcomes Uncomplicated malaria (defined as a history of fever with parasitological confirmation; acceptable parasitological confirmation will include rapid diagnostic tests (RDTs), malaria smears, or nucleic acid detection (i.e. polymerase chain reaction (PCR), loop-mediated isothermal amplification (LAMP), etc.)) (WHO 2010). This outcome is relevant for patients without malaria, given antifolate antimalarials for malaria prophylaxis. Severe malaria (defined as any case with cerebral malaria or acute P. falciparum malaria, with signs of severity or evidence of vital organ dysfunction, or both) (WHO 2010). This outcome is relevant for patients without malaria, given antifolate antimalarials for malaria prophylaxis. Parasite clearance (any Plasmodium species), defined as the time it takes for a patient who tests positive at enrolment and is treated to become smear-negative or PCR negative. This outcome is relevant for patients with malaria, treated with antifolate antimalarials. Treatment failure (defined as the inability to clear malaria parasitaemia or prevent recrudescence after administration of antimalarial medicine, regardless of whether clinical symptoms are resolved) (WHO 2019). This outcome is relevant for patients with malaria, treated with antifolate antimalarials. Secondary outcomes Duration of parasitaemia Parasite density Haemoglobin (Hb) concentrations (g/L) Anaemia: severe anaemia (defined as Hb less than 70 g/L in pregnant women and children aged six to 59 months; and Hb less than 80 g/L in other populations); moderate anaemia (defined as Hb less than 100 g/L in pregnant women and children aged six to 59 months; and less than 110 g/L in others) Death from any cause Among pregnant women: stillbirth (at less than 28 weeks gestation); low birthweight (less than 2500 g); active placental malaria (defined as Plasmodium detected in placental blood by smear or PCR, or by Plasmodium detected on impression smear or placental histology). Search methods for identification of studies A search will be conducted to identify completed and ongoing studies, without date or language restrictions. Electronic searches A search strategy will be designed to include the appropriate subject headings and text word terms related to each intervention of interest and study design of interest (see Appendix 1). Searches will be broken down by these two criteria (intervention of interest and study design of interest) to allow for ease of prioritization, if necessary. The study design filters recommended by the Scottish Intercollegiate Guidelines Network (SIGN), and those designed by Cochrane for identifying clinical trials for MEDLINE and Embase, will be used (SIGN 2020). There will be no date or language restrictions. Non-English articles identified for inclusion will be translated into English. If translations are not possible, advice will be requested from the Cochrane Infectious Diseases Group and the record will be stored in the "Awaiting assessment" section of the review until a translation is available. The following electronic databases will be searched for primary studies. Cochrane Central Register of Controlled Trials. Cumulative Index to Nursing and Allied Health Literature (CINAHL). Embase. MEDLINE. Scopus. Web of Science (both the Social Science Citation Index and the Science Citation Index). We will conduct manual searches of ClinicalTrials.gov, the International Clinical Trials Registry Platform (ICTRP), and the United Nations Children's Fund (UNICEF) Evaluation and Research Database (ERD), in order to identify relevant ongoing or planned trials, abstracts, and full-text reports of evaluations, studies, and surveys related to programmes on folic acid supplementation in malaria-endemic areas. Additionally, manual searches of grey literature to identify RCTs that have not yet been published but are potentially eligible for inclusion will be conducted in the following sources. Global Index Medicus (GIM). African Index Medicus (AIM). Index Medicus for the Eastern Mediterranean Region (IMEMR). Latin American & Caribbean Health Sciences Literature (LILACS). Pan American Health Organization (PAHO). Western Pacific Region Index Medicus (WPRO). Index Medicus for the South-East Asian Region (IMSEAR). The Spanish Bibliographic Index in Health Sciences (IBECS) (ibecs.isciii.es/). Indian Journal of Medical Research (IJMR) (journals.lww.com/ijmr/pages/default.aspx). Native Health Database (nativehealthdatabase.net/). Scielo (www.scielo.br/). Searching other resources Handsearches of the five journals with the highest number of included studies in the last 12 months will be conducted to capture any relevant articles that may not have been indexed in the databases at the time of the search. We will contact the authors of included studies and will check reference lists of included papers for the identification of additional records. For assistance in identifying ongoing or unpublished studies, we will contact the Division of Nutrition, Physical Activity, and Obesity (DNPAO) and the Division of Parasitic Diseases and Malaria (DPDM) of the CDC, the United Nations World Food Programme (WFP), Nutrition International (NI), Global Alliance for Improved Nutrition (GAIN), and Hellen Keller International (HKI). Data collection and analysis Selection of studies Two review authors will independently screen the titles and abstracts of articles retrieved by each search to assess eligibility, as determined by the inclusion and exclusion criteria. Studies deemed eligible for inclusion by both review authors in the abstract screening phase will advance to the full-text screening phase, and full-text copies of all eligible papers will be retrieved. If full articles cannot be obtained, we will attempt to contact the authors to obtain further details of the studies. If such information is not obtained, we will classify the study as "awaiting assessment" until further information is published or made available to us. The same two review authors will independently assess the eligibility of full-text articles for inclusion in the systematic review. If any discrepancies occur between the studies selected by the two review authors, a third review author will provide arbitration. Each trial will be scrutinized to identify multiple publications from the same data set, and the justification for excluded trials will be documented. A PRISMA flow diagram of the study selection process will be presented to provide information on the number of records identified in the literature searches, the number of studies included and excluded, and the reasons for exclusion (Moher 2009). The list of excluded studies, along with their reasons for exclusion at the full-text screening phase, will also be created. Data extraction and management Two review authors will independently extract data for the final list of included studies using a standardized data specification form. Discrepancies observed between the data extracted by the two authors will be resolved by involving a third review author and reaching a consensus. Information will be extracted on study design components, baseline participant characteristics, intervention characteristics, and outcomes. For individually randomized trials, we will record the number of participants experiencing the event and the number analyzed in each treatment group or the effect estimate reported (e.g. risk ratio (RR)) for dichotomous outcome measures. For count data, we will record the number of events and the number of person-months of follow-up in each group. If the number of person-months is not reported, the product of the duration of follow-up and the number of children evaluated will be used to estimate this figure. We will calculate the rate ratio and standard error (SE) for each study. Zero events will be replaced by 0.5. We will extract both adjusted and unadjusted covariate incidence rate ratios if they are reported in the original studies. For continuous data, we will extract means (arithmetic or geometric) and a measure of variance (standard deviation (SD), SE, or confidence interval (CI)), percentage or mean change from baseline, and the numbers analyzed in each group. SDs will be computed from SEs or 95% CIs, assuming a normal distribution of the values. Haemoglobin values in g/dL will be calculated by multiplying haematocrit or packed cell volume values by 0.34, and studies reporting haemoglobin values in g/dL will be converted to g/L. In cluster-randomized trials, we will record the unit of randomization (e.g. household, compound, sector, or village), the number of clusters in the trial, and the average cluster size. The statistical methods used to analyze the trials will be documented, along with details describing whether these methods adjusted for clustering or other covariates. We plan to extract estimates of the intra-cluster correlation coefficient (ICC) for each outcome. Where results are adjusted for clustering, we will extract the treatment effect estimate and the SD or CI. If the results are not adjusted for clustering, we will extract the data reported. Assessment of risk of bias in included studies Two review authors (KSC, LFY) will independently assess the risk of bias for each included trial using the Cochrane 'Risk of bias 2' tool (RoB 2) for randomized studies (Sterne 2019). Judgements about the risk of bias of included studies will be made according to the recommendations outlined in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2021). Disagreements will be resolved by discussion, or by involving a third review author. The interest of our review will be to assess the effect of assignment to the interventions at baseline. We will evaluate each primary outcome using the RoB2 tool. The five domains of the Cochrane RoB2 tool include the following. Bias arising from the randomization process. Bias due to deviations from intended interventions. Bias due to missing outcome data. Bias in measurement of the outcome. Bias in selection of the reported result. Each domain of the RoB2 tool comprises the following. A series of 'signalling' questions. A judgement about the risk of bias for the domain, facilitated by an algorithm that maps responses to the signalling questions to a proposed judgement. Free-text boxes to justify responses to the signalling questions and 'Risk of bias' judgements. An option to predict (and explain) the likely direction of bias. Responses to signalling questions elicit information relevant to an assessment of the risk of bias. These response options are as follows. Yes (may indicate either low or high risk of bias, depending on the most natural way to ask the question). Probably yes. Probably no. No. No information (may indicate no evidence of that problem or an absence of information leading to concerns about there being a problem). Based on the answer to the signalling question, a 'Risk of bias' judgement is assigned to each domain. These judgements include one of the following. High risk of bias Low risk of bias Some concerns To generate the risk of bias judgement for each domain in the randomized studies, we will use the Excel template, available at www.riskofbias.info/welcome/rob-2-0-tool/current-version-of-rob-2. This file will be stored on a scientific data website, available to readers. Risk of bias in cluster randomized controlled trials For the cluster randomized trials, we will be using the RoB2 tool to analyze the five standard domains listed above along with Domain 1b (bias arising from the timing of identification or recruitment of participants) and its related signalling questions. To generate the risk of bias judgement for each domain in the cluster RCTs, we will use the Excel template available at https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool/rob-2-for-cluster-randomized-trials. This file will be stored on a scientific data website, available to readers. Risk of bias in cross-over randomized controlled trials For cross-over randomized trials, we will be using the RoB2 tool to analyze the five standard domains listed above along with Domain 2 (bias due to deviations from intended interventions), and Domain 3 (bias due to missing outcome data), and their respective signalling questions. To generate the risk of bias judgement for each domain in the cross-over RCTs, we will use the Excel template, available at https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool/rob-2-for-crossover-trials, for each risk of bias judgement of cross-over randomized studies. This file will be stored on a scientific data website, available to readers. Overall risk of bias The overall 'Risk of bias' judgement for each specific trial being assessed will be based on each domain-level judgement. The overall judgements include the following. Low risk of bias (the trial is judged to be at low risk of bias for all domains). Some concerns (the trial is judged to raise some concerns in at least one domain but is not judged to be at high risk of bias for any domain). High risk of bias (the trial is judged to be at high risk of bias in at least one domain, or is judged to have some concerns for multiple domains in a way that substantially lowers confidence in the result). The 'risk of bias' assessments will inform our GRADE evaluations of the certainty of evidence for our primary outcomes presented in the 'Summary of findings' tables and will also be used to inform the sensitivity analyses; (see Sensitivity analysis). If there is insufficient information in study reports to enable an assessment of the risk of bias, studies will be classified as "awaiting assessment" until further information is published or made available to us. Measures of treatment effect Dichotomous data For dichotomous data, we will present proportions and, for two-group comparisons, results as average RR or odds ratio (OR) with 95% CIs. Ordered categorical data Continuous data We will report results for continuous outcomes as the mean difference (MD) with 95% CIs, if outcomes are measured in the same way between trials. Where some studies have reported endpoint data and others have reported change-from-baseline data (with errors), we will combine these in the meta-analysis, if the outcomes were reported using the same scale. We will use the standardized mean difference (SMD), with 95% CIs, to combine trials that measured the same outcome but used different methods. If we do not find three or more studies for a pooled analysis, we will summarize the results in a narrative form. Unit of analysis issues Cluster-randomized trials We plan to combine results from both cluster-randomized and individually randomized studies, providing there is little heterogeneity between the studies. If the authors of cluster-randomized trials conducted their analyses at a different level from that of allocation, and they have not appropriately accounted for the cluster design in their analyses, we will calculate the trials' effective sample sizes to account for the effect of clustering in data. When one or more cluster-RCT reports RRs adjusted for clustering, we will compute cluster-adjusted SEs for the other trials. When none of the cluster-RCTs provide cluster-adjusted RRs, we will adjust the sample size for clustering. We will divide, by the estimated design effects (DE), the number of events and number evaluated for dichotomous outcomes and the number evaluated for continuous outcomes, where DE = 1 + ((average cluster size 1) * ICC). The derivation of the estimated ICCs and DEs will be reported. We will utilize the intra-cluster correlation coefficient (ICC), derived from the trial (if available), or from another source (e.g., using the ICCs derived from other, similar trials) and then calculate the design effect with the formula provided in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2021). If this approach is used, we will report it and undertake sensitivity analysis to investigate the effect of variations in ICC. Studies with more than two treatment groups If we identify studies with more than two intervention groups (multi-arm studies), where possible we will combine groups to create a single pair-wise comparison or use the methods set out in the Cochrane Handbook to avoid double counting study participants (Higgins 2021). For the subgroup analyses, when the control group was shared by two or more study arms, we will divide the control group (events and total population) over the number of relevant subgroups to avoid double counting the participants. Trials with several study arms can be included more than once for different comparisons. Cross-over trials From cross-over trials, we will consider the first period of measurement only and will analyze the results together with parallel-group studies. Multiple outcome events In several outcomes, a participant might experience more than one outcome event during the trial period. For all outcomes, we will extract the number of participants with at least one event. Dealing with missing data We will contact the trial authors if the available data are unclear, missing, or reported in a format that is different from the format needed. We aim to perform a 'per protocol' or 'as observed' analysis; otherwise, we will perform a complete case analysis. This means that for treatment failure, we will base the analyses on the participants who received treatment and the number of participants for which there was an inability to clear malarial parasitaemia or prevent recrudescence after administration of an antimalarial medicine reported in the studies. Assessment of heterogeneity Heterogeneity in the results of the trials will be assessed by visually examining the forest plot to detect non-overlapping CIs, using the Chi2 test of heterogeneity (where a P value of less than 0.1 indicates statistical significance) and the I2 statistic of inconsistency (with a value of greater than 50% denoting moderate levels of heterogeneity). When statistical heterogeneity is present, we will investigate the reasons for it, using subgroup analysis. Assessment of reporting biases We will construct a funnel plot to assess the effect of small studies for the main outcome (when including more than 10 trials). Data synthesis The primary analysis will include all eligible studies that provide data regardless of the overall risk of bias as assessed by the RoB2 tool. Analyses will be conducted using Review Manager 5.4 (Review Manager 2020). Cluster-RCTs will be included in the main analysis after adjustment for clustering (see the previous section on cluster-RCTs). The meta-analysis will be performed using the Mantel-Haenszel random-effects model or the generic inverse variance method (when adjustment for clustering is performed by adjusting SEs), as appropriate. Subgroup analysis and investigation of heterogeneity The overall risk of bias will not be used as the basis in conducting our subgroup analyses. However, where data are available, we plan to conduct the following subgroup analyses, independent of heterogeneity. Dose of folic acid supplementation: higher doses (4 mg or more, daily) versus lower doses (less than 4 mg, daily). Moderate-severe anaemia at baseline (mean haemoglobin of participants in a trial at baseline below 100 g/L for pregnant women and children aged six to 59 months, and below 110 g/L for other populations) versus normal at baseline (mean haemoglobin above 100 g/L for pregnant women and children aged six to 59 months, and above 110 g/L for other populations). Antimalarial drug resistance to parasite: known resistance versus no resistance versus unknown/mixed/unreported parasite resistance. Folate status at baseline: Deficient (e.g. RBC folate concentration of less than 305 nmol/L, or serum folate concentration of less than 7nmol/L) and Insufficient (e.g. RBC folate concentration from 305 to less than 906 nmol/L, or serum folate concentration from 7 to less than 25 nmol/L) versus Sufficient (e.g. RBC folate concentration above 906 nmol/L, or serum folate concentration above 25 nmol/L). Presence of anaemia at baseline: yes versus no. Mandatory fortification status: yes, versus no (voluntary or none). We will only use the primary outcomes in any subgroup analyses, and we will limit subgroup analyses to those outcomes for which three or more trials contributed data. Comparisons between subgroups will be performed using Review Manager 5.4 (Review Manager 2020). Sensitivity analysis We will perform a sensitivity analysis, using the risk of bias as a variable to explore the robustness of the findings in our primary outcomes. We will verify the behaviour of our estimators by adding and removing studies with a high risk of bias overall from the analysis. That is, studies with a low risk of bias versus studies with a high risk of bias. Summary of findings and assessment of the certainty of the evidence For the assessment across studies, we will use the GRADE approach, as outlined in (Schünemann 2021). We will use the five GRADE considerations (study limitations based on RoB2 judgements, consistency of effect, imprecision, indirectness, and publication bias) to assess the certainty of the body of evidence as it relates to the studies which contribute data to the meta-analyses for the primary outcomes. The GRADEpro Guideline Development Tool (GRADEpro) will be used to import data from Review Manager 5.4 (Review Manager 2020) to create 'Summary of Findings' tables. The primary outcomes for the main comparison will be listed with estimates of relative effects, along with the number of participants and studies contributing data for those outcomes. These tables will provide outcome-specific information concerning the overall certainty of evidence from studies included in the comparison, the magnitude of the effect of the interventions examined, and the sum of available data on the outcomes we considered. We will include only primary outcomes in the summary of findings tables. For each individual outcome, two review authors (KSC, LFY) will independently assess the certainty of the evidence using the GRADE approach (Balshem 2011). For assessments of the overall certainty of evidence for each outcome that includes pooled data from included trials, we will downgrade the evidence from 'high certainty' by one level for serious (or by two for very serious) study limitations (risk of bias, indirectness of evidence, serious inconsistency, imprecision of effect estimates, or potential publication bias).

Crider K ，Williams J ，Qi YP ，Gutman J ，Yeung L ，Mai C ，Finkelstain J ，Mehta S ，Pons-Duran C ，Menéndez C ，Moraleda C ，Rogers L ，Daniels K ，Green P ... -  《Cochrane Database of Systematic Reviews》

An open investigation of the reproducibility of cancer biology research.

Errington TM ，Iorns E ，Gunn W ，Tan FE ，Lomax J ，Nosek BA ... -  《-》