Multi-stakeholder preferences for the use of artificial intelligence in healthcare: A systematic review and thematic analysis.

Despite the proliferation of Artificial Intelligence (AI) technology over the last decade, clinician, patient, and public perceptions of its use in healthcare raise a number of ethical, legal and social questions. We systematically review the literature on attitudes towards the use of AI in healthcare from patients, the general public and health professionals' perspectives to understand these issues from multiple perspectives. A search for original research articles using qualitative, quantitative, and mixed methods published between 1 Jan 2001 to 24 Aug 2021 was conducted on six bibliographic databases. Data were extracted and classified into different themes representing views on: (i) knowledge and familiarity of AI, (ii) AI benefits, risks, and challenges, (iii) AI acceptability, (iv) AI development, (v) AI implementation, (vi) AI regulations, and (vii) Human - AI relationship. The final search identified 7,490 different records of which 105 publications were selected based on predefined inclusion/exclusion criteria. While the majority of patients, the general public and health professionals generally had a positive attitude towards the use of AI in healthcare, all groups indicated some perceived risks and challenges. Commonly perceived risks included data privacy; reduced professional autonomy; algorithmic bias; healthcare inequities; and greater burnout to acquire AI-related skills. While patients had mixed opinions on whether healthcare workers suffer from job loss due to the use of AI, health professionals strongly indicated that AI would not be able to completely replace them in their professions. Both groups shared similar doubts about AI's ability to deliver empathic care. The need for AI validation, transparency, explainability, and patient and clinical involvement in the development of AI was emphasised. To help successfully implement AI in health care, most participants envisioned that an investment in training and education campaigns was necessary, especially for health professionals. Lack of familiarity, lack of trust, and regulatory uncertainties were identified as factors hindering AI implementation. Regarding AI regulations, key themes included data access and data privacy. While the general public and patients exhibited a willingness to share anonymised data for AI development, there remained concerns about sharing data with insurance or technology companies. One key domain under this theme was the question of who should be held accountable in the case of adverse events arising from using AI. While overall positivity persists in attitudes and preferences toward AI use in healthcare, some prevalent problems require more attention. There is a need to go beyond addressing algorithm-related issues to look at the translation of legislation and guidelines into practice to ensure fairness, accountability, transparency, and ethics in AI.

Vo V ，Chen G ，Aquino YSJ ，Carter SM ，Do QN ，Woode ME ... -  《-》

Artificial intelligence technologies and compassion in healthcare: A systematic scoping review.

Advances in artificial intelligence (AI) technologies, together with the availability of big data in society, creates uncertainties about how these developments will affect healthcare systems worldwide. Compassion is essential for high-quality healthcare and research shows how prosocial caring behaviors benefit human health and societies. However, the possible association between AI technologies and compassion is under conceptualized and underexplored. The aim of this scoping review is to provide a comprehensive depth and a balanced perspective of the emerging topic of AI technologies and compassion, to inform future research and practice. The review questions were: How is compassion discussed in relation to AI technologies in healthcare? How are AI technologies being used to enhance compassion in healthcare? What are the gaps in current knowledge and unexplored potential? What are the key areas where AI technologies could support compassion in healthcare? A systematic scoping review following five steps of Joanna Briggs Institute methodology. Presentation of the scoping review conforms with PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews). Eligibility criteria were defined according to 3 concept constructs (AI technologies, compassion, healthcare) developed from the literature and informed by medical subject headings (MeSH) and key words for the electronic searches. Sources of evidence were Web of Science and PubMed databases, articles published in English language 2011-2022. Articles were screened by title/abstract using inclusion/exclusion criteria. Data extracted (author, date of publication, type of article, aim/context of healthcare, key relevant findings, country) was charted using data tables. Thematic analysis used an inductive-deductive approach to generate code categories from the review questions and the data. A multidisciplinary team assessed themes for resonance and relevance to research and practice. Searches identified 3,124 articles. A total of 197 were included after screening. The number of articles has increased over 10 years (2011, n = 1 to 2021, n = 47 and from Jan-Aug 2022 n = 35 articles). Overarching themes related to the review questions were: (1) Developments and debates (7 themes) Concerns about AI ethics, healthcare jobs, and loss of empathy; Human-centered design of AI technologies for healthcare; Optimistic speculation AI technologies will address care gaps; Interrogation of what it means to be human and to care; Recognition of future potential for patient monitoring, virtual proximity, and access to healthcare; Calls for curricula development and healthcare professional education; Implementation of AI applications to enhance health and wellbeing of the healthcare workforce. (2) How AI technologies enhance compassion (10 themes) Empathetic awareness; Empathetic response and relational behavior; Communication skills; Health coaching; Therapeutic interventions; Moral development learning; Clinical knowledge and clinical assessment; Healthcare quality assessment; Therapeutic bond and therapeutic alliance; Providing health information and advice. (3) Gaps in knowledge (4 themes) Educational effectiveness of AI-assisted learning; Patient diversity and AI technologies; Implementation of AI technologies in education and practice settings; Safety and clinical effectiveness of AI technologies. (4) Key areas for development (3 themes) Enriching education, learning and clinical practice; Extending healing spaces; Enhancing healing relationships. There is an association between AI technologies and compassion in healthcare and interest in this association has grown internationally over the last decade. In a range of healthcare contexts, AI technologies are being used to enhance empathetic awareness; empathetic response and relational behavior; communication skills; health coaching; therapeutic interventions; moral development learning; clinical knowledge and clinical assessment; healthcare quality assessment; therapeutic bond and therapeutic alliance; and to provide health information and advice. The findings inform a reconceptualization of compassion as a human-AI system of intelligent caring comprising six elements: (1) Awareness of suffering (e.g., pain, distress, risk, disadvantage); (2) Understanding the suffering (significance, context, rights, responsibilities etc.); (3) Connecting with the suffering (e.g., verbal, physical, signs and symbols); (4) Making a judgment about the suffering (the need to act); (5) Responding with an intention to alleviate the suffering; (6) Attention to the effect and outcomes of the response. These elements can operate at an individual (human or machine) and collective systems level (healthcare organizations or systems) as a cyclical system to alleviate different types of suffering. New and novel approaches to human-AI intelligent caring could enrich education, learning, and clinical practice; extend healing spaces; and enhance healing relationships. In a complex adaptive system such as healthcare, human-AI intelligent caring will need to be implemented, not as an ideology, but through strategic choices, incentives, regulation, professional education, and training, as well as through joined up thinking about human-AI intelligent caring. Research funders can encourage research and development into the topic of AI technologies and compassion as a system of human-AI intelligent caring. Educators, technologists, and health professionals can inform themselves about the system of human-AI intelligent caring.

Morrow E ，Zidaru T ，Ross F ，Mason C ，Patel KD ，Ream M ，Stockley R ... -  《Frontiers in Psychology》

Trustworthy and ethical AI-enabled cardiovascular care: a rapid review.

Artificial intelligence (AI) is increasingly used for prevention, diagnosis, monitoring, and treatment of cardiovascular diseases. Despite the potential for AI to improve care, ethical concerns and mistrust in AI-enabled healthcare exist among the public and medical community. Given the rapid and transformative recent growth of AI in cardiovascular care, to inform practice guidelines and regulatory policies that facilitate ethical and trustworthy use of AI in medicine, we conducted a literature review to identify key ethical and trust barriers and facilitators from patients' and healthcare providers' perspectives when using AI in cardiovascular care. In this rapid literature review, we searched six bibliographic databases to identify publications discussing transparency, trust, or ethical concerns (outcomes of interest) associated with AI-based medical devices (interventions of interest) in the context of cardiovascular care from patients', caregivers', or healthcare providers' perspectives. The search was completed on May 24, 2022 and was not limited by date or study design. After reviewing 7,925 papers from six databases and 3,603 papers identified through citation chasing, 145 articles were included. Key ethical concerns included privacy, security, or confidentiality issues (n = 59, 40.7%); risk of healthcare inequity or disparity (n = 36, 24.8%); risk of patient harm (n = 24, 16.6%); accountability and responsibility concerns (n = 19, 13.1%); problematic informed consent and potential loss of patient autonomy (n = 17, 11.7%); and issues related to data ownership (n = 11, 7.6%). Major trust barriers included data privacy and security concerns, potential risk of patient harm, perceived lack of transparency about AI-enabled medical devices, concerns about AI replacing human aspects of care, concerns about prioritizing profits over patients' interests, and lack of robust evidence related to the accuracy and limitations of AI-based medical devices. Ethical and trust facilitators included ensuring data privacy and data validation, conducting clinical trials in diverse cohorts, providing appropriate training and resources to patients and healthcare providers and improving their engagement in different phases of AI implementation, and establishing further regulatory oversights. This review revealed key ethical concerns and barriers and facilitators of trust in AI-enabled medical devices from patients' and healthcare providers' perspectives. Successful integration of AI into cardiovascular care necessitates implementation of mitigation strategies. These strategies should focus on enhanced regulatory oversight on the use of patient data and promoting transparency around the use of AI in patient care.

Mooghali M ，Stroud AM ，Yoo DW ，Barry BA ，Grimshaw AA ，Ross JS ，Zhu X ，Miller JE ... -  《BMC Medical Informatics and Decision Making》

Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Description of the condition Malaria, an infectious disease transmitted by the bite of female mosquitoes from several Anopheles species, occurs in 87 countries with ongoing transmission (WHO 2020). The World Health Organization (WHO) estimated that, in 2019, approximately 229 million cases of malaria occurred worldwide, with 94% occurring in the WHO's African region (WHO 2020). Of these malaria cases, an estimated 409,000 deaths occurred globally, with 67% occurring in children under five years of age (WHO 2020). Malaria also negatively impacts the health of women during pregnancy, childbirth, and the postnatal period (WHO 2020). Sulfadoxine/pyrimethamine (SP), an antifolate antimalarial, has been widely used across sub-Saharan Africa as the first-line treatment for uncomplicated malaria since it was first introduced in Malawi in 1993 (Filler 2006). Due to increasing resistance to SP, in 2000 the WHO recommended that one of several artemisinin-based combination therapies (ACTs) be used instead of SP for the treatment of uncomplicated malaria caused by Plasmodium falciparum (Global Partnership to Roll Back Malaria 2001). However, despite these recommendations, SP continues to be advised for intermittent preventive treatment in pregnancy (IPTp) and intermittent preventive treatment in infants (IPTi), whether the person has malaria or not (WHO 2013). Description of the intervention Folate (vitamin B9) includes both naturally occurring folates and folic acid, the fully oxidized monoglutamic form of the vitamin, used in dietary supplements and fortified food. Folate deficiency (e.g. red blood cell (RBC) folate concentrations of less than 305 nanomoles per litre (nmol/L); serum or plasma concentrations of less than 7 nmol/L) is common in many parts of the world and often presents as megaloblastic anaemia, resulting from inadequate intake, increased requirements, reduced absorption, or abnormal metabolism of folate (Bailey 2015; WHO 2015a). Pregnant women have greater folate requirements; inadequate folate intake (evidenced by RBC folate concentrations of less than 400 nanograms per millilitre (ng/mL), or 906 nmol/L) prior to and during the first month of pregnancy increases the risk of neural tube defects, preterm delivery, low birthweight, and fetal growth restriction (Bourassa 2019). The WHO recommends that all women who are trying to conceive consume 400 micrograms (µg) of folic acid daily from the time they begin trying to conceive through to 12 weeks of gestation (WHO 2017). In 2015, the WHO added the dosage of 0.4 mg of folic acid to the essential drug list (WHO 2015c). Alongside daily oral iron (30 mg to 60 mg elemental iron), folic acid supplementation is recommended for pregnant women to prevent neural tube defects, maternal anaemia, puerperal sepsis, low birthweight, and preterm birth in settings where anaemia in pregnant women is a severe public health problem (i.e. where at least 40% of pregnant women have a blood haemoglobin (Hb) concentration of less than 110 g/L). How the intervention might work Potential interactions between folate status and malaria infection The malaria parasite requires folate for survival and growth; this has led to the hypothesis that folate status may influence malaria risk and severity. In rhesus monkeys, folate deficiency has been found to be protective against Plasmodium cynomolgi malaria infection, compared to folate-replete animals (Metz 2007). Alternatively, malaria may induce or exacerbate folate deficiency due to increased folate utilization from haemolysis and fever. Further, folate status measured via RBC folate is not an appropriate biomarker of folate status in malaria-infected individuals since RBC folate values in these individuals are indicative of both the person's stores and the parasite's folate synthesis. A study in Nigeria found that children with malaria infection had significantly higher RBC folate concentrations compared to children without malaria infection, but plasma folate levels were similar (Bradley-Moore 1985). Why it is important to do this review The malaria parasite needs folate for survival and growth in humans. For individuals, adequate folate levels are critical for health and well-being, and for the prevention of anaemia and neural tube defects. Many countries rely on folic acid supplementation to ensure adequate folate status in at-risk populations. Different formulations for folic acid supplements are available in many international settings, with dosages ranging from 400 µg to 5 mg. Evaluating folic acid dosage levels used in supplementation efforts may increase public health understanding of its potential impacts on malaria risk and severity and on treatment failures. Examining folic acid interactions with antifolate antimalarial medications and with malaria disease progression may help countries in malaria-endemic areas determine what are the most appropriate lower dose folic acid formulations for at-risk populations. The WHO has highlighted the limited evidence available and has indicated the need for further research on biomarkers of folate status, particularly interactions between RBC folate concentrations and tuberculosis, human immunodeficiency virus (HIV), and antifolate antimalarial drugs (WHO 2015b). An earlier Cochrane Review assessed the effects and safety of iron supplementation, with or without folic acid, in children living in hyperendemic or holoendemic malaria areas; it demonstrated that iron supplementation did not increase the risk of malaria, as indicated by fever and the presence of parasites in the blood (Neuberger 2016). Further, this review stated that folic acid may interfere with the efficacy of SP; however, the efficacy and safety of folic acid supplementation on these outcomes has not been established. This review will provide evidence on the effectiveness of daily folic acid supplementation in healthy and malaria-infected individuals living in malaria-endemic areas. Additionally, it will contribute to achieving both the WHO Global Technical Strategy for Malaria 2016-2030 (WHO 2015d), and United Nations Sustainable Development Goal 3 (to ensure healthy lives and to promote well-being for all of all ages) (United Nations 2021), and evaluating whether the potential effects of folic acid supplementation, at different doses (e.g. 0.4 mg, 1 mg, 5 mg daily), interferes with the effect of drugs used for prevention or treatment of malaria. To examine the effects of folic acid supplementation, at various doses, on malaria susceptibility (risk of infection) and severity among people living in areas with various degrees of malaria endemicity. We will examine the interaction between folic acid supplements and antifolate antimalarial drugs. Specifically, we will aim to answer the following. Among uninfected people living in malaria endemic areas, who are taking or not taking antifolate antimalarials for malaria prophylaxis, does taking a folic acid-containing supplement increase susceptibility to or severity of malaria infection? Among people with malaria infection who are being treated with antifolate antimalarials, does folic acid supplementation increase the risk of treatment failure? Criteria for considering studies for this review Types of studies Inclusion criteria Randomized controlled trials (RCTs) Quasi-RCTs with randomization at the individual or cluster level conducted in malaria-endemic areas (areas with ongoing, local malaria transmission, including areas approaching elimination, as listed in the World Malaria Report 2020) (WHO 2020) Exclusion criteria Ecological studies Observational studies In vivo/in vitro studies Economic studies Systematic literature reviews and meta-analyses (relevant systematic literature reviews and meta-analyses will be excluded but flagged for grey literature screening) Types of participants Inclusion criteria Individuals of any age or gender, living in a malaria endemic area, who are taking antifolate antimalarial medications (including but not limited to sulfadoxine/pyrimethamine (SP), pyrimethamine-dapsone, pyrimethamine, chloroquine and proguanil, cotrimoxazole) for the prevention or treatment of malaria (studies will be included if more than 70% of the participants live in malaria-endemic regions) Studies assessing participants with or without anaemia and with or without malaria parasitaemia at baseline will be included Exclusion criteria Individuals not taking antifolate antimalarial medications for prevention or treatment of malaria Individuals living in non-malaria endemic areas Types of interventions Inclusion criteria Folic acid supplementation Form: in tablet, capsule, dispersible tablet at any dose, during administration, or periodically Timing: during, before, or after (within a period of four to six weeks) administration of antifolate antimalarials Iron-folic acid supplementation Folic acid supplementation in combination with co-interventions that are identical between the intervention and control groups. Co-interventions include: anthelminthic treatment; multivitamin or multiple micronutrient supplementation; 5-methyltetrahydrofolate supplementation. Exclusion criteria Folate through folate-fortified water Folic acid administered through large-scale fortification of rice, wheat, or maize Comparators Placebo No treatment No folic acid/different doses of folic acid Iron Types of outcome measures Primary outcomes Uncomplicated malaria (defined as a history of fever with parasitological confirmation; acceptable parasitological confirmation will include rapid diagnostic tests (RDTs), malaria smears, or nucleic acid detection (i.e. polymerase chain reaction (PCR), loop-mediated isothermal amplification (LAMP), etc.)) (WHO 2010). This outcome is relevant for patients without malaria, given antifolate antimalarials for malaria prophylaxis. Severe malaria (defined as any case with cerebral malaria or acute P. falciparum malaria, with signs of severity or evidence of vital organ dysfunction, or both) (WHO 2010). This outcome is relevant for patients without malaria, given antifolate antimalarials for malaria prophylaxis. Parasite clearance (any Plasmodium species), defined as the time it takes for a patient who tests positive at enrolment and is treated to become smear-negative or PCR negative. This outcome is relevant for patients with malaria, treated with antifolate antimalarials. Treatment failure (defined as the inability to clear malaria parasitaemia or prevent recrudescence after administration of antimalarial medicine, regardless of whether clinical symptoms are resolved) (WHO 2019). This outcome is relevant for patients with malaria, treated with antifolate antimalarials. Secondary outcomes Duration of parasitaemia Parasite density Haemoglobin (Hb) concentrations (g/L) Anaemia: severe anaemia (defined as Hb less than 70 g/L in pregnant women and children aged six to 59 months; and Hb less than 80 g/L in other populations); moderate anaemia (defined as Hb less than 100 g/L in pregnant women and children aged six to 59 months; and less than 110 g/L in others) Death from any cause Among pregnant women: stillbirth (at less than 28 weeks gestation); low birthweight (less than 2500 g); active placental malaria (defined as Plasmodium detected in placental blood by smear or PCR, or by Plasmodium detected on impression smear or placental histology). Search methods for identification of studies A search will be conducted to identify completed and ongoing studies, without date or language restrictions. Electronic searches A search strategy will be designed to include the appropriate subject headings and text word terms related to each intervention of interest and study design of interest (see Appendix 1). Searches will be broken down by these two criteria (intervention of interest and study design of interest) to allow for ease of prioritization, if necessary. The study design filters recommended by the Scottish Intercollegiate Guidelines Network (SIGN), and those designed by Cochrane for identifying clinical trials for MEDLINE and Embase, will be used (SIGN 2020). There will be no date or language restrictions. Non-English articles identified for inclusion will be translated into English. If translations are not possible, advice will be requested from the Cochrane Infectious Diseases Group and the record will be stored in the "Awaiting assessment" section of the review until a translation is available. The following electronic databases will be searched for primary studies. Cochrane Central Register of Controlled Trials. Cumulative Index to Nursing and Allied Health Literature (CINAHL). Embase. MEDLINE. Scopus. Web of Science (both the Social Science Citation Index and the Science Citation Index). We will conduct manual searches of ClinicalTrials.gov, the International Clinical Trials Registry Platform (ICTRP), and the United Nations Children's Fund (UNICEF) Evaluation and Research Database (ERD), in order to identify relevant ongoing or planned trials, abstracts, and full-text reports of evaluations, studies, and surveys related to programmes on folic acid supplementation in malaria-endemic areas. Additionally, manual searches of grey literature to identify RCTs that have not yet been published but are potentially eligible for inclusion will be conducted in the following sources. Global Index Medicus (GIM). African Index Medicus (AIM). Index Medicus for the Eastern Mediterranean Region (IMEMR). Latin American & Caribbean Health Sciences Literature (LILACS). Pan American Health Organization (PAHO). Western Pacific Region Index Medicus (WPRO). Index Medicus for the South-East Asian Region (IMSEAR). The Spanish Bibliographic Index in Health Sciences (IBECS) (ibecs.isciii.es/). Indian Journal of Medical Research (IJMR) (journals.lww.com/ijmr/pages/default.aspx). Native Health Database (nativehealthdatabase.net/). Scielo (www.scielo.br/). Searching other resources Handsearches of the five journals with the highest number of included studies in the last 12 months will be conducted to capture any relevant articles that may not have been indexed in the databases at the time of the search. We will contact the authors of included studies and will check reference lists of included papers for the identification of additional records. For assistance in identifying ongoing or unpublished studies, we will contact the Division of Nutrition, Physical Activity, and Obesity (DNPAO) and the Division of Parasitic Diseases and Malaria (DPDM) of the CDC, the United Nations World Food Programme (WFP), Nutrition International (NI), Global Alliance for Improved Nutrition (GAIN), and Hellen Keller International (HKI). Data collection and analysis Selection of studies Two review authors will independently screen the titles and abstracts of articles retrieved by each search to assess eligibility, as determined by the inclusion and exclusion criteria. Studies deemed eligible for inclusion by both review authors in the abstract screening phase will advance to the full-text screening phase, and full-text copies of all eligible papers will be retrieved. If full articles cannot be obtained, we will attempt to contact the authors to obtain further details of the studies. If such information is not obtained, we will classify the study as "awaiting assessment" until further information is published or made available to us. The same two review authors will independently assess the eligibility of full-text articles for inclusion in the systematic review. If any discrepancies occur between the studies selected by the two review authors, a third review author will provide arbitration. Each trial will be scrutinized to identify multiple publications from the same data set, and the justification for excluded trials will be documented. A PRISMA flow diagram of the study selection process will be presented to provide information on the number of records identified in the literature searches, the number of studies included and excluded, and the reasons for exclusion (Moher 2009). The list of excluded studies, along with their reasons for exclusion at the full-text screening phase, will also be created. Data extraction and management Two review authors will independently extract data for the final list of included studies using a standardized data specification form. Discrepancies observed between the data extracted by the two authors will be resolved by involving a third review author and reaching a consensus. Information will be extracted on study design components, baseline participant characteristics, intervention characteristics, and outcomes. For individually randomized trials, we will record the number of participants experiencing the event and the number analyzed in each treatment group or the effect estimate reported (e.g. risk ratio (RR)) for dichotomous outcome measures. For count data, we will record the number of events and the number of person-months of follow-up in each group. If the number of person-months is not reported, the product of the duration of follow-up and the number of children evaluated will be used to estimate this figure. We will calculate the rate ratio and standard error (SE) for each study. Zero events will be replaced by 0.5. We will extract both adjusted and unadjusted covariate incidence rate ratios if they are reported in the original studies. For continuous data, we will extract means (arithmetic or geometric) and a measure of variance (standard deviation (SD), SE, or confidence interval (CI)), percentage or mean change from baseline, and the numbers analyzed in each group. SDs will be computed from SEs or 95% CIs, assuming a normal distribution of the values. Haemoglobin values in g/dL will be calculated by multiplying haematocrit or packed cell volume values by 0.34, and studies reporting haemoglobin values in g/dL will be converted to g/L. In cluster-randomized trials, we will record the unit of randomization (e.g. household, compound, sector, or village), the number of clusters in the trial, and the average cluster size. The statistical methods used to analyze the trials will be documented, along with details describing whether these methods adjusted for clustering or other covariates. We plan to extract estimates of the intra-cluster correlation coefficient (ICC) for each outcome. Where results are adjusted for clustering, we will extract the treatment effect estimate and the SD or CI. If the results are not adjusted for clustering, we will extract the data reported. Assessment of risk of bias in included studies Two review authors (KSC, LFY) will independently assess the risk of bias for each included trial using the Cochrane 'Risk of bias 2' tool (RoB 2) for randomized studies (Sterne 2019). Judgements about the risk of bias of included studies will be made according to the recommendations outlined in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2021). Disagreements will be resolved by discussion, or by involving a third review author. The interest of our review will be to assess the effect of assignment to the interventions at baseline. We will evaluate each primary outcome using the RoB2 tool. The five domains of the Cochrane RoB2 tool include the following. Bias arising from the randomization process. Bias due to deviations from intended interventions. Bias due to missing outcome data. Bias in measurement of the outcome. Bias in selection of the reported result. Each domain of the RoB2 tool comprises the following. A series of 'signalling' questions. A judgement about the risk of bias for the domain, facilitated by an algorithm that maps responses to the signalling questions to a proposed judgement. Free-text boxes to justify responses to the signalling questions and 'Risk of bias' judgements. An option to predict (and explain) the likely direction of bias. Responses to signalling questions elicit information relevant to an assessment of the risk of bias. These response options are as follows. Yes (may indicate either low or high risk of bias, depending on the most natural way to ask the question). Probably yes. Probably no. No. No information (may indicate no evidence of that problem or an absence of information leading to concerns about there being a problem). Based on the answer to the signalling question, a 'Risk of bias' judgement is assigned to each domain. These judgements include one of the following. High risk of bias Low risk of bias Some concerns To generate the risk of bias judgement for each domain in the randomized studies, we will use the Excel template, available at www.riskofbias.info/welcome/rob-2-0-tool/current-version-of-rob-2. This file will be stored on a scientific data website, available to readers. Risk of bias in cluster randomized controlled trials For the cluster randomized trials, we will be using the RoB2 tool to analyze the five standard domains listed above along with Domain 1b (bias arising from the timing of identification or recruitment of participants) and its related signalling questions. To generate the risk of bias judgement for each domain in the cluster RCTs, we will use the Excel template available at https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool/rob-2-for-cluster-randomized-trials. This file will be stored on a scientific data website, available to readers. Risk of bias in cross-over randomized controlled trials For cross-over randomized trials, we will be using the RoB2 tool to analyze the five standard domains listed above along with Domain 2 (bias due to deviations from intended interventions), and Domain 3 (bias due to missing outcome data), and their respective signalling questions. To generate the risk of bias judgement for each domain in the cross-over RCTs, we will use the Excel template, available at https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool/rob-2-for-crossover-trials, for each risk of bias judgement of cross-over randomized studies. This file will be stored on a scientific data website, available to readers. Overall risk of bias The overall 'Risk of bias' judgement for each specific trial being assessed will be based on each domain-level judgement. The overall judgements include the following. Low risk of bias (the trial is judged to be at low risk of bias for all domains). Some concerns (the trial is judged to raise some concerns in at least one domain but is not judged to be at high risk of bias for any domain). High risk of bias (the trial is judged to be at high risk of bias in at least one domain, or is judged to have some concerns for multiple domains in a way that substantially lowers confidence in the result). The 'risk of bias' assessments will inform our GRADE evaluations of the certainty of evidence for our primary outcomes presented in the 'Summary of findings' tables and will also be used to inform the sensitivity analyses; (see Sensitivity analysis). If there is insufficient information in study reports to enable an assessment of the risk of bias, studies will be classified as "awaiting assessment" until further information is published or made available to us. Measures of treatment effect Dichotomous data For dichotomous data, we will present proportions and, for two-group comparisons, results as average RR or odds ratio (OR) with 95% CIs. Ordered categorical data Continuous data We will report results for continuous outcomes as the mean difference (MD) with 95% CIs, if outcomes are measured in the same way between trials. Where some studies have reported endpoint data and others have reported change-from-baseline data (with errors), we will combine these in the meta-analysis, if the outcomes were reported using the same scale. We will use the standardized mean difference (SMD), with 95% CIs, to combine trials that measured the same outcome but used different methods. If we do not find three or more studies for a pooled analysis, we will summarize the results in a narrative form. Unit of analysis issues Cluster-randomized trials We plan to combine results from both cluster-randomized and individually randomized studies, providing there is little heterogeneity between the studies. If the authors of cluster-randomized trials conducted their analyses at a different level from that of allocation, and they have not appropriately accounted for the cluster design in their analyses, we will calculate the trials' effective sample sizes to account for the effect of clustering in data. When one or more cluster-RCT reports RRs adjusted for clustering, we will compute cluster-adjusted SEs for the other trials. When none of the cluster-RCTs provide cluster-adjusted RRs, we will adjust the sample size for clustering. We will divide, by the estimated design effects (DE), the number of events and number evaluated for dichotomous outcomes and the number evaluated for continuous outcomes, where DE = 1 + ((average cluster size 1) * ICC). The derivation of the estimated ICCs and DEs will be reported. We will utilize the intra-cluster correlation coefficient (ICC), derived from the trial (if available), or from another source (e.g., using the ICCs derived from other, similar trials) and then calculate the design effect with the formula provided in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2021). If this approach is used, we will report it and undertake sensitivity analysis to investigate the effect of variations in ICC. Studies with more than two treatment groups If we identify studies with more than two intervention groups (multi-arm studies), where possible we will combine groups to create a single pair-wise comparison or use the methods set out in the Cochrane Handbook to avoid double counting study participants (Higgins 2021). For the subgroup analyses, when the control group was shared by two or more study arms, we will divide the control group (events and total population) over the number of relevant subgroups to avoid double counting the participants. Trials with several study arms can be included more than once for different comparisons. Cross-over trials From cross-over trials, we will consider the first period of measurement only and will analyze the results together with parallel-group studies. Multiple outcome events In several outcomes, a participant might experience more than one outcome event during the trial period. For all outcomes, we will extract the number of participants with at least one event. Dealing with missing data We will contact the trial authors if the available data are unclear, missing, or reported in a format that is different from the format needed. We aim to perform a 'per protocol' or 'as observed' analysis; otherwise, we will perform a complete case analysis. This means that for treatment failure, we will base the analyses on the participants who received treatment and the number of participants for which there was an inability to clear malarial parasitaemia or prevent recrudescence after administration of an antimalarial medicine reported in the studies. Assessment of heterogeneity Heterogeneity in the results of the trials will be assessed by visually examining the forest plot to detect non-overlapping CIs, using the Chi2 test of heterogeneity (where a P value of less than 0.1 indicates statistical significance) and the I2 statistic of inconsistency (with a value of greater than 50% denoting moderate levels of heterogeneity). When statistical heterogeneity is present, we will investigate the reasons for it, using subgroup analysis. Assessment of reporting biases We will construct a funnel plot to assess the effect of small studies for the main outcome (when including more than 10 trials). Data synthesis The primary analysis will include all eligible studies that provide data regardless of the overall risk of bias as assessed by the RoB2 tool. Analyses will be conducted using Review Manager 5.4 (Review Manager 2020). Cluster-RCTs will be included in the main analysis after adjustment for clustering (see the previous section on cluster-RCTs). The meta-analysis will be performed using the Mantel-Haenszel random-effects model or the generic inverse variance method (when adjustment for clustering is performed by adjusting SEs), as appropriate. Subgroup analysis and investigation of heterogeneity The overall risk of bias will not be used as the basis in conducting our subgroup analyses. However, where data are available, we plan to conduct the following subgroup analyses, independent of heterogeneity. Dose of folic acid supplementation: higher doses (4 mg or more, daily) versus lower doses (less than 4 mg, daily). Moderate-severe anaemia at baseline (mean haemoglobin of participants in a trial at baseline below 100 g/L for pregnant women and children aged six to 59 months, and below 110 g/L for other populations) versus normal at baseline (mean haemoglobin above 100 g/L for pregnant women and children aged six to 59 months, and above 110 g/L for other populations). Antimalarial drug resistance to parasite: known resistance versus no resistance versus unknown/mixed/unreported parasite resistance. Folate status at baseline: Deficient (e.g. RBC folate concentration of less than 305 nmol/L, or serum folate concentration of less than 7nmol/L) and Insufficient (e.g. RBC folate concentration from 305 to less than 906 nmol/L, or serum folate concentration from 7 to less than 25 nmol/L) versus Sufficient (e.g. RBC folate concentration above 906 nmol/L, or serum folate concentration above 25 nmol/L). Presence of anaemia at baseline: yes versus no. Mandatory fortification status: yes, versus no (voluntary or none). We will only use the primary outcomes in any subgroup analyses, and we will limit subgroup analyses to those outcomes for which three or more trials contributed data. Comparisons between subgroups will be performed using Review Manager 5.4 (Review Manager 2020). Sensitivity analysis We will perform a sensitivity analysis, using the risk of bias as a variable to explore the robustness of the findings in our primary outcomes. We will verify the behaviour of our estimators by adding and removing studies with a high risk of bias overall from the analysis. That is, studies with a low risk of bias versus studies with a high risk of bias. Summary of findings and assessment of the certainty of the evidence For the assessment across studies, we will use the GRADE approach, as outlined in (Schünemann 2021). We will use the five GRADE considerations (study limitations based on RoB2 judgements, consistency of effect, imprecision, indirectness, and publication bias) to assess the certainty of the body of evidence as it relates to the studies which contribute data to the meta-analyses for the primary outcomes. The GRADEpro Guideline Development Tool (GRADEpro) will be used to import data from Review Manager 5.4 (Review Manager 2020) to create 'Summary of Findings' tables. The primary outcomes for the main comparison will be listed with estimates of relative effects, along with the number of participants and studies contributing data for those outcomes. These tables will provide outcome-specific information concerning the overall certainty of evidence from studies included in the comparison, the magnitude of the effect of the interventions examined, and the sum of available data on the outcomes we considered. We will include only primary outcomes in the summary of findings tables. For each individual outcome, two review authors (KSC, LFY) will independently assess the certainty of the evidence using the GRADE approach (Balshem 2011). For assessments of the overall certainty of evidence for each outcome that includes pooled data from included trials, we will downgrade the evidence from 'high certainty' by one level for serious (or by two for very serious) study limitations (risk of bias, indirectness of evidence, serious inconsistency, imprecision of effect estimates, or potential publication bias).

Crider K ，Williams J ，Qi YP ，Gutman J ，Yeung L ，Mai C ，Finkelstain J ，Mehta S ，Pons-Duran C ，Menéndez C ，Moraleda C ，Rogers L ，Daniels K ，Green P ... -  《Cochrane Database of Systematic Reviews》

ARTIFICIAL INTELLIGENCE IN MEDICAL PRACTICE: REGULATIVE ISSUES AND PERSPECTIVES.

Pashkov VM ，Harkusha AO ，Harkusha YO 《-》