Evaluation of online chat-based artificial intelligence responses about inflammatory bowel disease and diet.
The USA has the highest age-standardized prevalence of inflammatory bowel disease (IBD). Both genetic and environmental factors have been implicated in IBD flares and multiple strategies are centered around avoiding dietary triggers to maintain remission. Chat-based artificial intelligence (CB-AI) has shown great potential in enhancing patient education in medicine. We evaluate the role of CB-AI in patient education on dietary management of IBD.
Six questions evaluating important concepts about the dietary management of IBD which then were posed to three CB-AI models - ChatGPT, BingChat, and YouChat three different times. All responses were graded for appropriateness and reliability by two physicians using dietary information from the Crohn's and Colitis Foundation. The responses were graded as reliably appropriate, reliably inappropriate, and unreliable. The expert assessment of the reviewing physicians was validated by the joint probability of agreement for two raters.
ChatGPT provided reliably appropriate responses to questions on dietary management of IBD more often than BingChat and YouChat. There were two questions that more than one CB-AI provided unreliable responses to. Each CB-AI provided examples within their responses, but the examples were not always appropriate. Whether the response was appropriate or not, CB-AIs mentioned consulting with an expert in the field. The inter-rater reliability was 88.9%.
CB-AIs have the potential to improve patient education and outcomes but studies evaluating their appropriateness for various health conditions are sparse. Our study showed that CB-AIs have the ability to provide appropriate answers to most questions regarding the dietary management of IBD.
Naqvi HA
,Delungahawatta T
,Atarere JO
,Bandaru SK
,Barrow JB
,Mattar MC
... -
《-》
Use and Application of Large Language Models for Patient Questions Following Total Knee Arthroplasty.
A consumer-focused health care model not only allows unprecedented access to information, but equally warrants consideration of the appropriateness of providing accurate patient health information. Nurses play a large role in influencing patient satisfaction following total knee arthroplasty (TKA), but they come at a cost. A specific natural language artificial intelligence (AI) model, ChatGPT (Chat Generative Pre-trained Transformer), has accumulated over 100 million users within months of launching. As such, we aimed to compare: (1) orthopaedic surgeons' evaluation of the appropriateness of the answers to the most frequently asked patient questions after TKA; and (2) patients' comfort level in answering their postoperative questions by using answers provided by arthroplasty-trained nurses and ChatGPT.
We prospectively created 60 questions based on the most commonly asked patient questions following TKA. There were 3 fellowship-trained surgeons who assessed the answers provided by arthroplasty-trained nurses and ChatGPT-4 to each of the questions. The surgeons graded each set of responses based on clinical judgment as: (1) "appropriate," (2) "inappropriate" if the response contained inappropriate information, or (3) "unreliable," if the responses provided inconsistent content. Patients' comfort level and trust in AI were assessed using Research Electronic Data Capture (REDCap) hosted at our local hospital.
The surgeons graded 44 out of 60 (73.3%) responses for the arthroplasty-trained nurses and 44 out of 60 (73.3%) for ChatGPT to be "appropriate." There were 4 responses graded "inappropriate" and one response graded "unreliable" provided by the nurses. For the ChatGPT response, there were 5 responses graded "inappropriate" and no responses graded "unreliable." There were 136 patients (53.8%) who were more comfortable with the answers provided by ChatGPT compared to 86 patients (34.0%) who preferred the answers from arthroplasty-trained nurses. Of the 253 patients, 233 (92.1%) were uncertain if they would trust AI to answer their postoperative questions. There were 127 patients (50.2%) who answered that if they knew the previous answer was provided by ChatGPT, their comfort level in trusting the answer would change.
One potential use of ChatGPT can be found in providing appropriate answers to patient questions after TKA. At our institution, cost expenditures can potentially be minimized while maintaining patient satisfaction. Inevitably, successful implementation is dependent on the ability to provide information that is credible and in accordance with the objectives of both physicians and patients.
III.
Bains SS
,Dubin JA
,Hameed D
,Sax OC
,Douglas S
,Mont MA
,Nace J
,Delanois RE
... -
《-》
Accuracy of Information given by ChatGPT for Patients with Inflammatory Bowel Disease in Relation to ECCO Guidelines.
As acceptance of artificial intelligence [AI] platforms increases, more patients will consider these tools as sources of information. The ChatGPT architecture utilizes a neural network to process natural language, thus generating responses based on the context of input text. The accuracy and completeness of ChatGPT3.5 in the context of inflammatory bowel disease [IBD] remains unclear.
In this prospective study, 38 questions worded by IBD patients were inputted into ChatGPT3.5. The following topics were covered: [1] Crohn's disease [CD], ulcerative colitis [UC], and malignancy; [2] maternal medicine; [3] infection and vaccination; and [4] complementary medicine. Responses given by ChatGPT were assessed for accuracy [1-completely incorrect to 5-completely correct] and completeness [3-point Likert scale; range 1-incomplete to 3-complete] by 14 expert gastroenterologists, in comparison with relevant ECCO guidelines.
In terms of accuracy, most replies [84.2%] had a median score of ≥4 (interquartile range [IQR]: 2) and a mean score of 3.87 [SD: ±0.6]. For completeness, 34.2% of the replies had a median score of 3 and 55.3% had a median score of between 2 and <3. Overall, the mean rating was 2.24 [SD: ±0.4, median: 2, IQR: 1]. Though groups 3 and 4 had a higher mean for both accuracy and completeness, there was no significant scoring variation between the four question groups [Kruskal-Wallis test p > 0.05]. However, statistical analysis for the different individual questions revealed a significant difference for both accuracy [p < 0.001] and completeness [p < 0.001]. The questions which rated the highest for both accuracy and completeness were related to smoking, while the lowest rating was related to screening for malignancy and vaccinations especially in the context of immunosuppression and family planning.
This is the first study to demonstrate the capability of an AI-based system to provide accurate and comprehensive answers to real-world patient queries in IBD. AI systems may serve as a useful adjunct for patients, in addition to standard of care in clinics and validated patient information resources. However, responses in specialist areas may deviate from evidence-based guidance and the replies need to give more firm advice.
Sciberras M
,Farrugia Y
,Gordon H
,Furfaro F
,Allocca M
,Torres J
,Arebi N
,Fiorino G
,Iacucci M
,Verstockt B
,Magro F
,Katsanos K
,Busuttil J
,De Giovanni K
,Fenech VA
,Chetcuti Zammit S
,Ellul P
... -
《-》
AGA Clinical Practice Update on Diet and Nutritional Therapies in Patients With Inflammatory Bowel Disease: Expert Review.
Diet plays a critical role in human health, but especially for patients with inflammatory bowel disease (IBD). Guidance about diet for patients with IBD are often controversial and a source of uncertainty for many physicians and patients. The role of diet has been investigated as a risk factor for IBD etiopathogenesis and as a therapy for active disease. Dietary restrictions, along with the clinical complications of IBD, can result in malnutrition, an underrecognized condition among this patient population. The aim of this American Gastroenterological Association (AGA) Clinical Practice Update (CPU) is to provide best practice advice statements, primarily to clinical gastroenterologists, covering the topics of diet and nutritional therapies in the management of IBD, while emphasizing identification and treatment of malnutrition in these patients. We provide guidance for tailored dietary approaches during IBD remission, active disease, and intestinal failure. A healthy Mediterranean diet will benefit patients with IBD, but may require accommodations for food texture in the setting of intestinal strictures or obstructions. New data in Crohn's disease supports the use of enteral liquid nutrition to help induce remission and correct malnutrition in patients heading for surgery. Parenteral nutrition plays a critical role in patients with IBD facing acute and/or chronic intestinal failure. Registered dietitians are an essential part of the interdisciplinary team approach for optimal nutrition assessment and management in the patient population with IBD.
This expert review was commissioned and approved by the AGA Clinical Practice Updates Committee and the AGA Governing Board to provide timely guidance on a topic of high clinical importance to the AGA membership and underwent internal peer review by the CPU Committee and external peer review through standard procedures of Gastroenterology. The best practice advice statements were drawn from reviewing existing literature combined with expert opinion to provide practical advice on the role of diet and nutritional therapies in patients with IBD. Because this was not a systematic review, formal rating of the quality of evidence or strength of the presented considerations was not performed. Best Practice Advice Statements BEST PRACTICE ADVICE 1: Unless there is a contraindication, all patients with IBD should be advised to follow a Mediterranean diet rich in a variety of fresh fruits and vegetables, monounsaturated fats, complex carbohydrates, and lean proteins and low in ultraprocessed foods, added sugar, and salt for their overall health and general well-being. No diet has consistently been found to decrease the rate of flares in adults with IBD. A diet low in red and processed meat may reduce ulcerative colitis flares, but has not been found to reduce relapse in Crohn's disease. BEST PRACTICE ADVICE 2: Patients with IBD who have symptomatic intestinal strictures may not tolerate fibrous, plant-based foods (ie, raw fruits and vegetables) due to their texture. An emphasis on careful chewing and cooking and processing of fruits and vegetables to a soft, less fibrinous consistency may help patients with IBD who have concomitant intestinal strictures incorporate a wider variety of plant-based foods and fiber in their diets. BEST PRACTICE ADVICE 3: Exclusive enteral nutrition using liquid nutrition formulations is an effective therapy for induction of clinical remission and endoscopic response in Crohn's disease, with stronger evidence in children than adults. Exclusive enteral nutrition may be considered as a steroid-sparing bridge therapy for patients with Crohn's disease. BEST PRACTICE ADVICE 4: Crohn's disease exclusion diet, a type of partial enteral nutrition therapy, may be an effective therapy for induction of clinical remission and endoscopic response in mild to moderate Crohn's disease of relatively short duration. BEST PRACTICE ADVICE 5: Exclusive enteral nutrition may be an effective therapy in malnourished patients before undergoing elective surgery for Crohn's disease to optimize nutritional status and reduce postoperative complications. BEST PRACTICE ADVICE 6: In patients with IBD who have an intra-abdominal abscess and/or phlegmonous inflammation that limits ability to achieve optimal nutrition via the digestive tract, short-term parenteral nutrition may be used to provide bowel rest in the preoperative phase to decrease infection and inflammation as a bridge to definitive surgical management and to optimize surgical outcomes. BEST PRACTICE ADVICE 7: We suggest the use of parenteral nutrition for high-output gastrointestinal fistula, prolonged ileus, short bowel syndrome, and for patients with IBD with severe malnutrition when oral and enteral nutrition has been trialed and failed or when enteral access is not feasible or contraindicated. BEST PRACTICE ADVICE 8: In patients with IBD and short bowel syndrome, long-term parenteral nutrition should be transitioned to customized hydration management (ie, intravenous electrolyte support and/or oral rehydration solutions) and oral intake whenever possible to decrease the risk of developing long-term complications. Treatment with glucagon-like peptide-2 agonists can facilitate this transition. BEST PRACTICE ADVICE 9: All patients with IBD warrant regular screening for malnutrition by their provider by means of assessing signs and symptoms, including unintended weight loss, edema and fluid retention, and fat and muscle mass loss. When observed, more complete evaluation for malnutrition by a registered dietitian is indicated. Serum proteins are no longer recommended for the identification and diagnosis of malnutrition due to their lack of specificity for nutritional status and high sensitivity to inflammation. BEST PRACTICE ADVICE 10: All patients with IBD should be monitored for vitamin D and iron deficiency. Patients with extensive ileal disease or prior ileal surgery (resection or ileal pouch) should be monitored for vitamin B12 deficiency. BEST PRACTICE ADVICE 11: All outpatients and inpatients with complicated IBD warrant co-management with a registered dietitian, especially those who have malnutrition, short bowel syndrome, enterocutaneous fistula, and/or are requiring more complex nutrition therapies (eg, parenteral nutrition, enteral nutrition, or exclusive enteral nutrition), or those on a Crohn's disease exclusion diet. We suggest that all newly diagnosed patients with IBD have access to a registered dietitian. BEST PRACTICE ADVICE 12: Breastfeeding is associated with a lower risk for diagnosis of IBD during childhood. A healthy, balanced, Mediterranean diet rich in a variety of fruits and vegetables and decreased intake of ultraprocessed foods have been associated with a lower risk of developing IBD.
Hashash JG
,Elkins J
,Lewis JD
,Binion DG
... -
《-》