Project Grant K23HL181388

AN INTELLIGENT CLINICAL DECISION SUPPORT SYSTEM FOR PERIPHERAL ARTERIAL DISEASE - PROJECT SUMMARY / ABSTRACT UNSTRUCTURED CLINICIAN NOTES CONTAIN "80% OF MEDICAL INFORMATION" IN THE ELECTRONIC HEALTH RECORD (EHR) BUT ARE CUMBERSOME TO SEARCH AND ANALYZE. MULTIPLE NATIONAL THOUGHT LEADERS IN HEALTH CARE, INCLUDING THE NATIONAL ACADEMY OF SCIENCE, ENGINEERING AND MEDICINE HAVE CALLED FOR IMPROVED "ACCESS, TOOLS, AND CAPACITY FOR [CLINICAL] DATA ANALYSIS." YET, OUR INABILITY TO SEARCH, SUMMARIZE, AND EXTRACT KNOWLEDGE FROM CLINICAL NOTES REMAINS A MAJOR TECHNICAL IMPEDIMENT TO REPLACE THE TEDIOUS, TIME-CONSUMING TASK OF HUMAN CHART REVIEW. LARGE LANGUAGE MODELS (LLMS) ARE ADVANCED DEEP LEARNING ALGORITHMS CAPABLE OF THE UNDERSTANDING OF CONCEPTS AND CONTEXT FROM TEXT. THEY FACILITATE SEVERAL TASKS RELEVANT TO DIGITAL CHART REVIEW SUCH AS ADVANCED INFORMATION SEARCH AND RETRIEVAL. FURTHERMORE, LLMS CAN GENERATE COHERENT PROSE TO FORM CONTEXT SPECIFIC SUMMARIZATIONS. TOGETHER, THESE TWO ABILITIES HOLD THE POTENTIAL OF REALIZING THE VISION OF A WORLD WHERE MOST CLINICAL DECISIONS ARE COST-EFFECTIVELY "SUPPORTED BY ACCURATE, TIMELY, AND UP-TO-DATE CLINICAL INFORMATION." NEVERTHELESS, REAL WORLD DEPLOYMENT OF DIGITAL CHART REVIEW MUST ENSURE PERFORMANCE (I.E. ACCURACY, RELIABILITY) AND CLINICIANS' COMPATIBILITY TO FACILITATE EFFECTIVE AND SUSTAINABLE INTERACTIONS WITH CLINICIANS WITHIN THE CONTEXT OF THEIR CLINICAL WORKFLOWS. OUR RESEARCH GOAL IS TO DEVELOP A DIGITAL CHART REVIEW FOR PROVIDING CLINICIANS WITH ACCURATE AND ACTIONABLE INFORMATION AT THE POINT OF CARE. OUR CENTRAL HYPOTHESIS IS THAT A DOMAIN ADAPTED LLMS CAN DELIVER A DECISION FOCUSED CHART SUMMARY WHICH IS COMPARABLE TO HUMAN CHART REVIEW BY VASCULAR SURGEONS. WE WILL TEST THIS HYPOTHESIS USING REAL WORLD DATA FROM A LARGE STATEWIDE HEALTH INFORMATION EXCHANGE ON MORE THAN 124,000 PATIENTS WITH PERIPHERAL ARTERIAL DISEASE I.E. PAD (THE LEADING CAUSE OF AMPUTATION IN THE US). THE MENTORSHIP PANEL DEVELOPED A SET OF RESEARCH ACTIVITIES TO EXECUTE THE FOLLOWING AIMS THAT ARE ALIGNED WITH THE CANDIDATE'S OVERALL GOAL OF BECOMING AN INDEPENDENT CLINICAL INVESTIGATOR CAPABLE OF USING ADVANCES IN HEALTH INFORMATION TECHNOLOGY TO TRANSFORM VASCULAR CARE, AND THUS THE HEALTH OUTCOMES OF UNDERSERVED COMMUNITIES LIVING WITH PAD. IN AIM 1 WE DESIGN AND VALIDATE A LARGE LANGUAGE MODEL CAPABLE OF EXTRACTING AND SUMMARIZING PAD INFORMATION FROM PLAIN TEXT NOTES. WE WILL EVALUATE THE OUTPUTS OF THE LARGE LANGUAGE MODEL FOR ACCURACY, COMPLETENESS, RELEVANCE, AND UNCERTAINTY USING INDUSTRY STANDARD METRICS. WE HYPOTHESIZE THAT THE LLM TEXT EXTRACTION AND SUMMARIZATION IS COMPARABLE TO HUMAN CHART REVIEW. IN AIM 2, WE CO-DESIGN WITH CLINICIANS A MINIMALLY VIABLE PROTOTYPE OF A DIGITAL CHART REVIEW SYSTEM. WE WILL INCORPORATE FEEDBACK FROM THE CLINICIANS USING THE ITERATIVE AGILE INNOVATION PROCESS. WE HYPOTHESIZE THAT DIFFERENT CLINICAL SCENARIOS WILL REQUIRE EMPHASIS OF DIFFERENT INFORMATION TYPES.