Project Grant R01CA297832

SCH: COUNTERFACTUAL EXPLANATIONS FOR AI-ASSISTED CANCER DIAGNOSIS AND SUBTYPIING - ACCURATE DIAGNOSIS OF CANCER HINGES ON HISTOPATHOLOGICAL ASSESSMENT, WITH TREATMENT PIVOTING UPON THE TUMOR'S MORPHOLOGICAL CLASSIFICATION. AI MODELS, ESPECIALLY DEEP LEARNING (DL) MODELS, HAVE SHOWN GREAT PROMISE IN ACCURATELY CLASSIFYING TUMORS FROM HISTOPATHOLOGICAL IMAGES (OFTEN WITH ADDITIONAL GENOMIC INFORMATION). UNLIKE TYPICAL MEDICAL IMAGES FEATURING SMALL CRITICAL AREAS, HISTOPATHOLOGICAL IMAGES ARE TEXTURAL, WITH RELEVANT TEXTURE SPANNING THE ENTIRE IMAGE, MAKING IT CHALLENGING TO EXPLAIN DL PREDICTION BY LOCATING AREAS OF AN IMAGE. SUCH LACK OF EXPLAINABILITY (AND INTERPRETABILITY) SEVERELY LIMITS DL'S POTENTIAL AS A VALUABLE TOOL TO PATHOLOGISTS. THUS, THERE IS A CRITICAL NEED TO SYSTEMATICALLY EXPLAIN DL HISTOPATHOLOGICAL MODELS, BEYOND MERE LOCALIZATION, TO SUBSTANTIALLY IMPROVE AI-ASSISTED CANCER DIAGNOSIS FOR PATHOLOGISTS. THIS PROJECT AIMS TO DEVELOP A PRINCIPLED FRAMEWORK TO SYSTEMATICALLY EXPLAIN DL HISTOPATHOLOGICAL MODELS USING COUNTERFACTUAL EXPLANATIONS. THE RATIONALE IS THAT WHILE TEXTURE FEATURES ARE NOT AMENABLE TO LOCALIZATION-BASED EXPLANATION METHODS, ONE CAN EXPLAIN THE MODEL BY ASKING COUNTERFACTUAL QUESTIONS SUCH AS "WHAT HISTOPATHOLOGICAL IMAGE COULD HAVE SHIFTED THE MODEL PREDICTION FROM NON-AGGRESSIVE TUMOR TO AGGRESSIVE TUMOR". SPECIFICALLY, THIS PROJECT CENTERS AROUND FOUR TASKS: (1) DATASET-LEVEL GENERATIVE EXPLANATION: DEVELOPING A DATASET-LEVEL "GENERATIVE EXPLAINER" FRAMEWORK TO EXPLAIN ANY GIVEN DL HISTOPATHOLOGICAL MODEL BY GENERATING A SPECTRUM OF HISTOPATHOLOGICAL IMAGES THAT CAN LEAD TO AN ASSOCIATED SPECTRUM OF DIFFERENT PREDICTIONS (E.G., FROM "NON-AGGRESSIVE" THROUGH "AGGRESSIVE" TO "HIGHLY AGGRESSIVE") OF THE EXPLAINED DL MODEL. (2) INSTANCE-LEVEL COUNTERFACTUAL EXPLANATION: DEVELOPING A PRINCIPLED INSTANCE-LEVEL "COUNTERFACTUAL EXPLAINER" FRAMEWORK TO GENERATE INSTANCE-SPECIFIC COUNTERFACTUAL EXPLANATIONS FOR A SPECIFIC HISTOPATHOLOGICAL IMAGE. (3) FAST COUNTERFACTUAL EXPLANATION: DEVELOPING A "FAST COUNTERFACTUAL EXPLAINER" FRAMEWORK TO ENABLE REAL-TIME GENERATION OF COUNTERFACTUAL HISTOPATHOLOGICAL IMAGES. (4) FROM EXPLANATION TO SUBTYPE DISCOVERY: DEVELOPING A "SUBTYPING COUNTERFACTUAL EXPLAINER" FRAMEWORK THAT GOES BEYOND EXPLANATION TO DISCOVER NOVEL CANCER SUBTYPES (OR PHENOTYPES). RELEVANCE (SEE INSTRUCTIONS): ACCURATE DIAGNOSIS OF CANCER HINGES ON HISTOPATHOLOGICAL ASSESSMENT, WITH TREATMENT PIVOTING UPON THE TUMOR'S MORPHOLOGICAL CLASSIFICATION. AI MODELS CAN OFTEN ACCURATELY CLASSIFY TUMORS FROM HISTOPATHOLOGICAL IMAGES, BUT THEIR LACK OF INTERPRETABILITY SEVERELY HINDERS THEIR DEPLOYMENT IN CLINICAL SCENARIOS. THIS PROJECT DEVELOPS A PRINCIPLED FRAMEWORK TO SYSTEMATICALLY EXPLAIN AI HISTOPATHOLOGICAL MODELS USING COUNTERFACTUAL EXPLANATIONS, THEREBY SUBSTANTIALLY IMPROVING AI-ASSISTED CANCER DIAGNOSIS FOR PATHOLOGISTS.