Project Grant 2211429

COLLABORATIVE RESEARCH: SHF: MEDIUM: TOWARDS MORE HUMAN-LIKE AI MODELS OF SOURCE CODE -THE RESEARCH OBJECTIVE OF THIS PROJECT IS TO DESIGN NOVEL ARTIFICIAL INTELLIGENCE-BASED MODELS OF SOFTWARE THAT LEARN FROM AND ARE INFORMED BY HUMAN BEHAVIOR. THE FRONTIER OF MANY AREAS OF SOFTWARE ENGINEERING (SE) RESEARCH INVOLVES APPLICATIONS OF AI-BASED MODELS TO SE TASKS. MANY TASKS IN SE RESEARCH RELY ON THE SAME BASIC UNDERPINNING TECHNOLOGIES, OFTEN A NEURAL REPRESENTATION OF SOURCE CODE THAT IS TRAINED TO FIND FEATURES IN CODE, WHICH ARE THEN USED FOR VARIOUS TASKS E.G., TO PREDICT WORDS FOR A DOCUMENT OR AREAS OF CODE LIKELY TO CONTAIN A BUG. WHILE THE FIRST APPLICATIONS OF RECURRENT NEURAL NETWORK-BASED ENCODER-DECODER MODELS WERE A PARADIGM SHIFT OVER THE MANUALLY-CRAFTED HEURISTICS AND RULES THAT THE NEURAL MODELS REPLACED, SUBSEQUENT CHANGES HAVE YIELDED LESS IMPROVEMENT DESPITE INCREASED SOPHISTICATION. THE VISION OF THIS PROJECT IS TO ACHIEVE A BREAKTHROUGH IN MORE HUMAN-LIKE NEURAL MODELS OF SOURCE CODE. ITS AIM IS TO ADVANCE A BROAD SPECTRUM OF SE RESEARCH TASKS THAT RELY ON NEURAL MODELS, BY IMPROVING THE NEURAL MODELS OF CODE THAT UNDERPIN MANY DOWNSTREAM TASKS. THE RESEARCH PLAN IS THREE-FOLD: FIRST, THE PROJECT WILL CHARACTERIZE HUMAN BEHAVIOR DURING DIFFERENT SE TASKS VIA EYE-TRACKING AND IDE-BASED EXPERIMENTS. SECOND, THE PROJECT WILL DESIGN MODELS THAT PREDICT OR EVEN MIMIC HUMAN BEHAVIOR. THIRD, THE PROJECT WILL USE THOSE MODELS TO AUGMENT AND IMPROVE NEURAL REPRESENTATIONS OF SOURCE CODE, AND EVALUATE THESE NEW REPRESENTATIONS IN A VARIETY OF SE TASKS. THIS AWARD REFLECTS NSF'S STATUTORY MISSION AND HAS BEEN DEEMED WORTHY OF SUPPORT THROUGH EVALUATION USING THE FOUNDATION'S INTELLECTUAL MERIT AND BROADER IMPACTS REVIEW CRITERIA.