Project Grant 2326188

FW-HTF-RL/COLLABORATIVE RESEARCH: THE FUTURE OF AVIATION INSPECTION: ARTIFICIAL INTELLIGENCE AND MIXED REALITY AS AGENTS OF TRANSFORMATION -GLOBALLY, ECONOMIES RELY ON SAFE AIR TRAVEL; HOWEVER, WITH HUMAN ERROR ACCOUNTING FOR 70% OF AIRCRAFT ACCIDENTS, AN EMPHASIS NEEDS TO BE PLACED ON HELPING THOSE RESPONSIBLE FOR ENSURING THE SAFETY AND RELIABILITY OF MODERN AND FUTURE AIRCRAFTS. AVIATION MAINTENANCE TECHNICIANS ROUTINELY STRUGGLE TO KEEP PACE WITH THE NEEDS OF THE AVIATION INDUSTRY AS THEY ARE IMPACTED BY A HAZARDOUS WORK ENVIRONMENT, HIGH COGNITIVE LOAD, A COMPLEX TASK, AND GROWING WORKER SHORTAGES, AND THIS STRUGGLE IS ONLY POISED TO GROW AS THE NEED FOR THEM IS SLATED TO INCREASE IN THE FUTURE. THIS FUTURE OF WORK AT THE HUMAN-TECHNOLOGY FRONTIER - RESEARCH: LARGE (FW-HTF-RL) AWARD SUPPORTS A COLLABORATIVE RESEARCH PROJECT TO ADDRESS THIS CHALLENGE, LED BY A GROUP OF UNIVERSITIES, PROFESSIONAL ORGANIZATIONS AND INDUSTRY PARTNERS: CLEMSON UNIVERSITY, PURDUE UNIVERSITY, GREENVILLE TECHNICAL COLLEGE, SA TECHNOLOGIES, NATIONAL CENTER FOR AUTONOMOUS TECHNOLOGIES, AVIATION TECHNICIAN EDUCATION COUNCIL, CHOOSEAEROSPACE, FRONTIER AIRLINES, AAR, REPUBLIC AIRWAYS, ATLAS AIR, STEVENS AEROSPACE, VERICOR, AMFA, AND LOCKHEED MARTIN. THE GOAL OF THIS RESEARCH PROJECT IS TO MERGE EXPERTISE AND TECHNOLOGICAL ADVANCEMENTS IN ARTIFICIAL INTELLIGENCE (AI) AND EXTENDED REALITY (XR) TECHNOLOGIES TO ENHANCE THE COGNITIVE CAPABILITIES OF AVIATION MAINTENANCE TECHNICIANS DURING INSPECTION TASKS. THE CENTRAL IDEA IS THAT THIS AUGMENTATION COULD INCREASE THEIR INSPECTION CAPABILITIES, REDUCE WORKLOAD, AND ULTIMATELY REDUCE THE NUMBER OF AVIATION ACCIDENTS CAUSED BY MAINTENANCE ERRORS. IN THE LONG TERM, THESE EFFORTS WILL CONTINUOUSLY IMPROVE THE OVERALL HEALTH OF BOTH FUTURE AVIATION MAINTENANCE TECHNICIANS AND AIRCRAFT FLEETS. FURTHERMORE, WHILE THIS WORK HAS PRIORITIZED THE IMMEDIATE EXPLORATION OF THE AVIATION MAINTENANCE SECTOR, SIMILAR DOMAINS THAT LEVERAGE INFORMATION-RICH TASKS, VISUAL INSPECTION, AND ROUTINE MAINTENANCE STAND TO BENEFIT FROM THE DEMONSTRATED TECHNOLOGICAL INTEGRATIONS. THIS PROJECT BRINGS TOGETHER SEVERAL DISCIPLINES, INCLUDING HUMAN FACTORS ENGINEERING, COMPUTER SCIENCE, HUMAN-COMPUTER INTERACTION, BEHAVIORAL AND SOCIAL SCIENCE, ECONOMICS, AND AVIATION MAINTENANCE. THE INVESTIGATOR TEAM IS STRUCTURED TO ACHIEVE MULTIPLE CONVERGENT GOALS. FIRST, THIS WORK LEVERAGES HUMAN FACTORS, BEHAVIORAL SCIENCE, AND HUMAN-COMPUTER INTERACTION DISCIPLINES TO UNDERSTAND THE IMPACTS THAT MERGED AI AND XR TECHNOLOGIES WILL HAVE ON THE COGNITIVE PROCESS OF AVIATION MAINTENANCE TECHNICIANS AND THE POTENTIAL RISKS ASSOCIATED WITH THE INTEGRATION OF THESE TECHNOLOGIES INTO THIS WORKFORCE. SECOND, THIS RESEARCH PROJECT LEVERAGES COMPUTER SCIENCE AND HUMAN-COMPUTER INTERACTION TO DESIGN AND DEVELOP NOVEL AI MODELS THAT PERFORM AIRCRAFT INSPECTIONS AND MAKE MAINTENANCE RECOMMENDATIONS BASED ON INFORMATION GATHERED THROUGH XR TECHNOLOGIES. THE RESEARCH TEAM WILL HELP DESIGN COMMUNICATION AND INTERACTION PARADIGMS SO FUTURE AVIATION MAINTENANCE TECHNICIANS CAN UNDERSTAND AND ACCEPT THESE RECOMMENDATIONS. THIRD, THE PROJECT COULD PROVIDE THE BREAKTHROUGH INTEGRATION OF AI AND XR TECHNOLOGY WITHIN THE AVIATION MAINTENANCE FIELD TO HELP AVIATION MAINTENANCE TECHNICIANS IN REAL TIME. FINALLY, THIS EFFORT CONTINUOUSLY SYNTHESIZES THE RESULTS OF THE OTHER THREE GOALS WITH SOCIETY AND WORKFORCE-DERIVED DATA TO QUANTIFY THE ECONOMIC FEASIBILITY AND IMPACT THAT AI AND XR TECHNOLOGIES WILL HAVE ON THE AVIATION MAINTENANCE DOMAIN AND ADJACENT WORKPLACE SECTORS. THIS PROJECT HAS BEEN FUNDED BY THE FUTURE OF WORK AT THE HUMAN-TECHNOLOGY FRONTIER CROSS-DIRECTORATE PROGRAM TO PROMOTE A DEEPER FUNDAMENTAL UNDERSTANDING OF THE INTERDEPENDENT HUMAN-TECHNOLOGY PARTNERSHIP IN WORK CONTEXTS BY ADVANCING THE DESIGN OF INTELLIGENT WORK TECHNOLOGIES THAT OPERATE IN HARMONY WITH HUMAN WORKERS. THIS AWARD REFLECTS NSF'S STATUTORY MISSION AND HAS BEEN DEEMED WORTHY OF SUPPORT THROUGH EVALUATION USING THE FOUNDATION'S INTELLECTUAL MERIT AND BROADER IMPACTS REVIEW CRITERIA.- SUBAWARDS ARE NOT PLANNED FOR THIS AWARD.