Project Grant 2402327

COLLABORATIVE RESEARCH: CSR: MEDIUM: DISCO: DISCIPLINED DATA SCIENCE FRAMEWORK FOR STORAGE I/O MANAGEMENT -IN THE MULTI-BILLION-DOLLAR COMPUTER STORAGE INDUSTRY, EFFICIENT OPERATION IS ESSENTIAL FOR ACHIEVING GOOD APPLICATION ACCURACY, RELIABILITY, AND PERFORMANCE. TRADITIONALLY, THIS EFFICIENCY HAS RELIED ON HEURISTIC ALGORITHMS WITH PARAMETERS THAT ARE SELECTED BY HUMANS. HOWEVER, AS WORKLOADS AND DEVICES BECOME INCREASINGLY COMPLEX, MANUAL TUNING BY HUMANS BECOMES IMPRACTICAL. THE DISCO PROJECT WILL ADDRESS HOW TO SYSTEMATICALLY LEVERAGE DATA SCIENCE (DS) TO REVOLUTIONIZE THE MANY FACETS OF STORAGE I/O DECISION MAKING. MORE SPECIFICALLY, DISCO?S RESEARCH OBJECTIVES ARE TO (A) PIONEER A COMPREHENSIVE DATA SCIENCE PIPELINE TAILORED TO ENHANCE THE STORAGE I/O DECISION-MAKING PROCESS BY IN-DEPTH EXPLORATION OF INTRICATE CONCEPTS SUCH AS DATA AUGMENTATION, PRECISE LABELING, NOISE FILTRATION, METICULOUS MODEL ENGINEERING, DRIFT DETECTION, AND MANY OTHERS; (B) TARGET BOTH CLASSICAL I/O POLICIES AND OPEN PROBLEMS IN THE CONTEXT OF MODERN DEVICE FEATURES AS WELL AS VENTURE TO ?UNCHARTED TERRITORIES SUCH AS INVESTIGATING WHAT DATA SCIENCE CAN REVEAL FROM BILLIONS OF PERFORMANCE DATA POINTS; AND (C) COMPREHENSIVELY ENCOMPASS HIGH-, MEDIUM-, AND LOW-FREQUENCY DECISION MAKING AND ADDRESS EACH OF THEIR OWN UNIQUE CHALLENGES, BUT AT THE SAME TIME ADDRESS CROSS-CUTTING CONCERNS SUCH AS ALL-IN-ONE INTEGRATION. THE DISCO PROJECT WILL BRING SIGNIFICANT BROADER IMPACTS, ESPECIALLY IN TRAINING FUTURE STORAGE DATA SCIENTISTS. THE DATA STORAGE RESEARCH VISION 2025 (DSRV) PAPER FROM AN NSF WORKSHOP EMPHASIZED THE DEFICIT OF THE PROFESSIONALS WHO ARE KNOWLEDGEABLE IN BOTH STORAGE AND AI AREAS WHERE THE NUMBER OF FRESH GRADUATE STUDENTS WITH THIS COMBINATION OF SKILLS IS SMALL, AND TRAINING EXISTING STAFF TAKES TIME AND EFFORT AND STORAGE COMPANIES ARE ALSO EXPERIENCING SIGNIFICANT COMPETITION FROM OTHER INDUSTRIES THAT REQUIRE AI/ML KNOWLEDGE. IN THIS CONTEXT, THE DISCO PROJECT WILL TRAIN GRADUATE AND UNDERGRADUATE STUDENTS TO BE PART OF THE NEXT-GENERATION STORAGE DATA SCIENTISTS. THE PROJECT WILL ALSO RELEASE OPEN ML-FOR-STORAGE TESTBEDS ALONG WITH A PUBLIC STORAGE DATA SCIENCE CURRICULUM. IN TERMS OF TECHNOLOGY TRANSFER, THE DSRV WORKSHOP PAPER ALSO STATES THAT ?STORAGE COMPANIES ARE EXCITED BY THE OPPORTUNITIES OF USING ML TO IMPROVE PERFORMANCE AND RELIABILITY, AND DEVELOP QUALITY PRODUCTS.? THE DISCO PROJECT WILL PRODUCE SOPHISTICATED ML-FOR-STORAGE SOLUTIONS FOR SOLID-STATE DRIVE (SSD) SYSTEMS, POTENTIALLY MAKING A POSITIVE IMPACT TO THE SSD MARKET THAT IS FORECASTED TO REACH OVER $50 BILLION BY 2025. THIS AWARD REFLECTS NSF'S STATUTORY MISSION AND HAS BEEN DEEMED WORTHY OF SUPPORT THROUGH EVALUATION USING THE FOUNDATION'S INTELLECTUAL MERIT AND BROADER IMPACTS REVIEW CRITERIA.- SUBAWARDS ARE NOT PLANNED FOR THIS AWARD.