Collaborative research: a subspace optimization framework for resource-efficient and private fine-tuning of large language models

The National Science Foundation Division of Electrical, Communications and Cyber Systems awarded The University of Texas at San Antonio $120,000 on January 1, 2027, under the Engineering program (CFDA 47.041) to develop a subspace optimization framework for resource-efficient and privacy-preserving fine-tuning of large language models.

The research addresses computational and data-sensitivity barriers that constrain small organizations, universities, healthcare institutions, and resource-limited users from adapting general-purpose LLMs to specialized tasks. The project investigates methods to achieve performance comparable to full-parameter fine-tuning while operating within limited computing resources and protecting sensitive training data that cannot be shared. The framework dynamically constructs and updates low-dimensional subspaces that capture structured patterns in model parameter changes during fine-tuning, reducing both financial and energy costs of model adaptation.

The project runs through December 31, 2029, with performance at UTSA's San Antonio, Texas location. Work includes development of educational content, laboratory modules, and hands-on research experiences for undergraduate and graduate students. UTSA also conducts pre-college outreach introducing middle- and high-school students to modern AI and engineering through project-based learning at participating institutions.

Abstract

Large language models (llms) have transformed artificial intelligence (AI) applications by enabling advanced language understanding, content generation, and decision-making across many domains. However, adapting these general-purpose models to specialized tasks often requires substantial computing resources and access to sensitive, domain-specific data. These requirements can limit the ability of small organizations, universities, healthcare institutions, and other resource-constrained users to benefit from recent advances in AI. This project addresses this challenge by developing methods that make LLM adaptation more resource efficient while protecting sensitive information. The research contributes to societal benefits by broadening access to advanced AI tools, strengthening the protection of sensitive information, and reducing the financial and energy costs of model adaptation. The project also supports the development of the national AI workforce through new course content, laboratory modules, and hands-on research experiences for undergraduate and graduate students. Through established pre-college outreach activities at the participating institutions, project-based learning also introduces middle- and high-school students to modern AI and engineering. The scientific problem addressed by this project is how to achieve performance comparable to full-parameter fine-tuning when computing resources are limited and training data are sensitive or cannot be shared. The research builds on evidence that changes made to large models during fine-tuning often follow structured patterns that can be represented in much smaller, low-dimensional spaces. Using this insight, the project investigates four connected research thrusts. First, the project develops a subspace optimization framework that dynamically constructs and updates these informative subspaces and optimizes the model only within them using low-cost evaluations of the training objective to reduce memory and computational requirements. Second, for settings in which sensitive data are stored centrally, the project integrates differential privacy with subspace optimization to improve the trade-offs among privacy, model performance, and resource use. Third, for distributed settings where data remain at separate entities, the project develops a federated subspace optimization method that supports collaborative fine-tuning while reducing communication costs and avoiding direct data sharing. Finally, the project connects the methodological and theoretical advances to practice by applying the developed methods to real-world healthcare problems and evaluating their effectiveness. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the foundation's intellectual merit and broader impacts review criteria.- subawards are not planned for this award.