SF24B-T007.pdf
Standard Form PDF 49 KB Posted
- Solicitation number
- SF24B-T007
About this file
This document is a Small Business Technology Transfer (STTR) or Small Business Innovation Research (SBIR) solicitation topic for Phase I, II, and III development work.
The topic SF24B-T007 seeks to develop machine learning or reinforcement learning architectures for satellite control systems that can provide guaranteed closed-loop behavior in nonlinear control contexts. The objective addresses the critical gap between rapidly advancing machine learning capabilities and the theoretical guarantees required for safe space-based implementation. Phase I work requires awardees to conduct a comprehensive literature review of machine/reinforcement learning techniques capable of providing performance guarantees, investigate satellite controller requirements, compile necessary theorems for demonstrating guaranteed behavior, and devise a test plan comparing theoretical predictions to practical performance. Phase II requires awardees to design theorems and control structures demonstrating which machine learning models and training approaches can provide provable stability guarantees, then implement these systems on multiple vehicles including a representative satellite to validate adherence to theoretical guarantees. Phase III involves cooperative integration with satellite software manufacturers and military satellite system developers, on-board demonstration of control system performance, and evaluation of transition opportunities for civilian government applications. The technology is ITAR-restricted under 22 CFR Parts 120-130 and EAR-controlled under 15 CFR Parts 730-774, requiring disclosure of any proposed foreign nationals, their countries of origin, visa status, and intended tasks. The project is classified under Space Platforms technology area and aligns with Space Technology and Trusted AI and Autonomy modernization priorities. No CMMC level requirement applies, and no Technical Point of Contact is designated.
View the file
Other versions and copies of SF 24B
| File | Revision | Posted | Attached to |
|---|---|---|---|
| SF24B-T005.pdf | Revision not stated | Multiple Hypothesis Management | |
| SF24B-T006.pdf | Revision not stated | Probabilistic 3D Outer Zone Radiation Belt Model | |
| SF24B-T011.pdf | Revision not stated | Into the Wild-Transitioning Basic Rsh Algs to Ops | |
| SF24B-T009.pdf | Revision not stated | Cultivating PWSA Innovations Through Collaboration | |
| SF24B-T008.pdf | Revision not stated | Self-Regulating Heaters for Satellites | |
| SF24B-T004.pdf | Revision not stated | Data-Centric AI in Multi Domain Awareness |
Who attaches SF 24B
| Agency | Files |
|---|---|
| Department of the Air Force Materiel Command | 6 |
| Space Development Agency | 1 |
Other files
| File | Type | Posted |
|---|---|---|
| AF_STTR_24B_v3.pdf |
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
SF24B-T007: Finding Guaranteed RL Control for Satellite Systems
PROJECTED CMMC LEVEL REQUIREMENT:
N/A
TECHNOLOGY AREAS:
Space Platforms
MODERNIZATION PRIORITIES:
Space Technology | Trusted AI and Autonomy
KEYWORDS:
Reinforcement learning; nonlinear controls; optimization; satellite control; autonomy
ADDITIONAL INFORMATION
N/A
OBJECTIVE:
The focus of this topic is to discover and design machine learning or reinforcement learning architectures for use within a satellite control context which are capable of providing guaranteed closed-loop behavior in a nonlinear controls context.
ITAR:
The technology within this topic is restricted under the International Traffic in Arms Regulation (ITAR), 22 CFR Parts 120-130, which controls the export and import of defense-related material and services, including export of sensitive technical data, or the Export Administration Regulation (EAR), 15 CFR Parts 730-774, which controls dual use items. Offerors must disclose any proposed use of foreign nationals (FNs), their country(ies) of origin, the type of visa or work permit possessed, and the statement of work (SOW) tasks intended for accomplishment by the FN(s) in accordance with section 3.5 of the Announcement. Offerors are advised foreign nationals proposed to perform on this topic may be restricted due to the technical data under US Export Control Laws.
DESCRIPTION:
Machine or reinforcement learning techniques have proven their usefulness in creating control schemes that can handle complicated inputs and maneuver vehicles as intended. One of the fundamental drawbacks of these controllers is how quickly their capabilities have grown in comparison to the theoretical guarantees normally required to ensure their safety. At the moment, machine learning-based controllers are rapidly being adopted despite the lack of guaranteed safety. The future of satellite autonomy may involve these types of controllers, but these controllers must be shown to be safe for flight with guaranteed closed-loop behavior if they are to be implemented in space. This topic aims to discover whether certain control structures, activation functions, and training results for machine/reinforcement learning controllers exist that can provide formal guarantees for a satellite's behavior and, if so, what they may be.
PHASE I:
Awardee(s) will conduct a comprehensive review of current research in machine/reinforcement learning techniques and architectures capable of providing performance guarantees within a control context. Awardee(s) will investigate and compile the possible requirements for a satellite controller as well as the necessary theorems needed to demonstrate guaranteed behavior. Awardee(s) will devise a test plan capable of demonstrating the use of the control systems using machine/reinforcement learning techniques and allowing the comparison of them between theory and practice.
PHASE II:
Awardee(s) will design the theorems and control structures that illustrate what type of machine learning-based models and training approaches can be shown to provide provable stability guarantees under certain conditions.
Implement these control systems on multiple vehicles, including a representative satellite, showcasing the adherence of these controllers to their theoretical guarantees.
PHASE III DUAL USE APPLICATIONS:
In cooperative efforts with one or more satellite software manufacturers and military satellite system developers, awardee(s) should expect to integrate the proposed control algorithms with satellite software. Awardee(s) should expect to demonstrate the control system performance with it running on board a satellite. Awardee(s) should expect to evaluate transition opportunities for utilization in approved Government civilian applications.
REFERENCES:
* 1. *Reference 1.RL uncertainty characterization still relies on statistical estimation: Clements, William R., et al. "Estimating risk and uncertainty in deep reinforcement learning." arXiv preprint arXiv:1905.09638 (2019)
1.
* 2. *Reference 2. Trained RL agents still suffer from brittleness and data issues: Lockwood, Owen, and Mei Si. "A Review of Uncertainty for Deep Reinforcement Learning." Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. Vol. 18. No. 1. 2022
2.
* 3. *Reference 3. State of the art guarantees still exist at most only for linear models: Z. Marvi and B.
Kiumarsi, "Reinforcement Learning With Safety and Stability Guarantees During Exploration For Linear Systems," in IEEE Open Journal of Control Systems, vol. 1, pp. 322-334, 2022, doi:
10.1109/OJCSYS.2022.3209945.
3.
TECHNICAL POINT OF CONTACT (TPOC):
None
File details come from the government source that posted it. Updated .