SF24B-T007.pdf

Standard Form PDF 49 KB Posted

Attached to
Finding Guaranteed RL Control for Satellite Systems
Solicitation number
SF24B-T007
Issued by

About this file

This document is a Small Business Technology Transfer (STTR) or Small Business Innovation Research (SBIR) solicitation topic for Phase I, II, and III development work.

The topic SF24B-T007 seeks to develop machine learning or reinforcement learning architectures for satellite control systems that can provide guaranteed closed-loop behavior in nonlinear control contexts. The objective addresses the critical gap between rapidly advancing machine learning capabilities and the theoretical guarantees required for safe space-based implementation. Phase I work requires awardees to conduct a comprehensive literature review of machine/reinforcement learning techniques capable of providing performance guarantees, investigate satellite controller requirements, compile necessary theorems for demonstrating guaranteed behavior, and devise a test plan comparing theoretical predictions to practical performance. Phase II requires awardees to design theorems and control structures demonstrating which machine learning models and training approaches can provide provable stability guarantees, then implement these systems on multiple vehicles including a representative satellite to validate adherence to theoretical guarantees. Phase III involves cooperative integration with satellite software manufacturers and military satellite system developers, on-board demonstration of control system performance, and evaluation of transition opportunities for civilian government applications. The technology is ITAR-restricted under 22 CFR Parts 120-130 and EAR-controlled under 15 CFR Parts 730-774, requiring disclosure of any proposed foreign nationals, their countries of origin, visa status, and intended tasks. The project is classified under Space Platforms technology area and aligns with Space Technology and Trusted AI and Autonomy modernization priorities. No CMMC level requirement applies, and no Technical Point of Contact is designated.

View the file

Other versions and copies of SF 24B

File Revision Posted Attached to
SF24B-T005.pdf Revision not stated Multiple Hypothesis Management
SF24B-T006.pdf Revision not stated Probabilistic 3D Outer Zone Radiation Belt Model
SF24B-T011.pdf Revision not stated Into the Wild-Transitioning Basic Rsh Algs to Ops
SF24B-T009.pdf Revision not stated Cultivating PWSA Innovations Through Collaboration
SF24B-T008.pdf Revision not stated Self-Regulating Heaters for Satellites
SF24B-T004.pdf Revision not stated Data-Centric AI in Multi Domain Awareness

Who attaches SF 24B

Other files

File Type Posted
AF_STTR_24B_v3.pdf PDF

On GovTribe

Work with this file

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

SF24B-T007: Finding Guaranteed RL Control for Satellite Systems

PROJECTED CMMC LEVEL REQUIREMENT:

N/A

TECHNOLOGY AREAS:

Space Platforms

MODERNIZATION PRIORITIES:

Space Technology | Trusted AI and Autonomy

KEYWORDS:

Reinforcement learning; nonlinear controls; optimization; satellite control; autonomy

ADDITIONAL INFORMATION

N/A

OBJECTIVE:

The focus of this topic is to discover and design machine learning or reinforcement learning architectures for use within a satellite control context which are capable of providing guaranteed closed-loop behavior in a nonlinear controls context.

ITAR:

The technology within this topic is restricted under the International Traffic in Arms Regulation (ITAR), 22 CFR Parts 120-130, which controls the export and import of defense-related material and services, including export of sensitive technical data, or the Export Administration Regulation (EAR), 15 CFR Parts 730-774, which controls dual use items. Offerors must disclose any proposed use of foreign nationals (FNs), their country(ies) of origin, the type of visa or work permit possessed, and the statement of work (SOW) tasks intended for accomplishment by the FN(s) in accordance with section 3.5 of the Announcement. Offerors are advised foreign nationals proposed to perform on this topic may be restricted due to the technical data under US Export Control Laws.

DESCRIPTION:

Machine or reinforcement learning techniques have proven their usefulness in creating control schemes that can handle complicated inputs and maneuver vehicles as intended. One of the fundamental drawbacks of these controllers is how quickly their capabilities have grown in comparison to the theoretical guarantees normally required to ensure their safety. At the moment, machine learning-based controllers are rapidly being adopted despite the lack of guaranteed safety. The future of satellite autonomy may involve these types of controllers, but these controllers must be shown to be safe for flight with guaranteed closed-loop behavior if they are to be implemented in space. This topic aims to discover whether certain control structures, activation functions, and training results for machine/reinforcement learning controllers exist that can provide formal guarantees for a satellite's behavior and, if so, what they may be.

PHASE I:

Awardee(s) will conduct a comprehensive review of current research in machine/reinforcement learning techniques and architectures capable of providing performance guarantees within a control context. Awardee(s) will investigate and compile the possible requirements for a satellite controller as well as the necessary theorems needed to demonstrate guaranteed behavior. Awardee(s) will devise a test plan capable of demonstrating the use of the control systems using machine/reinforcement learning techniques and allowing the comparison of them between theory and practice.

PHASE II:

Awardee(s) will design the theorems and control structures that illustrate what type of machine learning-based models and training approaches can be shown to provide provable stability guarantees under certain conditions.

Implement these control systems on multiple vehicles, including a representative satellite, showcasing the adherence of these controllers to their theoretical guarantees.

PHASE III DUAL USE APPLICATIONS:

In cooperative efforts with one or more satellite software manufacturers and military satellite system developers, awardee(s) should expect to integrate the proposed control algorithms with satellite software. Awardee(s) should expect to demonstrate the control system performance with it running on board a satellite. Awardee(s) should expect to evaluate transition opportunities for utilization in approved Government civilian applications.

REFERENCES:

* 1. *Reference 1.RL uncertainty characterization still relies on statistical estimation: Clements, William R., et al. "Estimating risk and uncertainty in deep reinforcement learning." arXiv preprint arXiv:1905.09638 (2019)

1.

* 2. *Reference 2. Trained RL agents still suffer from brittleness and data issues: Lockwood, Owen, and Mei Si. "A Review of Uncertainty for Deep Reinforcement Learning." Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. Vol. 18. No. 1. 2022

2.

* 3. *Reference 3. State of the art guarantees still exist at most only for linear models: Z. Marvi and B.

Kiumarsi, "Reinforcement Learning With Safety and Stability Guarantees During Exploration For Linear Systems," in IEEE Open Journal of Control Systems, vol. 1, pp. 322-334, 2022, doi:

10.1109/OJCSYS.2022.3209945.

3.

TECHNICAL POINT OF CONTACT (TPOC):

None

File details come from the government source that posted it. Updated .