Collaborative research: ideas lab: breaking low: end-to-end delivery technology for interactive multi-person XR rehabilitation activities

The National Science Foundation awarded the Regents of the University of Michigan a $845,500 cooperative agreement on October 1, 2025, under the NSF Technology, Innovation, and Partnerships program (CFDA 47.084) to develop end-to-end delivery technology for interactive multi-person extended reality (XR) rehabilitation activities.

The project develops immersive XR exercise environments enabling users to move and interact in three-dimensional space with each other and virtual elements, with clinicians able to guide and interact with patients remotely. The core technical contributions address motion-to-photon latency challenges in multi-user, geographically distributed XR by introducing adaptive XR applications with new delivery mechanisms, internet path selection leveraging testbed infrastructure, and programmable wireless resources using open radio access networks. The project prioritizes high-importance XR traffic delivery while intelligently managing lower-priority traffic, making rehabilitation experiences more enjoyable and effective by incorporating social interactions between remote users that boost engagement and skill acquisition.

Work is performed at the University of Michigan, Ann Arbor, Michigan, through September 30, 2027. The award funds sub-recipient pass-through to Nokia of America Corporation and iGYM LLC. Nokia develops a vertical-driven, mobility-aware, cross-sector collaborative framework integrating vehicle-to-network and vehicle-to-everything communication to address latency challenges in remote and cooperative driving scenarios. iGYM LLC develops innovative XR applications translating peripersonal space boundary interactions into immersive AR/VR experiences, integrating the Breaking Low XR networking technology into multiplayer games, and conducts preliminary beta testing with iGYM participants to assess feasibility and effectiveness.

Abstract

Extended reality (XR) technologies have shown significant promise in increasing user engagement and skill acquisition in a variety of domains. The goal of this project is to accelerate adoption of innovative XR applications for rehabilitation, for example, to enhance user experiences in treatments to improve motor function for diseases with motor disabilities. This project develops immersive XR exercise environments that enable users to move and interact in 3D space with each other and with virtual elements. A key goal is to make the experience of rehabilitation more enjoyable and effective by incorporating social interactions between remote users that can boost engagement and skill acquisition. The technology also allows clinicians to guide and interact with their patients remotely. To create a virtual environment that users experience as fast and seamless, this project develops novel approaches to the underlying networking infrastructure needed to run the application. Collaboration with industry partners will support technology adoption for XR-enabled rehabilitation technology and for the XR industry. Realizing multi-user, GEO-distributed XR technology is challenging due to stringent motion-to-photon latency requirements for good user experience. Current wide-area internet routing and cellular wireless management are one-size-fits-all across applications, hurting latency. A key insight of this project is that not all types of XR traffic require uniformly low latency; instead, the project enables prioritization of delivery of important XR traffic while intelligently managing lower-priority XR traffic. The project?s core technical contributions are an adaptive XR application with new delivery mechanisms, leveraging internet path selection on the testbed, and programmable wireless resources using open radio access networks (open ran) and xapps. Performance of the XR environment will be assessed via user experience and key network performance indicators. The expected outcome is achieving key performance targets currently deemed impossible on today?s internet by demonstrations of network-supported, multi-user XR technology for rehabilitation at different sites. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the foundation's intellectual merit and broader impacts review criteria.- subawards are planned for this award.