NSF convergence accelerator track h: phase II smart wearables for expanding workplace access for people with blindness and low vision
Active Cooperative Agreement Awarded Last action
- Award ID
- 2345139
- Recipient
-
New York University UEI M5SZJ6VHUHN8
- Awarding agency
-
National Science Foundation
- Obligated
- $5,000,000
Award facts
- Assistance listing
- 47.084 NSF Technology, Innovation, and Partnerships
- Completion date 96% complete
- Place of performance
- New York, NY 10016, USA
Award details come from USAspending.gov.
Description
- Abstract
- There are 285 million people with blindness and low vision (pblv) worldwide. One dramatic correlate of vision loss is unemployment, with rates as high as 81% in urban environments. Employment disparities stem, in large part, from difficulties with transportation to and from work and wayfinding within the workplace itself. This project takes a fundamental step in addressing the employment challenges of pblv through a powerful assistive-navigation platform, the visually impaired smart service system for spatial intelligence and onboard navigation (VIS4ION). VIS4ION is a discreet, instrumented backpack with an array of miniaturized sensors integrated into straps that connect to an embedded system for computational analysis. Real-time audio and tactile feedback are provided through a binaural bone conduction headset and an optional reconfigured waist strap turned haptic interface. A prototype platform, partly developed through the phase 1 convergence accelerator grant, provides valuable microservices for pblv, including real-time navigation, scene understanding, and obstacle avoidance, all of which could transform workplace experiences for pblv. This translational phase 2 project broadly seeks to bring the current VIS4ION prototype to a commercial system for impact in real complex workplace environments. The work will leverage new developments in conversational AI, machine vision, networking, and haptics, along with extensive trials with users. To realize the goals for this multi-faceted project, a transdisciplinary team has been assembled that spans technology development, engineering, translational medicine, and business management, supported by partners in private industry (google, at & t, and qualcomm), non-profits for pblv (lighthouse guild and visions), and government agencies for transport and disabilities (MTA, DOT, and NYC office for persons with disabilities). This translational project will be executed in four inter-connected tasks: (1) boosting independent AI-based microservices for smart wearables with a specific focus on a navigation pipeline that supports indoor and outdoor journeys, with zero infrastructural requirements; (b) enhancing coordinated microservices through custom AI ensembles and conversational AI; (c) building network connectivity resilience through unique video rate-adaptation algorithms; and (d) executing extensive system usability testing in transit hubs, hospitals, and workplaces. Beyond the envisioned impact on medicine, science, engineering, and improving the lives of pblv, this program will foster formal and informal learning opportunities for graduate, undergraduate, medical, and high school students in clinical and fundamental stem/steam research. These training opportunities will foster multi-pronged and multi-disciplinary team approaches critical to the development of innovative solutions for complex real-world problems. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the foundation's intellectual merit and broader impacts review criteria.- subawards are planned for this award.
Transactions
| Action | Obligated | Date |
|---|---|---|
| Amendment | $1,000,000 | |
| Amendment | $2,000,000 | |
| Original award | $2,000,000 |
Subawards
| Subrecipient | Amount | Awarded |
|---|---|---|
| The Trustees Of Columbia University In The City Of New York | $236,478 | |
| Lighthouse Guild International, Inc. | $200,476 |
Quick answers
Who received award 2345139?
2345139 was awarded to New York University by National Science Foundation on December 15, 2023.
How much is award 2345139 worth?
$5,000,000 has been obligated on 2345139.
On GovTribe
See this award's full record
- Every transaction and subaward
- The recipient's other awards and teaming partners
- Similar grant awards
- Ask GovTribe AI about this award