Next-generation expressive personalized voices for speech-generating devices
Ended Project Grant Awarded Last action
- Award ID
- R41DC020693
- Recipient
-
Synfonica LLC UEI LJ91KA3XA2D5
- Awarding agency
-
National Institute on Deafness and Other Communincation Disorders
National Institutes of Health, Department of Health and Human Services
- Obligated
- $551,504
Award facts
- Assistance listing
- 93.173 Research Related to Deafness and Communication Disorders
- Completion date
- Originally
- Place of performance
- New York, USA
Award details come from USAspending.gov.
Description
- Abstract
- The creation of personalized synthetic voices has wide application in medical/rehabilitation settings for PA- tients who rely on a speech-generating device (SGD) for communication. One common application is voice banking, wherein a person who risks losing their voice, such as somebody with a neurodegenerative disease like amyotrophic lateral sclerosis (ALS), records their own speech before the onset of disease-related dysar- thria for later use in an SGD that mimics their natural speech characteristics. While the technology underlying the creation of such personalized synthetic voices is growing in maturity and adoption by SGD users, IT still SUF- fers from two primary limitations: a lack of expressiveness and a burdensome amount of recording needed to create highly natural-sounding voices. The proposed project aims to remedy this situation by marrying the MA- chine-learning technology behind modeltalker, a pioneering voice-banking text-to-speech service developed at nemours children's health, with the knowledge-based technology underlying synfony, a rule-based text-to- speech system developed by synfonica LLC, which is capable of generating a variety of speech styles and EX- pressive modes. The expert knowledge built into synfonica will be used to design an optimal set of sentences for voice bankers to record, and its algorithms for the generation of natural-sounding prosody in different modes and styles will be integrated into modeltalker's machine-learning algorithms, creating a hybrid system that embraces the best qualities of both approaches. The new text-to-speech (TTS) system resulting from this project will (a) require a minimal amount of recorded speech from the voice banker, (b) accurately capture their vocal identity, and (c) be structured such that new expressive modes and speech styles can be added easily without additional recording. The feasibility of the project will be demonstrated by recording the voices of an adult male, an adult female, and a child, and generating TTS voices that can speak in three expressive modes (neutral, happy, and SAD). Perceptual experiments will be run to evaluate their intelligibility, naturalness, SUC- cess in capturing the vocal identity of the speaker, and the appropriateness of their expressive modes. In GEN- eral, the project will be a major step forward in enabling the users of personalized synthetic voices to express their emotions and intentions.
Transactions
| Action | Obligated | Date |
|---|---|---|
| Amendment | $0 | |
| Amendment | $0 | |
| Amendment | $0 | |
| Amendment | $275,752 | |
| Original award | $275,752 |
Quick answers
Who received award R41DC020693?
R41DC020693 was awarded to Synfonica LLC by National Institute on Deafness and Other Communincation Disorders (National Institutes of Health) on August 15, 2022.
How much is award R41DC020693 worth?
$551,504 has been obligated on R41DC020693.
On GovTribe
See this award's full record
- Every transaction and subaward
- The recipient's other awards and teaming partners
- Similar grant awards
- Ask GovTribe AI about this award