Efri braid: scalable-learning neuromorphics

Active Project Grant Awarded Last action

Award ID
2318152
Recipient
Awarding agency
Obligated
$1,999,968

Award facts

Assistance listing
47.041 Engineering
Completion date 79% complete
Place of performance
Santa Barbara, CA 93106, USA

Award details come from USAspending.gov.

Description

Abstract
Recent advances in the field of artificial intelligence suggest that the route toward higher-intelligence brain-inspired systems is via significantly increasing network size. However, such a rather evolutionary approach faces dire challenges. Training the largest machine learning models for natural language processing requires months of data-center-scale computations, in other words, enormous energy, time, and cost. Reserves for improvements, e.g., due to the refinement of algorithms and hardware, seem limited, and most importantly, further advances could no longer be fueled by semiconductor technology scaling. Additionally, state-of-the-art models rely on offline training with vast amount of training data, i.e., are not capable of continual real-time learning. Such challenges naturally bring more attention to the biological neural networks, which are living proof of superior, agile, and adaptive intelligence running on very energy-efficient ?brain? Hardware. Exciting opportunities are presented by recent developments in the theory of spiking neural networks, the most biologically plausible models, and neuromorphic circuits implemented with dense emerging memory devices. The proposed project aims to capitalize on these advances and address the most pressing challenges to develop scalable algorithms and hardware for human-brain-scale neuromorphic systems with practically useful (robust, fast, inexpensive) learning capabilities. The project will enable neuromorphic systems of immediate importance for many practical applications, including autonomous robots and vehicles, and biomedicine, including portable and personal medical devices. Furthermore, the broad algorithm-to-system nature of the proposed research provides attractive opportunities for high-school, undergraduate, and graduate students to explore novel research and get exposed to the emerging field of neuromorphic computing. The proposed project will pursue outreach activities by leveraging programs at participating universities, with a particular focus on attracting minority students. The key features of our research are hardware-friendly local learning algorithms, a framework for continual online ?one-shot? Learning, and variation-tolerant in-memory computing hardware circuits. Specifically, on the algorithmic front, we focus on recurrent spiking neural networks with biologically-plausible spike frequency adaptation neurons. We will build on local learning algorithms recently proposed by our team members that facilitate learning over longer time scales via synaptic plasticity. These algorithms will be further extended to support continual learning and CO-optimized with the hardware using neural architecture search techniques. On the hardware front, the focus is on hybrid neuromorphic circuits that take advantage of analog in-memory computing. Critical hardware challenges, such as the scaling of network complexity and implementation of robust in-situ learning, will be addressed by utilizing ultra-high-density crosspoint devices implementing fixed-value weights of the learning algorithms and novel variation-tolerant memristive synapses featuring both short-term and long-term plasticity. Algorithms and hardware circuits will be holistically integrated into the learning-to-learn spiking neural network framework. Such a framework enables two kinds of learning ? A slow incremental one mimicking developmental learning and fast ?one-shot? Learning utilizing network dynamics. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the foundation's intellectual merit and broader impacts review criteria.

Transactions

Action Obligated Date
Amendment $0
Original award $1,999,968

Subawards

Subrecipient Amount Awarded
Technische Universitaet Graz Statement of Work Graz University of Technology Project: Scalable-Learning Neuromorphics To facilitate the development of neuromorhic electronics implementing… $103,475
Yale Univ Dr. Priya Panda will be responsible for overseeing the project, including reporting requirements, and supervising the graduate/undergraduate students.… $0
Yale Univ $67,816
New York University SCOPE OF WORK: CHKLOVSKII GROUP The Chklovskii group is developing a normative approach for deriving online algorithms implementable in neural networks using… $74,988
Technische Universitaet Graz Statement of work graz university of technology project: scalable-learning neuromorphics to facilitate the development of neuromorhic electronics implementing… $84,417
New York University SCOPE OF WORK: CHKLOVSKII GROUP The Chklovskii group is developing a normative approach for deriving online algorithms implementable in neural networks using… $74,997
Technische Universitaet Graz Statement of Work Graz University of Technology Project: Scalable-Learning Neuromorphics To facilitate the development of neuromorhic electronics implementing… $186,952

Quick answers

Who received award 2318152?

2318152 was awarded to University Of California, Santa Barbara by Office of Emerging Frontiers and Multidisciplinary Activities (National Science Foundation) on September 1, 2023.

How much is award 2318152 worth?

$1,999,968 has been obligated on 2318152.

Which agency awarded 2318152?

Office of Emerging Frontiers and Multidisciplinary Activities (National Science Foundation) awarded 2318152, with funding from National Science Foundation.

On GovTribe

See this award's full record

  • Every transaction and subaward
  • The recipient's other awards and teaming partners
  • Similar grant awards
  • Ask GovTribe AI about this award