Computational foundations of active visual sensing

Active Cooperative Agreement Awarded Last action

Award ID
UF1NS126566
Recipient
Awarding agency
Obligated
$9,562,720

Award facts

Completion date 93% complete
Originally
Place of performance
Palo Alto, CA 94305, USA

Award details come from USAspending.gov.

Description

Abstract
Vision is an active process: we move our head and eyes to explore the sensory world. This is particularly important in situations where a stationary view provides limited information, such as when looking for an object that is occluded or obscured, which is common in complex natural scenes. However, our understanding of active vision is limited due to experimental and theoretical challenges, including the difculty of studying vision in freely moving animals and the lack of formal theoretical frameworks that integrate visual representations with actions. In this team project, we will combine expertise in visual neuroscience, behavior, machine learning, and theory, to determine the behavioral, neural, and computational underpinnings of active sensing. Our approach is based on a new theoretical framework of bounded rational control (BRC), and a behavioral task in which mice perform an object recognition task in the presence of occlusion and image corruptions. To enable active sensing, stimuli in the task are rendered real-time in augmented reality based on the animal's viewpoint. In our RST aim, we will develop models of active sensing based on constrained visual representations in BRC. In the second aim, we measure behavioral performance (both correct/incorrect responses and full-body movements) during the task, and in the third aim we will measure neural activity across visual cortical areas during the task. For both aims 2 and 3, we will t our models to the corresponding behavioral and neural data, and then perform causal tests of our models by presenting novel stimuli predicted to elicit specic responses from the model. Together, these aims will provide a foundational understanding of active vision in the mouse that will support a subsequent U19 proposal taking advantage of genetic tools to investigate the underlying local and long-range neural circuits.

Transactions

Action Obligated Date
Amendment $0
Amendment $375,965
Amendment -$375,965
Amendment $0
Amendment $0
Amendment $0
Amendment $0
Amendment $0
Amendment $0
Amendment $1,976,763
Amendment -$1,976,763
Amendment $1,976,763
Amendment -$1,976,763
Amendment $1,976,763
Amendment -$1,976,763
Amendment $1,976,763
Amendment -$1,976,763
Amendment $1,976,763
Amendment -$1,976,763
Amendment $4,781,360
Original award $4,781,360
Show all 21

Subawards

Subrecipient Amount Awarded
Carnegie-Mellon University Computational foundations of active visual sensing $201,786
University Of Oregon $6,377
Ecole Polytechnique Federale De Lausanne, Epfl $198,230
University Of Oregon $272,999
Carnegie-Mellon University $151,800
William Marsh Rice University Agreement: $38,392 This subaward is a salary agreement for the period of 1/16/2024 to 8/31/2024 for Adrian Lankenau Ahumada, a Rice University SSPB PhD student.… $38,392

Quick answers

Who received award UF1NS126566?

UF1NS126566 was awarded to The Leland Stanford Junior University by National Institute of Neurological Disorders and Stroke (National Institutes of Health) on March 15, 2022.

How much is award UF1NS126566 worth?

$9,562,720 has been obligated on UF1NS126566.

On GovTribe

See this award's full record

  • Every transaction and subaward
  • The recipient's other awards and teaming partners
  • Similar grant awards
  • Ask GovTribe AI about this award