Project Grant F32EY038561

MECHANISMS OF GLOBAL VISUAL STABILITY ACROSS EYE MOVEMENTS - PROJECT SUMMARY CURRENT SCIENTIFIC UNDERSTANDING OF VISUAL PROCESSING RELIES PRIMARILY ON EXPERIMENTS THAT ASSUME PASSIVE VISION: AN OBSERVER FIXATES THEIR GAZE, AND AN EXPERIMENTER CONTROLS WHAT IS PERCEIVED. HOWEVER, NATURAL VISION IS BUILT UP ACROSS FREQUENT BUT DISCRETE EYE MOVEMENTS (SACCADES) WHOSE DYNAMICS CONTROL THE CONTENTS OF PERCEPTION JUST AS MUCH AS STIMULUS MANIPULATIONS. SACCADES CONSTANTLY ALTER HOW WE VIEW THE 3D ARRANGEMENT OF EVERY SINGLE VISIBLE ELEMENT IN A SCENE YET, SURPRISINGLY, THE FLOW OF VISUAL EXPERIENCE IS DEVOID OF DISORIENTING JUMPS OR SPATIAL MISALIGNMENT. THIS INTRIGUING PHENOMENON, TRANS-SACCADIC STABILITY, IS A FORM OF CHANGE BLINDNESS, WHEREBY CHANGES TO SENSORY INPUT ARE NOT CONSCIOUSLY NOTICED. THE UBIQUITY OF SACCADES (2- 3 PER SECOND) SUGGESTS THAT THE PROCESSES GOVERNING TRANS-SACCADIC CHANGE DETECTION AND CHANGE BLINDNESS ARE FUNDAMENTAL TO NATURAL VISION. HOWEVER, DESPITE A WEALTH OF BEHAVIORAL WORK, LITTLE IS KNOWN ABOUT THEIR NEURAL MECHANISMS. THIS GAP IS WORRYING GIVEN GROWING EVIDENCE FOR CLINICAL DEFICITS IN PERCEIVING THE RELATIONAL STRUCTURE OF SCENE ELEMENTS, PARTICULARLY IN AMNESIC PATIENTS WITH DAMAGE TO THE MEDIAL TEMPORAL LOBE. THIS PROJECT AIMS TO CHARACTERIZE A PHYSIOLOGICAL SYSTEM FOR VISUAL CHANGE DETECTION, GOVERNED BY SACCADE DYNAMICS, THAT EXPLAINS BOTH TRANS-SACCADIC STABILITY AND THESE CURRENTLY UNEXPLAINED VISUOSPATIAL PERCEPTUAL ABNORMALITIES IN NEUROLOGICAL CONDITIONS. DETECTING OR IGNORING VISUAL CHANGES REQUIRES COMPARING SENSORY INPUT TO A MEMORY BUFFER OF RECENT VISUAL EXPERIENCE. THIS PROPOSAL INTRODUCES A NEW APPROACH TO TRANS-SACCADIC STABILITY THAT FOCUSES ON DETECTING CHANGES OF GLOBAL SPATIAL STRUCTURE-THE 3D ARRANGEMENT OF ALL SCENE LANDMARKS AND OBJECTS. NAMELY, IT IS UNCLEAR A) HOW SACCADES CONFIGURE MEMORY BUFFERS OF GLOBAL STRUCTURE, B) WHAT NEURAL MECHANISMS UNDERLIE GLOBAL CHANGE DETECTION, AND C) WHETHER THESE MECHANISMS DIFFER FROM THOSE FOR DETECTING CHANGES TO INDIVIDUAL OBJECT FEATURES. WE HYPOTHESIZE THAT EYE MOVEMENTS DIFFERENTLY CONTROL TWO SPATIOTEMPORALLY DISTINCT NEURAL SYSTEMS FOR LOCAL (INDIVIDUAL OBJECTS) AND GLOBAL (SPATIAL STRUCTURE) CHANGE DETECTION. TO TEST THIS, WE WILL MEASURE EYE MOVEMENTS, GAZE POSITION, AND WHOLE-BRAIN NEURAL ACTIVITY WHILE HUMAN PARTICIPANTS FREELY VIEW IMAGES OF NATURAL SCENES AND REPORT WHEN THEY NOTICE STIMULUS CHANGES. WE WILL BUILD COMPUTATIONAL MODELS OF HOW EYE MOVEMENTS INFLUENCE CHANGE DETECTION (AIM 1) AND CHARACTERIZE THE NEURAL REPRESENTATIONAL MECHANISMS OF GLOBAL AND LOCAL CHANGE DETECTION (AIMS 2 AND 3). THIS WORK WILL CONTRIBUTE TO OUR UNDERSTANDING OF NATURAL VISION AND GIVE INSIGHT INTO CLINICAL DEFICITS IN GAZE CONTROL AND VISUAL PERCEPTION, PROVIDING TARGETS FOR NOVEL OCULOMOTOR THERAPIES OR NEUROSTIMULATION TREATMENTS. THE FELLOWSHIP PLAN FEATURES TRAINING IN ADVANCED COMPUTATIONAL MODELING AND FMRI-MEG REPRESENTATIONAL ANALYSES NEW TO THE CANDIDATE, NATURALISTIC EXPERIMENT DESIGN, STRUCTURED PROFESSIONAL DEVELOPMENT AND TEACHING WORKSHOPS, AND INTELLECTUAL INPUT FROM A COLLABORATIVE, INTERDISCIPLINARY COMMUNITY ACROSS NYU.