Project Grant 2237538
- This federal Project Grant award of $200,000 from the National Science Foundation's Engineering program (CFDA 47.041) aims to enhance the reliability and robustness of snapshot compressive imaging (SCI) systems. The primary objective is to develop a versatile bilevel optimization framework to study uncertainties in hybrid models that combine physical optics and deep learning algorithms for SCI. The research focuses on modeling mask, weight, and data uncertainties to establish the computational...
- This Project Grant award, valued at $400,000, was provided by the National Science Foundation (NSF) under its Computer and Information Science and Engineering (CISE) program (CFDA 47.070). The award supports the development of innovative "snapshot computational imaging" systems that leverage recent advances in metaoptics, or optical devices using sub-wavelength nano-structures, to capture multidimensional information about light interactions with the world. The key objectives of this...
- This $162,510 Project Grant awarded by the National Science Foundation (NSF) Division of Mathematical Sciences will fund collaborative research at Tufts University to develop innovative, memory-efficient algorithms for high-dimensional imaging applications such as medical imaging, object inspection, and video surveillance. The key products will be accelerated reconstruction and compression techniques that can process large volumes of multi-dimensional imaging data in real-time while using...
- This Project Grant award from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) totaling $539,998 will fund the development of an integrated framework to enable high-performance, energy-efficient learning-based super resolution (SR) technology. The key innovations of this 3-year project (July 1, 2025 - June 30, 2028) include: Extracting computer graphics (CG) information from GPU architecture during low-resolution rendering...
- This $162,490 federal Project Grant awarded by the National Science Foundation's (NSF) Division of Mathematical Sciences will fund collaborative research at Virginia Polytechnic Institute & State University (Virginia Tech) to develop advanced, memory-efficient algorithms and solvers for high-dimensional imaging applications such as medical imaging and video compression. The project aims to achieve significant improvements over existing state-of-the-art methods by leveraging data properties...
- This $600,000 Project Grant award from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) supports research at the University of California, San Diego (UCSD) to develop theoretical frameworks and computational methods for reconstructing complex 3D shapes using neural implicit representations. The key objectives are to enable the reconstruction of 3D shapes with intricate topologies, such as objects with holes, and to allow...
- This $558,594 Project Grant was awarded by the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) Federal Grant Program. The grant supports research at the University of South Florida (USF) to develop new mathematical tools and a unified framework for studying the fundamental limits of computational imaging systems. The project aims to tackle deficiencies in existing techniques for analyzing the performance and jointly optimizing the...
- The National Science Foundation (NSF) awarded a $300,000 Project Grant to Arizona State University under the Computer and Information Science and Engineering (CISE) program (CFDA 47.070) on January 1, 2024. The grant supports a 3-year collaborative research project to develop novel hardware platforms and algorithms for fusing optical and ultrasonic sensors to enhance computer vision and computational imaging capabilities. The key products and services to be delivered include: New rendering...
- This Project Grant award of $600,000.00 from the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) program supports research on a new class of "weak 3D cameras" that can efficiently capture simplified geometric representations of environments for real-time applications. The project aims to develop compact, low-power 3D vision systems that can reliably operate in challenging real-world conditions, leveraging new geometric...
- This four-year, $400,000 project grant from the National Science Foundation's Computer and Information Science and Engineering program aims to develop new techniques for 3D scene understanding. Specifically, the Stanford University researchers will explore implicit neural representations to model scene structure and details from raw images and videos. They will integrate findings into course development and partner with organizations to teach artificial intelligence, computer vision, and...
CAREER: THEORETICAL FRAMEWORK FOR DESIGN AND ANALYSIS OF SNAPSHOT COMPRESSIVE IMAGING SYSTEMS -CAPTURING HIGH-RESOLUTION 3D DATA CUBES, SUCH AS VIDEO FILES OR HYPERSPECTRAL IMAGES, IS A KEY REQUIREMENT IN MANY MODERN APPLICATIONS, RANGING FROM MEDICINE TO ROBOTICS. HOWEVER, SINCE SENSOR ARRAYS CAN TYPICALLY ACQUIRE ONLY 2D IMAGES, CAPTURING SUCH DATA CUBES OFTEN REQUIRES SCANNING ALONG THE THIRD DIMENSION, WHICH MAKES THE PROCESS TIME-CONSUMING, COSTLY, AND INEFFECTIVE. ONE EMERGING SOLUTION TO ADDRESS THIS CHALLENGE AND ENABLE EFFICIENT 3D IMAGING IS THE SO-CALLED SNAPSHOT COMPRESSIVE IMAGING (SCI). IN SCI SOLUTIONS, THE DATA-ACQUISITION HARDWARE IS DESIGNED TO CAPTURE AN ENCODED 2D IMAGE THAT SUMMARIZES THE FULL INFORMATION CONTAINED IN THE 3D DATA CUBE. THE DESIRED 3D DATA CUBE IS LATER RECONSTRUCTED FROM A SINGLE 2D PROJECTION USING COMPLEX COMPUTATIONAL DECODING ALGORITHMS. MOST THEORETICAL AND ALGORITHMIC QUESTIONS RELATED TO SUCH DECODING PROBLEMS ARE STILL WIDELY OPEN. IN THE ABSENCE OF A SOLID THEORETICAL UNDERSTANDING OF THE PROBLEM, EXISTING SOLUTIONS ARE GENERALLY HEURISTIC METHODS THAT ARE COMPUTATIONALLY VERY INTENSIVE, INEFFICIENT, AND SUB-OPTIMAL. THE GOAL OF THIS PROJECT IS TO ENABLE COST-EFFECTIVE, RELIABLE, AND EFFICIENT SCI IMAGING BY ADDRESSING THE RELATED FUNDAMENTAL QUESTIONS. SUCH SOLUTIONS CAN IMPACT A WIDE RANGE OF APPLICATIONS, FROM MEDICAL DIAGNOSIS TO ROBOTICS TO AGRICULTURE. TO DEVELOP FULLY PRACTICAL AND ROBUST SCI SOLUTIONS APPLICABLE IN A WIDE RANGE OF APPLICATIONS, A NOVEL THEORETICAL FRAMEWORK IS REQUIRED THAT ENABLES RESEARCHERS TO DESIGN AND OPTIMIZE I) THE 3D TO 2D PROJECTION STEP SUBJECT TO THE HARDWARE CONSTRAINTS OF THE SYSTEM, AND II) COMPUTATIONALLY EFFICIENT RECOVERY ALGORITHMS THAT CAN REPRODUCE A HIGH-QUALITY 3D DATA CUBE FROM A SINGLE 2D MEASUREMENT. THE MAIN GOAL OF THIS PROPOSAL IS TO PROVIDE SUCH A THEORETICAL PLATFORM THAT ENABLES RESEARCHERS TO DESIGN, ANALYZE, AND OPTIMIZE SCI SYSTEMS. TO ACHIEVE THIS GOAL, THE TEAM OF RESEARCHERS AIM AT I) CHARACTERIZING THE FUNDAMENTAL TRADE-OFFS BETWEEN THE PARAMETERS OF SCI SYSTEMS, SUCH AS PROJECTION MAPPING, 3D DATA-CUBE STRUCTURE, AND ACHIEVABLE RECONSTRUCTION QUALITY AND RESOLUTION; II) DEVELOPING AN AUTOMATED, THEORETICALLY-FOUNDED, AND EFFICIENT APPROACH TO STRUCTURE LEARNING THAT IS APPLICABLE TO VARIOUS TYPES OF 3D DATA CUBES ENCOUNTERED IN SCI APPLICATIONS; AND III) DESIGNING DISRUPTIVE SCI SOLUTIONS THAT INCORPORATE THE DEVELOPED AUTOMATED STRUCTURE-LEARNING METHOD INTO AN EFFICIENT NEAR-OPTIMAL SCI RECOVERY ALGORITHM THAT PERFORMS CLOSE TO THE CHARACTERIZED FUNDAMENTAL LIMITS. THIS AWARD REFLECTS NSF'S STATUTORY MISSION AND HAS BEEN DEEMED WORTHY OF SUPPORT THROUGH EVALUATION USING THE FOUNDATION'S INTELLECTUAL MERIT AND BROADER IMPACTS REVIEW CRITERIA.
Mod # | Description | ReasonForModification | Federal Obligation | Date |
|---|---|---|---|---|
| Not listed | $75.7k | 9/15/25 | ||
| Not listed | $112.7k | 7/9/25 | ||
| Not listed | $213.4k | 1/19/23 |