Sbir phase i: smartphone-based machine learning and computer vision for cost-effective verification of forest carbon offsets

This $256,000 National Science Foundation Project Grant supports the development of a smartphone application by Earthshot Labs PBC to facilitate forest carbon offset verification. Leveraging computer vision and augmented reality capabilities, the app aims to make tree measurements for ecological modeling and forecasting dramatically easier compared to traditional tape measures. It is expected to classify tree species through bark and leaf imagery analysis while also determining diameter at breast height through distance and orientation calculations between the phone and trunk. Funding will support data collection in Panama and Brazil to advance species identification algorithms as well as scope expansion to additional regions and biodiversity indicators over time. This award from the NSF Technology, Innovation, and Partnerships program seeks to advance breakthrough technologies and solutions to national challenges through science and engineering innovation.

Abstract

The broader impact of this sbir phase i project is to make the gathering of tree measurements and other field-based nature observations dramatically easier. The project involves building a mobile APP that uses computer vision and augmented reality to make measuring trees much easier than using the tape measures of today, in fact IT will be as simple as scanning a barcode. This will result in much more nature imagery and other training data for use with ecological models, which will yield a better understanding of how ecosystems will change in the coming years. One important prediction this project will help with is forest growth which is very useful for generating carbon offsets that can finance the regeneration of large amounts of land. Better ecological models can also help communities prepare for changes in climate, sea level, soil quality and other ecological shifts in the coming decades. Millions of people will be potentially affected by climate change and its accompanying shifts in ecosystems, so arming communities and governments with better insights about these impacts will be critical. Furthermore, catalyzing many millions of hectares of nature regeneration projects will help mitigate the worst effects of climate change and other ecological challenges. This project involves the unique combination of computer vision with augmented reality in order to quickly and accurately measure trees. There are multiple computer vision neural networks being developed for the APP. One of them uses bark and tree imagery in order to classify the tree species, an important feature needed for ecological models. Another model analyzes surrounding scenery and quickly identifies the closest tree trunk. The APP then uses the phone?s augmented reality capabilities to gauge the distance and orientation of the phone from the trunk and combines these two to yield a diameter at breast height measurement. The research plan involves collecting data from specific regions in panama and brazil in conjunction with active nature restoration projects and gathering a critical mass of leaf and bark imagery so that species in those areas can be classified accurately. The scope will then increase to additional regions and later, measurements such as birdsong and other biodiversity markers. Over time the APP could become a platform for many such nature observations, and IT is expected to evolve to become more game-like to attract large numbers of people having fun experiences together and advancing the cause of nature science. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the foundation's intellectual merit and broader impacts review criteria.