Collaborative research: an audiotactile data system for blind or low vision faculty, staff, postdocs, and graduate students in chemistry, math, computer and information sciences

This federal Project Grant award from the National Science Foundation (NSF) under the STEM Education (CFDA 47.076) program is funding the development and testing of software and hardware tools to enable faculty, staff, postdoctoral research fellows, and graduate students who are blind or have low vision to generate, identify, and manipulate digital data patterns and trends in the fields of chemistry, math, computer and information sciences.

The $741,159 award to Newhaptics Corp and the University of Illinois at Urbana-Champaign focuses on three key objectives: 1) developing new hardware interaction components and firmware/drivers, 2) developing new interaction software, and 3) evaluating the system and conducting user workshops. This research aims to break down barriers to data use for the blind and low vision STEM community by incorporating spatial information through multiline Braille and large array tactile graphics hardware, along with interactive software tools. The award period runs from August 1, 2024 to July 31, 2028.

Abstract

Researchers at newhaptics corporation and the university of illinois at urbana-champaign are developing and testing software and hardware tools for faculty, staff, postdoctoral research fellows, and graduate students who are blind or have low vision, and who are working in college and university chemistry, mathematics, and computer science and engineering and information sciences employment settings. These tools, which use a combination of hearing and touch technologies, are making IT possible for people who are blind or have low vision to generate, identify, and manipulate digital data patterns and trends. Given the scarcity of stem scientists, researchers, and educators in our country, opportunities to increase knowledge about better data use technologies is essential to the retention and advancement of students and professionals who are blind or have low vision. The research being conducted aims to: 1) develop new hardware interaction components and firmware/drivers; 2) develop new interaction software, and 3) evaluate the system and conduct workshops for users. The project activities are addressing the following key research questions: 1) how can the addition of spatial information, realized through multiline braille and large array tactile graphics hardware, coupled with interactive software tools, break down barriers to data use? 2) what design considerations contribute to multi-modal data, that is, verbal, sonification, and tactile data representations that go beyond a single perceptual modality? Answers to these questions have the potential to contribute to research about stem postsecondary workplace solutions for people with disabilities. This award has been made in response to the NSF solicitation ?workplace equity for persons with disabilities in stem and stem education? (NSF 23-593). The project is funded by the division of equity for excellence in stem?s alliances for graduate education and the professoriate program. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the foundation's intellectual merit and broader impacts review criteria.- subawards are not planned for this award.