Kasi: combining sound based AR & tactile pieces for accessible visual based stem communication - this phase i project expands the kasi learning system, which uses audio-based augmented reality (AR) of…

Kasi: combining sound based AR & tactile pieces for accessible visual based stem communication - this phase i project expands the kasi learning system, which uses audio-based augmented reality (AR) of physical manipulatives, for independent exploration of chemical diagrams with three-dimensional features. The goal of this project is to support blind/visually impaired (BVI) students in scientific disciplines from k-12, through college, and into employment. The objectives are to 1) develop the kasi system for use in college-level chemistry courses by creating a digital tool for drawing three-dimensional chemical representations, designing new tactile physical manipulatives, and implementing corresponding computer vision algorithms to assess and guide student learning and 2) validate the feasibility of the kasi system with BVI college science students using a mixed methods study. Project outcomes include 1) an independent method for BVI students to explore and construct chemical diagrams, 2) increased communication between BVI students and their instructors and their student peers, 3) more BVI students participating and succeeding in science courses that are the pre-requisite to employment in stem and medical fields, 4) publish findings of successful practices that support stem career advancement for BVI students. The product of this project is an audio-based augmented reality system that uses inexpensive physical manipulatives with web-based software and non-proprietary hardware (camera, magnetic whiteboard) for a scalable method of accessible and inclusive learning to help all students to succeed in stem careers.