This project investigates how to use new touch technologies, like touchscreens, to create graphics and simulations that can be felt, heard, and seen. Using readily available, low-cost systems, the principal investigator will investigate how to map visual information to touch and sound for students with visual impairments.
This project lays the foundation and framework for enabling digital, multimodal tactile graphics on touchscreens for individuals with visual impairments (VI). Given the low-cost, portability, and wide availability of touchscreens, this work promotes the use of vibrations and sounds on these readily available platforms for addressing the graphical access challenge for individuals with VI. An open-source vibration library has been created and fundamental perceptual building blocks (e.g.\ shapes, lines, critical points, line width and gaps, etc.) guiding how basic graphical components should be rendered on these platforms is being disseminated.