Toucha11y: Making Inaccessible Public Touchscreens Accessible
Despite their growing popularity, many public kiosks with touchscreens are inaccessible to blind people. Toucha11y is a working prototype that allows blind users to use existing inaccessible touchscreen kiosks independently and with little effort. Toucha11y consists of a mechanical bot that can be instrumented to an arbitrary touchscreen kiosk by a blind user and a companion app on their smartphone. The bot, once attached to a touchscreen, will recognize its content, retrieve the corresponding information from a database, and render it on the user's smartphone. As a result, a blind person can use the smartphone's built-in accessibility features to access content and make selections. The mechanical bot will detect and activate the corresponding touchscreen interface. We present the system design of Toucha11y along with a series of technical evaluations. Through a user study, we found out that Toucha11y could help blind users operate inaccessible touchscreen devices.
Created by:
Jiasheng Li, Zeyu Yan, Arush Shah, Jonathan Lazar, Huaishu Peng
Awards:
CHI 2023 Honorable Mentions Award
Publications:
News:
![toucha11y](/assets/images/toucha11y/1-intro.png)
![toucha11y](/assets/images/toucha11y/3-system_diagram.png)
![toucha11y](/assets/images/toucha11y/6-phoneInterface.jpg)
![toucha11y](/assets/images/toucha11y/7-sift_flann.png)
![toucha11y](/assets/images/toucha11y/8-interface_example.png)
![toucha11y](/assets/images/toucha11y/11-test_set_up.png)
![toucha11y](/assets/images/toucha11y/15-new_base.png)
![toucha11y](/assets/images/toucha11y/4-assembly-new_rerendered.png)
![toucha11y](/assets/images/toucha11y/5-robot.jpg)
![toucha11y](/assets/images/toucha11y/9-location_detection.png)
![toucha11y](/assets/images/toucha11y/13-process.png)
![toucha11y](/assets/images/toucha11y/12-userStudy.jpg)
![toucha11y](/assets/images/toucha11y/14-study_result.png)