Communicating multimodal wayfinding messages for visually impaired people via wearables

Joey van der Bie, Somaya Ben Allouch, Christina Jaschinski

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

2 Citations (Scopus)
33 Downloads (Pure)

Abstract

People with a visual impairment (PVI) often experience difficulties with wayfinding. Current navigation applications have limited communication channels and do not provide detailed enough information to support PVI. By transmitting wayfinding information via multimodal channels and combining these with wearables, we can provide tailored information for wayfinding and reduce the cognitive load. This study presents a framework for multimodal wayfinding communication via smartwatch. The framework consists of four modalities: audio, voice, tactile and visual. Audio and voice messages are transmitted using a bone conduction headphone, keeping the ears free to focus on the environment. With a smartwatch vibrations are directed to a sensitive part of the body (i.e., the wrist), making it easier to sense the vibrations. Icons and short textual feedback are viewed on the display of the watch, allowing for hands-free navigation.
Original languageEnglish
Title of host publicationMobileHCI '19
Subtitle of host publicationproceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
Place of PublicationNew YorkNYUnited States
PublisherAssociation for Computing Machinery
Pages1-7
ISBN (Print)9781450368254
DOIs
Publication statusPublished - 1 Oct 2019
EventMobileHCI '19 21st International Conference on Human-Computer Interaction with Mobile Devices and Services: Bridging mobile across the world - Taipei International Convention Center, Taipei, Taiwan, Province of China
Duration: 1 Oct 20194 Oct 2019
Conference number: 21
https://dl.acm.org/citation.cfm?id=3338286

Publication series

NameProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
PublisherACM

Conference

ConferenceMobileHCI '19 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
Abbreviated titleMobileHCI'19
CountryTaiwan, Province of China
CityTaipei
Period1/10/194/10/19
Internet address

Fingerprint Dive into the research topics of 'Communicating multimodal wayfinding messages for visually impaired people via wearables'. Together they form a unique fingerprint.

Cite this