Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


Sensory substitution has been a research subject for decades, and yet its applicability outside of the research is very limited. Thus creating scepticism among researchers that a full sensory substitution is not even possible [8]. In this paper, we do not substitute the entire perceptual channel. Instead, we follow a different approach which reduces the captured information drastically. We present concepts and implementation of two mobile applications which capture the user's environment, describe it in the form of text and then convey its textual description to the user through a vibrotactile wearable display. The applications target users with hearing and vision impairments.
Original languageEnglish
Title of host publicationProceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers
Number of pages4
ISBN (Electronic)978-1-4503-5966-5
Publication statusPublished - 2018


  • haptic interfaces
  • skin reading
  • vibrotactile display
  • wearable display
  • wearables
  • accessible technology
  • accessibility


Dive into the research topics of 'Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution'. Together they form a unique fingerprint.

Cite this