Sensory Substitution: Visual Information via Haptics

Jack Brooks*, Árni Kristjánsson, Runar Unnthorsson

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review


Sensory substitution devices compensate for the lack of one sense, such as vision, by conveying information about a person’s environment through the stimulation of another sense, like touch or audition. In this chapter, we introduce a newly developed sensory substitution device (SSD), the Sound of Vision (SOV) device, which acquires visual information via a 3D camera system and conveys it to people with visual impairments through touch and audition. We focus mainly on the haptic stimulation that the system uses, introducing the relevant research and hardware. We raise important design issues for producing functionally relevant sensory substitution, such as training on the SSD, which is vital for externalization and navigation with the SOV system. All-in-all, the SOV system is a highly promising candidate for a successful SSD and is innovative in its simultaneous use of both haptic and auditory information.

Original languageEnglish
Title of host publicationNeuromethods
PublisherHumana Press Inc.
Number of pages16
Publication statusPublished - 1 Jan 2023

Publication series

ISSN (Print)0893-2336
ISSN (Electronic)1940-6045

Bibliographical note

Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Science+Business Media, LLC, part of Springer Nature.

Other keywords

  • Multisensory perception
  • Neuroplasticity
  • Remapping
  • Training
  • Vibrotactile
  • Vision to touch
  • Visual impairment


Dive into the research topics of 'Sensory Substitution: Visual Information via Haptics'. Together they form a unique fingerprint.

Cite this