This paper proposes a methodology to enhance audio described movies (i.e., films augmented with additional narration to explain visual content to viewers who are blind or visually impaired) by providing positional information of on-screen actors through haptics. Using a vibrotactile belt, we map the location of a character across the screen to a relative location around the waist, and the relative distance of a character from the camera is mapped to a tactile rhythm. Character movement is subsequently conveyed through these two dimensions. All participants, including one visually impaired subject, felt the vibrations improved their visualization of the clips. This subject also felt that it was quite easy to combine the information received through audio and haptics, and that the vibrations were not obstructing the subject's attention to audio.

Original languageEnglish (US)
Title of host publicationHCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings
Number of pages5
EditionPART 1
StatePublished - 2011
Event14th International Conference on Human-Computer Interaction, HCI International 2011 - Orlando, FL, United States
Duration: Jul 9 2011Jul 14 2011

Publication series

NameCommunications in Computer and Information Science
NumberPART 1
Volume173 CCIS
ISSN (Print)1865-0929


Other14th International Conference on Human-Computer Interaction, HCI International 2011
Country/TerritoryUnited States
CityOrlando, FL


  • Audio description
  • assistive technology
  • described audio
  • descriptive video service
  • haptics
  • movies
  • tactile icons
  • tactons
  • vibrotactile belt
  • video description

ASJC Scopus subject areas

  • General Computer Science
  • General Mathematics


Dive into the research topics of 'Audio-haptic description in movies'. Together they form a unique fingerprint.

Cite this