Foveated haptic gaze

Bijan Fakhri, Troy McDaniel, Heni Ben Amor, Hemanth Venkateswara, Abhik Chowdhury, Sethuraman Panchanathan

Research output: Chapter in Book/Report/Conference proceedingConference contribution


As digital worlds become ubiquitous via video games, simulations, virtual and augmented reality, people with disabilities who cannot access those worlds are becoming increasingly disenfranchised. More often than not the design of these environments focuses on vision, making them inaccessible in whole or in part to people with visual impairments. Accessible games and visual aids have been developed but their lack of prevalence or unintuitive interfaces make them impractical for daily use. To address this gap, we present Foveated Haptic Gaze, a method for conveying visual information via haptics that is intuitive and designed for interacting with real-time 3-dimensional environments. To validate our approach we developed a prototype of the system along with a simplified first-person shooter game. Lastly we present encouraging user study results of both sighted and blind participants using our system to play the game with no visual feedback.

Original languageEnglish (US)
Title of host publicationSmart Multimedia - 2nd International Conference, ICSM 2019, Revised Selected Papers
EditorsTroy McDaniel, Stefano Berretti, Igor D.D. Curcio, Anup Basu
Number of pages13
ISBN (Print)9783030544065
StatePublished - 2020
Event2nd International Conference on Smart Multimedia, ICSM 2019 - San Diego, United States
Duration: Dec 16 2019Dec 18 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12015 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference2nd International Conference on Smart Multimedia, ICSM 2019
Country/TerritoryUnited States
CitySan Diego


  • Assistive technology
  • Haptics
  • Sensory substitution
  • Video games

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Foveated haptic gaze'. Together they form a unique fingerprint.

Cite this