Better Teaming Through Visual Cues: How Projecting Imagery in a Workspace Can Improve Human-Robot Collaboration

Ramsundar Kalpagam Ganesan; Yash Rathore; Heather Ross; Hani Ben Amor

doi:10.1109/MRA.2018.2815655

Better Teaming Through Visual Cues: How Projecting Imagery in a Workspace Can Improve Human-Robot Collaboration

Ramsundar Kalpagam Ganesan, Yash Rathore, Heather Ross, Hani Ben Amor

Research output: Contribution to journal › Article › peer-review

38 Scopus citations

Abstract

In this article, we present a communication paradigm using a context-aware mixed-reality approach for instructing human workers when collaborating with robots. The main objective is to utilize the physical work environment as a canvas to communicate task-related instructions and robot intentions in the form of visual cues. A vision-based object-tracking algorithm is used to precisely determine the pose and state of physical objects in and around the workspace. A projection-mapping technique is employed to overlay visual cues on the tracked objects and the workspace. Simultaneous tracking and projection onto objects enable the system to provide just-in-time instructions for carrying out a procedural task.

Original language	English (US)
Pages (from-to)	59-71
Number of pages	13
Journal	IEEE Robotics and Automation Magazine
Volume	25
Issue number	2
DOIs	https://doi.org/10.1109/MRA.2018.2815655
State	Published - Jun 2018

ASJC Scopus subject areas

Control and Systems Engineering
Computer Science Applications
Electrical and Electronic Engineering

Access to Document

10.1109/MRA.2018.2815655

Cite this

@article{f94f2166d42d4f55a93f79f465ba009f,

title = "Better Teaming Through Visual Cues: How Projecting Imagery in a Workspace Can Improve Human-Robot Collaboration",

abstract = "In this article, we present a communication paradigm using a context-aware mixed-reality approach for instructing human workers when collaborating with robots. The main objective is to utilize the physical work environment as a canvas to communicate task-related instructions and robot intentions in the form of visual cues. A vision-based object-tracking algorithm is used to precisely determine the pose and state of physical objects in and around the workspace. A projection-mapping technique is employed to overlay visual cues on the tracked objects and the workspace. Simultaneous tracking and projection onto objects enable the system to provide just-in-time instructions for carrying out a procedural task.",

author = "{Kalpagam Ganesan}, Ramsundar and Yash Rathore and Heather Ross and {Ben Amor}, Hani",

note = "Publisher Copyright: {\textcopyright} 1994-2011 IEEE.",

year = "2018",

month = jun,

doi = "10.1109/MRA.2018.2815655",

language = "English (US)",

volume = "25",

pages = "59--71",

journal = "IEEE Robotics and Automation Magazine",

issn = "1070-9932",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "2",

}

TY - JOUR

T1 - Better Teaming Through Visual Cues

T2 - How Projecting Imagery in a Workspace Can Improve Human-Robot Collaboration

AU - Kalpagam Ganesan, Ramsundar

AU - Rathore, Yash

AU - Ross, Heather

AU - Ben Amor, Hani

PY - 2018/6

Y1 - 2018/6

N2 - In this article, we present a communication paradigm using a context-aware mixed-reality approach for instructing human workers when collaborating with robots. The main objective is to utilize the physical work environment as a canvas to communicate task-related instructions and robot intentions in the form of visual cues. A vision-based object-tracking algorithm is used to precisely determine the pose and state of physical objects in and around the workspace. A projection-mapping technique is employed to overlay visual cues on the tracked objects and the workspace. Simultaneous tracking and projection onto objects enable the system to provide just-in-time instructions for carrying out a procedural task.

AB - In this article, we present a communication paradigm using a context-aware mixed-reality approach for instructing human workers when collaborating with robots. The main objective is to utilize the physical work environment as a canvas to communicate task-related instructions and robot intentions in the form of visual cues. A vision-based object-tracking algorithm is used to precisely determine the pose and state of physical objects in and around the workspace. A projection-mapping technique is employed to overlay visual cues on the tracked objects and the workspace. Simultaneous tracking and projection onto objects enable the system to provide just-in-time instructions for carrying out a procedural task.

UR - http://www.scopus.com/inward/record.url?scp=85047015826&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85047015826&partnerID=8YFLogxK

U2 - 10.1109/MRA.2018.2815655

DO - 10.1109/MRA.2018.2815655

M3 - Article

AN - SCOPUS:85047015826

SN - 1070-9932

VL - 25

SP - 59

EP - 71

JO - IEEE Robotics and Automation Magazine

JF - IEEE Robotics and Automation Magazine

IS - 2

ER -

Better Teaming Through Visual Cues: How Projecting Imagery in a Workspace Can Improve Human-Robot Collaboration

Abstract

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this