Tableware: Social Coordination Through Computationally Augmented Everyday Objects Using Auditory Feedback

Yanjun Lyu, Brandon Mechtley, Lauren Hayes, Xin Wei Sha

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations


This research develops a novel way of rethinking cultural and social behavior using computationally augmented artifacts. These ‘instruments’ provide various types of auditory feedback when manipulated by certain actions within social contexts, such as a bar or dining space. They foster affective social engagement through the habitual and explorative actions that they afford in everyday contexts, and their resulting auditory feedback. The goal is not only to observe how social interactions are affected by the manipulation of augmented artifacts, but also to observe how the sounds and manipulations affect psycho-sociological [1] changes towards more collaborative social relations during the processes of participatory sense-making [2]. In this paper, we present: a) a study of dynamic social interaction and how we instrumented tangible artifacts to reflect and induce engagement, b) a literature review that provides background for our design methodology, c) ‘vocal prototyping’–a responsive media technique for developing action-sonic mappings, d) our experimental prototype based on this design methodology.

Original languageEnglish (US)
Title of host publicationHCI International 2020 – Late Breaking Papers
Subtitle of host publicationDigital Human Modeling and Ergonomics, Mobility and Intelligent Environments - 22nd HCI International Conference, HCII 2020, Proceedings
EditorsConstantine Stephanidis, Vincent G. Duffy, Norbert Streitz, Shin’ichi Konomi, Heidi Krömker
PublisherSpringer Science and Business Media Deutschland GmbH
Number of pages18
ISBN (Print)9783030599867
StatePublished - 2020
Event22nd International Conference on Human-Computer Interaction, HCII 2020 - Copenhagen, Denmark
Duration: Jul 19 2020Jul 24 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12429 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference22nd International Conference on Human-Computer Interaction, HCII 2020


  • Action-sonic coupling
  • Affective computing
  • Computationally augmented interface
  • Dynamic of coordination
  • Embodied interaction
  • Engagement
  • Ensemble interaction
  • Participatory sense-making
  • Responsive media
  • Social cognition
  • Social interaction
  • Tangible user interaction

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Tableware: Social Coordination Through Computationally Augmented Everyday Objects Using Auditory Feedback'. Together they form a unique fingerprint.

Cite this