Universität Bielefeld - Technische Fakultät - AG Wissensbasierte Systeme

S. Kopp, T. Sowa & I. Wachsmuth:
Imitation Games with an Artificial Agent: From Mimicking to Understanding Shape-Related Iconic Gestures.

In A. Camurri & G. Volpe (eds.): Gesture-Based Communication in Human-Computer Interaction,
International Gesture Workshop 2003, Genua, Italy.
Revised Papers, LNAI 2915, Springer, 2004, pp. 436-447.

Download PDF

BibTeX

Abstract:

We describe an anthropomorphic agent that is engaged in
an imitation game with the human user. In imitating natural gestures
demonstrated by the user, the agent brings together gesture recognition
and synthesis on two levels of representation. On the mimicking level,
the essential form features of the meaning-bearing gesture phase (stroke)
are extracted and reproduced by the agent. Meaning-based imitation re-
quires extracting the semantic content of such gestures and re-expressing
it with possibly alternative gestural forms. Based on a compositional se-
mantics for shape-related iconic gestures, we present first steps towards
this higher-level gesture imitation in a restricted domain.