Specifying and animating facial signals for discourse in embodied conversational agents.

Saved in:
Bibliographic Details
Title: Specifying and animating facial signals for discourse in embodied conversational agents.
Authors: DeCarlo, Doug1 decarlo@cs.rutgers.edu, Stone, Matthew2,3, Revilla, Corey4, Venditti, Jennifer J.5
Source: Computer Animation & Virtual Worlds. Feb2004, Vol. 15 Issue 1, p27-38. 12p. 2 Black and White Photographs, 1 Diagram, 3 Charts, 1 Graph.
Subjects: Computer-generated imagery, Computer drawing, Facial expression, Speech, Gesture
Abstract: People highlight the intended interpretation of their utterances within a larger discourse by a diverse set of non-verbal signals. These signals represent a key challenge for animated conversational agents because they are pervasive, variable, and need to be coordinated judiciously in an effective contribution to conversation. In this paper, we describe a freely available cross-platform real-time facial animation system, RUTH, that animates such high-level signals in synchrony with speech and lip movements. RUTH adopts an open, layered architecture in which fine-grained features of the animation can be derived by rule from inferred linguistic structure, allowing us to use RUTH, in conjunction with annotation of observed discourse, to investigate the meaningful high-level elements of conversational facial movement for American English speakers. [ABSTRACT FROM AUTHOR]
Copyright of Computer Animation & Virtual Worlds is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:People highlight the intended interpretation of their utterances within a larger discourse by a diverse set of non-verbal signals. These signals represent a key challenge for animated conversational agents because they are pervasive, variable, and need to be coordinated judiciously in an effective contribution to conversation. In this paper, we describe a freely available cross-platform real-time facial animation system, RUTH, that animates such high-level signals in synchrony with speech and lip movements. RUTH adopts an open, layered architecture in which fine-grained features of the animation can be derived by rule from inferred linguistic structure, allowing us to use RUTH, in conjunction with annotation of observed discourse, to investigate the meaningful high-level elements of conversational facial movement for American English speakers. [ABSTRACT FROM AUTHOR]
ISSN:15464261
DOI:10.1002/cav.5