facial expression Papers

Human beings not only have the ability of logical reasoning, but also can produce, control and express emotions. Making computers have the ability of generating emotions is a challenging task of affective computing. In this paper, we construct an emotion generation model using cognitive maps and show the generated emotions with 3D facial expression animation. This paper first introduces some basic theories about emotion, reviews some typical emotion models and compares their strengths and weaknesses.... Read more

This paper investigates the impact of contradictory emotional content on people’s ability to identify the emotion expressed on avatar faces as compared to human faces. Participants saw emotional faces (human or avatar) coupled with emotional texts. The face and text could either display the same or different emotions. Participants were asked to identify the emotion on the face and in the text. While they correctly identified the emotion on human faces more often than on... Read more

In this paper we present RealActor, a character behavior realization system for embodied conversational agents based on the Behavior Markup Language (BML). Developed several years ago as part of the SAIBA framework, BML is an XML dialect for describing physical realizations of multimodal human behaviors. It allows modeling of complex communicative utterances which include both verbal and non-verbal behavior. BML elements represent various primitive actions (e.g. speech, facial and body gestures) and multimodal behavior can... Read more

In this paper we present a system which allows a virtual character to display multimodal sequential expressions i.e. expressions that are composed of different signals partially ordered in time and belonging to different nonverbal communicative channels. It is composed of a language for the description of such expressions from real data and of an algorithm that uses this description to automatically generate emotional displays. We explain in detail the process of creating multimodal sequential expressions,... Read more

We introduce a physically-based facial animation system for natural-looking emotional expressions. Our system enables creation of simple facial expressions using Facial Action Coding System (FACS) and complex facial expressions by blending existing expressions. We propose a method for blending facial actions, based on a parameterization that combines elements of FACS and MPEG-4 standard. We explore the complex expression space by examining the blends of basic emotions produced with our model. Read more

Avatars are frequently used in virtual worlds and online games to convey emotions across cultures. However, our previous study suggested there are cultural differences in recognizing avatar's facial expressions [1]. Yuki et al.'s study using emoticons and photorealistic human face images suggests Americans tend to interpret emotions based on the mouth, while Japanese tend to focus on the eyes [2]. Inspired by Yuki's study, this study uses cartoonish avatar faces to find cultural differences in... Read more

For simulating communicative behavior, realistic appearance and plausible behavior is important. Postures and mimics also reflect emotional behavior. There exist various models of emotion, like the psycho-evolutionary theory developed by Plutchik [1], or Ekman's FACS. But most models are only suited for muscular expressions. A more unattended field however, also in graphics, is the change in color. Also, other physiological symptoms like crying are left unconsidered. Read more

The tennis game that is described in the xml is a double, thus there are four tennis players on the court. There is a handful of spectators that are really excited about the game. The spectators have different preferences about the teams that they favor or are neutral. To vary the mood-states, each spectator has an euphoria factor that determines how much a change in the mood-state will affect it. The mood-state of a spectator... Read more

DEIRA is a virtual agent commenting on virtual horse races in real time. DEIRA analyses the state of the race, acts emotionally and comments about the situation in a believable and engaging way, using synthesized speech and facial expressions. In this paper we discuss the challenges, explain the computational models for the cognitive, emotional and communicative behavior, and account on implementation and feedback from users. Read more

One of the biggest obstacles for constructing effective sociable virtual humans lies in the failure of machines to recognize the desires, feelings and intentions of the human user. Virtual humans lack the ability to fully understand and decode the communication signals human users emit when communicating with each other. This article describes our research in overcoming this problem by developing senses for the virtual humans which enables them to hear and understand human speech,... Read more