Video Chatbots

Relax after a hard days work, the Perfect Boyfriend is here to listen and care. Created with the Perfect Girlfriend for PBL media.

Ms. Dewey was a viral marketing campaign started by Microsoft in October 2006. It also refers to the character of the same name, who is the campaign's main subject. The Ms. Dewey website was an Adobe Flash-based experimental interface for Live Search. The interface features a modern-looking cityscape as a backdrop with the character on the left side, while the search results appear on the right. The cityscape backdrop changed depending on the time of day.

Developed by advertising agency, McCann-Erickson, San Francisco and digital content marketing firm, "EVB San Francisco", Ms. Dewey appeared to be an interactive search assistant who audibly commented on searched keywords in her own style and made random actions when idle, including taking props from behind her desk. The responses actually consisted of about 600 video clips recorded over a period of three days.

Microsoft did not overtly market the website, and appeared to be relying on media coverage to draw users in. Janina Gavankar played the role of the Ms. Dewey character.

At January 2009 the website became inactive.

DEIRA - Dynamic Engaging Intelligent Reporter Agent is a virtual horse race reporter, specifically designed for reporting on horse races. The intention is to provide an alternative for real race reporters. Usage and adaptation The system may be adapted in many ways. The face can easily be replaced, as long as it can be used by Visage Interactive. The voice can be generated by any text-to-speech generator. What events are generated and the corresponding sentences that can be uttered about that event can also easily be adjusted, since they are expressed in rules and grammars respectively. This means adapting the reporter to report on a different type of race should be an easy thing to do. Also, the system is designed in a very modular way, which should make other structural changes fairly straight-forward to make.

DEIRA has a large vocabulary, which is easily extendible to include even more. Emotional display is done by intonation of speech as well as physically in the face. The design was highly influenced by the opinions of potential users (in the case of horse race reporting), who were polled multiple times during development. The system is also easily adjustable for use in other kinds of races.

The provided horse race simulation software is used to provide input on the state of the race. DEIRA analyses this information and eventually sends the resulting utterance including emotional expression to the visual representation software Visage Interactive which in turn shows the agent reporting the race.

Within DEIRA, horse race information is received by the Race Analysis Module, which scans the changing race state for events that are possibly interesting to report. These events are then passed on to the Mental Model which adjusts the global mental state and adds a local mental state to the incoming events. The events are then queued in the Event Queue, making them available for the other modules.

The Text Generation Module takes the highest priority event without text and generates suitable sentences based on the grammar to describe it. The Speech Generation Module is responsible for making this text suitable for the text-to-speech engine, also adding the emotional aspects to the speech.

The Face Animation Module provides the corresponding facial expression information. When an event has obtained all the necessary information from these modules, the Output Module sends it all through to Visage.