Spoken Dialog System on Plasma Display Panel Estimating Users' Interest by Image Processing

We have been developing a proactive spoken dialog system on a plasma display panel (PDP). “Proactive dialog system” referes to a system with the added functionality of actively presenting acceptable information in acceptable timing. The proposed system is based on spoken dialog. It can detect non-verbal information, such as changes in gaze and face direction and head gestures of the user during dialog, and recommend suitable information. We implemented a dialog scenario to present sightseeing information on the system. Experiments with 100 subjects were held to evaluate the system's efficiency. The system grows particularly clear when dialog contains recommendations.