2022 INTERSPEECH INTERSPEECH 2022

SKYE: More than a conversational AI

Abstract

This paper presents how a virtual character was created through a conversational AI system that not only has an open-domain dialog system but also takes visual and audio inputs to create an interactive and interpersonal responses to users. The virtual character has its 3D figure with a particular voice and personality for the immersive AI experience. Multiple AI modules were integrated into the system to make human-like interaction including automatic speech recognition, Text-to-speech model, intelligent open-domain dialog system, and 3D game engine.

🌉 Interdisciplinary Bridge — Natural Language Processing and Speech & Audio
🧭 Keyword Pioneer — 3d game engine
🐣 Hot Topic Early Bird — dialogue system
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Deep Learning, Interdisciplinary, Machine Learning, Natural Language Processing, Reinforcement Learning, Speech & Audio