A Survey of Middlewares for Multi-Modal Interactions

Jinseok Seo

The user interfaces in computing environments are becoming experience - oriented, diversified, and personalized from the WIMP (Widows, Icons, Mouse, and Pointer) interface, and a wide variety of interaction devices are continuously being developed to support these needs.  Therefore, in order to combine these new devices with existing application software, a method for connecting operating systems and the existing software is needed.  Researchers in various fields such as virtual reality, home appliances, and ubiquitous computing have studied middleware to solve this problem.  This paper is a survey of these middlewares.