A System for Multimodal Interaction with Kinect-Enabled Virtual Windows

Bernardos, Ana M. and Marquínez, Íñigo and Gómez, David and Besada, Juan and Casar, José (2015) A System for Multimodal Interaction with Kinect-Enabled Virtual Windows. A System for Multimodal Interaction with Kinect-Enabled Virtual Windows, 1 (3). e1. ISSN 2312-8623

[thumbnail of icst.intetain.2015.259498.pdf]
Available under License Creative Commons Attribution No Derivatives.

Download (524kB) | Preview


Commercial off-the-shelf gaming devices (e.g. such as Kinect) are demonstrating to have a great potential beyond their initial service purpose. In particular, when integrated within the environment or as part of smart objects, peripheral COTS for gaming may facilitate the definition of novel interaction methods, particularly applicable to smart spaces service concepts. In this direction, this paper describes a system prototype that makes possible to deliver multimodal interaction with the media contents in a Virtual Window. Using a Kinect device, the Interactive Window itself adjusts the video clipping to the real time perspective of the user – who can freely move within the sensor coverage are. On the clipped video, the user is able to select objects by pointing at meaningful image sections and to initiate actions related to them. Voice orders may also complete the interaction when necessary. Although implemented for smart spaces, the service concept can also be applied to learning, remote control processes or teleconference.

Item Type: Article
Uncontrolled Keywords: multimodal interaction, virtual windows, deictic interaction, smart spaces, smart objects
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
QA75 Electronic computers. Computer science
Depositing User: EAI Editor IV
Date Deposited: 01 Jul 2021 11:53
Last Modified: 01 Jul 2021 11:53
URI: https://eprints.eudl.eu/id/eprint/4302

Actions (login required)

View Item
View Item