Spatially aware interactions in large scale immersive environments

Abstract

Lastly, we focus on how multi-modal interaction input mechanisms, voice, smartphones and spatial awareness can be coupled to build a multi-user interaction interface that is comfortable and fun to use. In a multi-use case scenario, we present approaches to support uid demarcation of personal vs. shared use spaces so that simultaneous personal and collaborative interactions can be dened clearly. Finally, based on our research results, we discuss signicant challenges that need to be overcome to make large immersive spaces truly useful for multiple participants. The challenges specically relate to the issues of privacy and uid multi-user collaboration.

In designing interactive interfaces for large immersive spaces, solutions to tackle these issues are essential. In this thesis, we establish spatial context in large immersive spaces as the primary basis to devise multi-modal interaction mechanisms, which can easily support multiuser operations. We present several user-centric interaction technologies that are primarily driven through spatial awareness in large spaces. We leverage the Collaborative Research Augmented Interactive Virtual Environment (CRAIVE)-Lab at Rensselaer Polytechnic Institute as the testbed for our work. We take a holistic approach towards establishing this environment as a multi-purpose interactive space, presenting several use cases in which basic interactions are realized based on spatial intelligence. Beyond that, we explore cross-device interactions, where ubiquitous devices such as smartphones and tablets are coupled for content transfer and communication mechanisms. We explore an interaction input mechanism that allows a single user to freely move around the space and perform basic actions such as point, click and drag. Usability and challenges related to such an interface as a viable alternative to mouse are discussed.

Human-scale immersive environments now extend well beyond research labs to real-world environments such as meeting spaces, airports, hotel lobbies and situation rooms. One of the primary challenges in these unconventional environments is the lack of natural and intuitive interaction interfaces. Mouse and keyboard are still the primary means of interaction and communication, which are inadequate to fully realize the potential of such spaces. There are major limitations posed by conventional interaction devices such as single-userlimited interoperability, non-contextualized information exchange, and constrained user location/movement.