Walkable Mixed Reality Map as interaction interface for Virtual Heritage

Abstract

© 2019 Elsevier Ltd.

Studies in the Virtual Heritage (VH) domain have led to underlining the significance of a contextual relationship between users, immersive reality technologies and interactive and engaging cultural context as essential aspects towards enabling cultural learning in VH applications. Interaction methods, therefore, play a great role in terms of enabling interactive and engaging experience under various VH settings. This paper proposes a novel approach to use maps as interaction interfaces in a Mixed Reality (MxR) environment that could be applied to specific VH settings with a predefined cultural and historical context. The primary focus of the proposed interaction method named ‘Walkable MxR Map’ is to use interactive, immersive and walkable maps to allow users interact with cultural content, 3D models, and different multimedia content at museums and heritage sites. Hence, the applicability of the proposed systems will not be limited to museums' indoor settings; its applicability extends outdoors at the natural location of cultural heritage assets. To this end, immersive reality technologies, interaction methods, development platforms and mapping and cloud storage services have been combined to realise the interaction method. The Walkable MxR Map allows users to interact with virtual objects via maps that are virtually projected on the floor and viewable through MxR devices, specifically the Microsoft HoloLens. The projected maps are room-scale and walkable with a potential global scalability. Besides movement-based interaction, users can interact with virtual objects, multimedia content and 3D models using HoloLens's standard gesture, gaze and voice interaction methods.