Cultural heritage sites are treasured symbols of humanity’s past, but many remain inaccessible due to preservation efforts, geographic limitations, or structural fragility. The DIDYMOS-XR project addresses this challenge by creating immersive digital twins of historic landmarks, powered by cutting-edge mixed reality (MR) technology. Developed by the University of Patras, this system enables users to explore reconstructed cultural sites either individually or as part of a shared, multi-user experience.
This technology not only preserves historical integrity but also makes heritage more engaging and inclusive for a global audience. By enabling both on-site and remote access, we’re bringing centuries-old stories to life with the power of XR. Whether you’re on-site or thousands of kilometers away, XR technology breathes new life into any story.
The developed application offers two modes: a synchronous multi-user guided tour and an asynchronous version tailored to individual interests. Whether using the Meta Quest 3 or a smartphone, users can explore detailed 3D reconstructions of historical landmarks such as the Sacrification Church of Pyhämaa in Finland and the Biblioteca Museu Víctor Balaguer in Spain.
Through “portal” effects, users can step into virtual interiors placed directly on real-world surfaces, seamlessly blending physical and digital spaces. Real-time weather and lighting effects enrich immersion, adapting to live environmental conditions using the OpenWeatherMap API. These features make cultural exploration both realistic and dynamic, bridging the sensory gap between on-site and remote visits.
Users appear as avatars within the virtual environment, enabling collaborative navigation of the space. The system syncs positions and actions across devices, ensuring that exploration remains cohesive and social. These avatars can follow a virtual guide through the site in real time or choose their own points of interest for more flexible discovery. Educational content is delivered through intuitive visual cues and speech bubbles, making complex history easier to understand and remember. The dual-guide system ensures that whether you’re a solo visitor or part of a virtual group, your journey is tailored and informative.
The user experience was rigorously evaluated through hands-on testing with twenty participants, all university students or graduates. Feedback indicated a high level of immersion and educational value, with particular praise for the visual realism, interactivity, and multi-user functionality. Key features such as portal transitions and environmental responsiveness were especially well-received. Importantly, users recognized the broader potential of MR in other fields like education, science, and art, confirming that the technologies behind DIDYMOS-XR can be applied far beyond cultural heritage. The feedback provides clear direction for further development, including improved localization, adaptive virtual guides, and real-time chat capabilities with live experts.
The DIDYMOS-XR project is opening new doors for sustainable tourism, inclusive education, and digital preservation by integrating MR technologies into cultural experiences. This work demonstrates that we can make history more accessible without sacrificing authenticity. With continued innovation, we can scale these systems across multiple sites and user groups, creating a truly global network of immersive heritage experiences. The past may be behind us, but with mixed reality, exploring it has never felt more immediate.
Watch our augmented and virtual reality tourism applications in action on our YouTube channel.
Author: Dr Gerasimos Arvanitis, University of Patras
