Interactive Narrative Installations: Exploring Augmented Reality and Spatial Sound to Create Immersive Cultural Storytelling

Project Abstract

This study investigates how interactive narrative installations that integrate augmented reality (AR) and spatial sound can create immersive cultural storytelling experiences, offering innovative modalities for audience engagement with heritage and local narratives. Grounded in art and design theory, the research examines the synergetic potential of AR overlays, real-time gesture interactions, and 3D audio environments to situate storytelling within physical spaces while extending perceptual boundaries beyond the screen. The project employs a design-based methodological framework combining prototyping, participatory co-creation with community storytellers, and iterative evaluation through mixed methods. A multi-stage process guides development (1) synthesis of cultural content through ethnographic elicitation and archival research to identify core narratives and sensory cues; (2) creation of a modular installation system that integrates mobile AR triggers, spatial audio, and responsive visuals capable of running in gallery, courtyard, and museum settings; (3) implementation of a narrative engine that maps user movements and gestures to branching story paths, environmental audio cues, and material textures to heighten embodiment and agency; (4) deployment of pilot installations with diverse participant groups to collect qualitative feedback on immersion, coherence, and cultural authenticity; and (5) iterative refinements based on evaluative data. The research investigates how AR layering interacts with spatial sound to evoke memory, place attachment, and intercultural empathy, while addressing accessibility, inclusivity, and ethical considerations in presenting cultural content. Key findings anticipate that (a) multimodal congruence between visual augmentation, audio localization, and user action enhances narrative immersion and empathy toward represented communities; (b) spatial sound that reflects the acoustic ecology of a locale deepens sense of place and temporality, allowing users to infer historical layers through soundscapes; (c) participatory co-design yields culturally respectful storytelling that aligns with community memory and avoids sensationalization; and (d) technical constraints such as latency, tracking accuracy, and environment-dependent acoustics significantly influence narrative agency and perceived realism. The project contributes a scalable framework for designing immersive cultural storytelling installations that harness AR and room-scale audio to choreograph audience movement, attention, and interpretation. It also offers a set of design guidelines, technical specifications, and evaluative metrics for practitioners exploring interactive narrative experiences in public spaces. By foregrounding collaborative methodologies and empirical assessment, the study demonstrates how immersive technologies can expand the dramaturgy of cultural storytelling, foster dialog between communities and audiences, and establish new paradigms for preserving intangible heritage through experiential art.

Project Overview

What This Project Is About

---

A plain-language overview of the topic and what the project investigates.

---

---

The Problem It Addresses

---

What problem or gap this project tackles and why it matters to the field or society.

---

---

Objectives of the Project

---

1. Identify how AR and spatial sound can support narrative in cultural settings.
2. Design a practical installation concept that blends story, place, and sound.
3. Test user engagement and accessibility for diverse audiences.
4. Document the workflow and constraints of creating immersive experiences.

---

---

What You Will Do Step by Step

---

1. Review simple case studies of AR storytelling and sound design.
2. Prototype a small-scale narrative installation using accessible tools.
3. Collect feedback from participants through observation and short surveys.
4. Refine the installation based on feedback and test for different spaces.

---

---

Expected Outcome

An easy-to-implement installation concept that merges augmented visuals with spatial audio to tell a cultural story, plus a short guide for future researchers or makers on how to build similar projects.