Duotun Wang, Linjie Qiu, Linlin Cai, Yue Jiang, Mingming Fan, Zeyu Wang · International Journal of Human-Computer Interaction 2026 · 2026
DOI: 10.1080/10447318.2026.2713822
Counts differ because each database indexes a different set of publications. We treat OpenAlex as the canonical count; Google Scholar is not shown (no API, and crawling it violates its ToS).
GenAI is increasingly reshaping spatial interactions in immersive environments, bridging diverse input and output modalities to create intelligent user experiences. This survey provides a structured examination of visual GenAI techniques adapted and applied to MR contexts, which include Virtual Reality (VR), and Augmented Reality (AR), emphasizing their roles in enabling rich, adaptive, and naturalistic interactions. We screened publications from international venues between 2018 and 2025, followed by an in-depth review of 102 papers. We focus on the applications of visual content creation in 2D&3D and vision-language models (VLMs), highlighting their integration practices within MR. Furthermore, we investigate the co-evolution of generative models and MR interaction design, including immersive visualization, controllable generation, and synthetic data creation. The survey concludes by outlining recent challenges and potential research directions to advance the synergy of visual GenAI and MR techniques.
No comments yet — start the discussion below.