XR and HCI Research Briefing — 2026-06-15

Key Paper Summaries

1 sources

titanhaptics.com

titanhaptics.com

1. Spatial Computing: Recent Advances in Multimodal Natural Interaction for XR Headsets

• Core Topic: A comprehensive survey of multimodal input/output technologies aimed at achieving natural interaction between users and their environment in XR headsets. It centers on the integration of visual, audio, and haptic feedback.

• Differentiation and Contribution: Moves beyond vision-based display research to present the integration of three sensory modalities (visual, audio, haptic) as a primary research direction. Empirically demonstrates that the Microsoft HoloLens 2 and HTC Vive Pro/Vive Pro Eye have been the most active experimental devices over the past two years.

• Experiments and Analysis: As of 2024, the HoloLens 2 is identified as the preferred device for Head-Mounted Display (HMD) research, while the Meta Quest 2, though declining in usage since 2022, remains a popular platform.

• Limitations: Most previous XR surveys were categorized by display type, research type, use case, input technology, and task type; this study is limited in scope by focusing specifically on HMDs.

1 sources

cancerresearch.org

cancerresearch.org

2. Radiance Fields in XR: A Survey of Implementations and Applications

• Core Topic: A systematic survey on how Radiance Fields (RF) technology is utilized in XR environments, focusing on real-time rendering and interactive 3D scene generation.

• Differentiation and Contribution: Emphasizes the need for integrated multimodal interaction, specifically proposing that multimodal interaction including haptic and textile feedback is a crucial future research direction.

• Experiments and Analysis: Beyond basic functional changes (viewpoint changes, scene transitions), it suggests methods for improving the efficiency of physics-based interaction simulations and monitoring the realism of RF scenes using Large Vision Models.

• Limitations: Despite their high potential for XR application, much of the research in this field remains at the XR demonstration level, with a noted lack of robust implementations and in-depth user studies.

3. A Retrospective Review of Ultrasound Mid-Air Haptics in HCI

• Core Topic: A historical and technical analysis of how ultrasound-based mid-air haptic feedback technology has evolved in HCI. Focuses on technology that provides tactile feedback to a user's hands or arms without physical contact.

• Differentiation and Contribution: Demonstrates the practical value of ultrasound haptics in rehabilitation and XR applications, analyzing how muscle stiffness in the user's arms and hands affects haptic perception.

• Experiments and Analysis: Research presented at the 2024 IEEE International Conference (MetroXRAINE) shows that arm and hand muscle stiffness significantly influences a user’s perception of ultrasound haptics.

• Limitations: Further research is needed regarding the spatial accuracy, precision of intensity control, and adaptability of ultrasound mid-air haptic technology across diverse user groups.

4. Transcending Human Ability: Opportunities and Risks of Cognitive and Physical Augmentation via AI, Robotics, and XR

• Core Topic: An analysis of how Extended Reality (XR) and haptic interfaces facilitate natural interaction through body augmentation. Reviews next-generation technologies, including thin, skin-adhesive haptic interfaces (e.g., Tacttoo).

• Differentiation and Contribution: Highlights that creating immersive experiences rich in sensory feedback can simultaneously achieve physical and cognitive augmentation. Presents the innovative application potential of real-time tactile feedback delivery technology.

• Experiments and Analysis: Analyzes the design and implementation of skin-adhesive haptic interfaces similar to Tacttoo. It demonstrates how such devices blur the boundaries between virtual and real interactions by delivering real-time tactile information.

• Limitations: Practical issues such as skin irritation from long-term wear, battery life, and the stability of signal transmission remain insufficiently addressed.

Research Trend Summary

Integration of Multimodal Sensing and Haptic Feedback

The most prominent trend in XR/HCI research this week is the integration of triple-sensory feedback, including visual, audio, and haptic elements. There is a strong movement to move away from vision-centric interactions to provide users with more natural and immersive experiences.

Progress in Practical Ultrasound and Skin-Adhesive Haptic Tech

Ultrasound mid-air haptic technology and skin-adhesive haptic interfaces have moved beyond the proof-of-concept stage and are beginning to be applied in real-world rehabilitation and XR fields. Scientific analysis regarding how physical variables, such as muscle stiffness, affect haptic perception is also underway.

Expansion of Multimodal Interaction Research with Radiance Fields (RF)

Radiance Field technology, which generates high-quality 3D scenes in XR environments, is being integrated with haptic feedback, going beyond simple visual rendering. This is contributing to making physics-based interaction simulations more realistic.

References and Additional Resources

• arXiv Spatial Computing Paper: - Latest technology trends in multimodal natural interaction for XR headsets
• arXiv Radiance Fields Survey: - Radiance field implementation and application in XR
• arXiv Ultrasound Haptics Retrospective: - Historical development of ultrasound mid-air haptic technology in HCI
• arXiv Human Augmentation Paper: - Physical and cognitive augmentation technologies via AI, robotics, and XR

3 sources

arxiv.org

Beyond Human: Cognitive and Physical Augmentation through AI, Robotics, and XR – Opportunities and R

arxiv.org

\\reviseTowards spatial computing: recent advances in multimodal natural interaction for XR headsets

arxiv.org

arxiv.org