Edge and IoT-supported Intelligent Augmented Reality: Promise, Challenges, and Solutions

Maria Gorlatova, Ph.D.
Associate Professor
Department of Electrical and Computer Engineering
Duke University, Durham, NC

Date:
03/08/2024

Time:
9:30 am – 10:30 am CST

Location:
San Pedro 1, Weston Conference Center
506 Dolorosa St, San Antonio, TX 78204

Zoom: https://utsa.zoom.us/j/94807623288

Abstract:
Mobile augmented reality (AR), which integrates virtual objects with 3D real environments in real time, has been showing outstanding potential in many application domains including education, retail, and healthcare. AR is broadly expected to redefine how we interact with technology and the world around us. Yet current AR falls short of many of the expectations. This talk presents our vision of multi-device, edge computing-supported and Internet-of-Things (IoT)-integrated platforms for next-generation intelligent context-aware AR. I describe shortcomings in modern AR platforms’ spatial and semantic awareness capabilities and identify key gaps that need to be addressed to enable AR to become robust and resource-efficient; I present solutions to some of the challenges, touching on topics in edge computing, machine learning, and resource-efficient simultaneous localization and mapping (SLAM). I also highlight opportunities associated with close integration of AR platforms and their users and describe a set of solutions for robust gaze-based user context awareness in AR. The talk showcases several applications of next-generation context-aware AR, such as AR-based surgical guidance and AR support for mental and behavioral health and well-being.