UVR Lab. was formed
in Feb. 2001 at GIST to study and develop “Virtual Reality in Smart
computing environments” that process multimodal input, perceive
user’s intention and emotion, and respond to user’s request through
Augmented Reality. Since 2012, UVR Lab moved to KAIST GSCT and restarted
with a theme of “FUN in Ubiquitous VR.”
작성일 : 16-04-03
Smartwatch-assisted Robust 6-DOF Hand Tracking System for Object Manipulation in HMD-based AR
글쓴이 :
UVR
조회 : 8,134
Hyung-il Kim, Woontack Woo
Smartwatch-assisted Robust 6-DOF Hand Tracking System for Object Manipulation in HMD-based Augmented Reality
This work is accepted as poster in IEEE Symposium on 3D User Interfaces (3DUI) 2016. (People's Choice Award)
We introduce a smartwatch assisted sensor fusion approach to robustly track 6-DOF hand movement in head mounted display (HMD) based augmented reality (AR) environment, which can be used for robust 3D object manipulation. Our method uses a wrist-worn smartwatch with HMD-mounted depth sensor to robustly track 3D position and orientation of user’s hand. We introduce HMD-based augmented reality platform with smartwatch, and method to accurately calibrate orientation between smartwatch and HMD. We also implement natural 3D object manipulating system using 6-DOF hand tracker with hand grasping detection. Our proposed system is easy to use, and doesn’t require any hand held devices.