Smartwatch-assisted Robust 6-DOF Hand Tracking System for Object Manipulation in HMD-based AR
April 3, 2016 | video, 8768views


Hyung-il Kim, Woontack Woo

Smartwatch-assisted Robust 6-DOF Hand Tracking System for Object Manipulation in HMD-based Augmented Reality


This work is accepted as poster in IEEE Symposium on 3D User Interfaces (3DUI) 2016. (People's Choice Award)

We introduce a smartwatch assisted sensor fusion approach to robustly track 6-DOF hand movement in head mounted display (HMD) based augmented reality (AR) environment, which can be used for robust 3D object manipulation. Our method uses a wrist-worn smartwatch with HMD-mounted depth sensor to robustly track 3D position and orientation of user’s hand. We introduce HMD-based augmented reality platform with smartwatch, and method to accurately calibrate orientation between smartwatch and HMD. We also implement natural 3D object manipulating system using 6-DOF hand tracker with hand grasping detection. Our proposed system is easy to use, and doesn’t require any hand held devices.
List
Address. (34141)KAIST N5 #2325,
291 Daehak-ro, Yuseong-gu,
Daejeon,
Republic of Korea
Phone. +82-42-350-5923