CGI 2016

[acm 2949044] Efficient 3D Hand Tracking in Articulation Subspaces for the Manipulation of Virtual Objects [PDF] [notes]

Gabyong Park, Antonis Argyros, Woontack Woo

Synthesis

Instead of 6 26 DoFs directly, use articulation subspace with 6 DoF for the parm and 4 DoF for each finger :

Divide and conquer approach :

• first estimate 6 DoFs of palm
• then parallelly determine 4 DoF of each finger

Pipeline

Segmentation

Using depth and HSV

wrist position from wristband

Hand contours are extracted through edge detection (using sobel operator)

3D hand model

sample a number of points between hand joints based on forward kinematics

fit gaussian model to label the fingers

Uses temporal continuity by initializing gaussian distrib representation of fingers as optimized at previous step

EM algo to cluster

Contribution

No GPU to acheive real-time