半虚拟现实座舱中基于最大后验概率框架的手姿态估计

手姿态估计是半虚拟现实(SVR)座舱环境中进行人机交互(HCI)的基础工作,为此提出一种基于最大后验概率(MAP)框架的手姿态估计方法.针对手部自遮挡问题,建立多视点手势特征树,通过树节点搜索实现手姿态参数的快速估计,并利用时序信息提高估计精度.在树节点搜索过程中,采用改进的局部敏感哈希(LSH)索引算法提高搜索效率....

Hand Pose Estimation Based on Maximum a Posteriori Framework in Semi-virtual Reality Cockpit

To realize natural interaction in a semi-virtual reality (SVR) system, hand pose estimation is a crucial step of human-computer interaction (HCI) in a semi-virtual reality cockpit. In order to enhance the sense of immersion for the pilot in the semi-virtual reality cockpit, a hand pose estimation method based on maximum a posteriori (MAP) framework is proposed in this paper. Under the MAP framework, a multi-view tree that contains information of multiple cameras is put forward to deal with the self-occlusion in hand motion. Hand gesture parameters are estimated by searching among the tree nodes. In this method, temporal consistency is used to advance the estimated accuracy, and locality sensitive hashing (LSH) is improved to raise the efficiency in the tree searching algorithm. Experimental results show that the proposed algorithm possesses the characteristic of real-time and accurate rendering of the virtual hand and the ability to reconstruct hand postures in a semi-virtual reality cockpit.