Video-based arm motion estimation and interaction with fuzzy predictive control

Abstract

Multi-projector display systems are gaining popularity for use in immersive virtual reality applications and scientific visualization. While recent work has addressed the issues of human interfaces to hide the distributed nature of those systems, there has been relatively little work on natural interactive modalities. In this paper, based on the discrete characteristics of nodes distribution and the spatio-temporal coherence of the user’s movement, we propose a non-contact interaction solution for multi-projector display system. Utilizing a virtual three-dimensional interactive rectangular parallelepiped, we establish correspondence between the virtual scene and the user’s arm position information. For robustly tracking the user’s arm position, an arm motion estimation method is designed based on the fuzzy predictive control theory. To verify the efficiency and accuracy of the proposed method, various motion estimation algorithms were tested with and without the fuzzy predictive control theory to stabilize the output.