• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Dynamic Manipulation of a Virtual Object in Marker-less AR system Based on Both Human Hands

Vol. 4, No. 4, August 26, 2010
10.3837/tiis.2010.08.010, Download Paper (Free):

Abstract

This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using humans body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
J. Chun and B. Lee, "Dynamic Manipulation of a Virtual Object in Marker-less AR system Based on Both Human Hands," KSII Transactions on Internet and Information Systems, vol. 4, no. 4, pp. 618-632, 2010. DOI: 10.3837/tiis.2010.08.010.

[ACM Style]
Junchul Chun and Byungsung Lee. 2010. Dynamic Manipulation of a Virtual Object in Marker-less AR system Based on Both Human Hands. KSII Transactions on Internet and Information Systems, 4, 4, (2010), 618-632. DOI: 10.3837/tiis.2010.08.010.