UCT CS Research Document Archive

A System for a Hand Gesture-Manipulated Virtual Reality Environment

Clark, Andrew and Deshendran Moodley (2016) A System for a Hand Gesture-Manipulated Virtual Reality Environment. In Blauw, FF, M Coetzee, EM Ehlers, WS Leung, C Marnewick and DT van der Haar, Eds. Proceedings Annual Conference of the South African Institute of Computer Scientists and Information Technologists (SAICSIT 2016), Johannesburg, South Africa.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.


Extensive research has been done using machine learning techniques for hand gesture recognition (HGR) using camera-based devices; such as the Leap Motion Controller (LMC). However, limited research has investigated machine learning techniques for HGR in virtual reality applications (VR). This paper reports on the design, implementation, and evaluation of a static HGR system for VR applications using the LMC. The gesture recognition system incorporated a lightweight feature vector of five normalized tip-to-palm distances and a k-nearest neighbour (kNN) classifier. The system was evaluated in terms of response time, accuracy and usability using a case-study VR stellar data visualization application created in the Unreal Engine 4. An average gesture classification time of 0.057ms with an accuracy of 82.5% was achieved on four distinct gestures, which is comparable with previous results from Sign Language recognition systems. This shows the potential of HGR machine learning techniques applied to VR, which were previously applied to non-VR scenarios such as Sign Language recognition.

EPrint Type:Conference Paper
Subjects:I Computing Methodologies: I.2 ARTIFICIAL INTELLIGENCE
I Computing Methodologies: I.3 COMPUTER GRAPHICS
ID Code:1113
Deposited By:Moodley, Deshen
Deposited On:18 November 2016
Alternative Locations:http://dl.acm.org/citation.cfm?id=2987511