Gesture Based Interface for Asynchronous Video Communication for Deaf People in South Africa

Ramuhaheli, Tshifhiwa (2011) Gesture Based Interface for Asynchronous Video Communication for Deaf People in South Africa, MSc.

PDF 2011-ramuhaheli-thesis.pdf Download (1MB)

Abstract

The preferred method of communication amongst Deaf people is that of sign language. There are problems with the video quality when using the real-time video communication available on mobile phones. The alternative is to use text-based communication on mobile phones, however findings from other research studies show that Deaf people prefer using sign language to communicate with each other rather than text. This dissertation looks at implementing a gesture-based interface for an asynchronous video communication for Deaf people. The gesture interface was implemented on a store and forward video architecture since this preserves the video quality even when there is low bandwidth. In this dissertation three gesture-based video communication prototypes were designed and implemented using a user centred design approach. These prototypes were implemented on both the computer and mobile devices. The first prototype was computer based and the evaluation of this prototype showed that the gesture based interface improved the usability of sign language video communication. The second prototype is set up on the mobile device and it was tested on several mobile devices but the device limitation made it impossible to support all the features needed in the video communication. The different problems experienced on the dissimilar devices made the task of implementing the prototypes on the mobile platform challenging. The prototype was revised several times before it was tested on a different mobile phone. The final prototype used both the mobile phone and the computer. The computer served to simulate a mobile device with greater processing power. This approach simulated a more powerful future mobile device capable of running the gesture-based interface. The computer was used for video processing but to the user it was as if the whole system was running on the mobile phone. The evaluation process was conducted with ten Deaf users in order to determine the efficiency and usability of the prototype. The results showed that the majority of the users were satisfied with the quality of the video communication. The evaluation also revealed usability problems but the benefits of communicating in sign language outweighed the usability difficulties. Furthermore the users were more interested in the video communication on the mobile devices than on the computer as this was a much more familiar technology and offered the convenience of mobility.

Item Type:	Electronic thesis or dissertation (MSc)
Uncontrolled Keywords:	Deaf Communication, Mobile Devices, South African Sign Language, Usability
Subjects:	Human-centered computing
Date Deposited:	25 Aug 2011
Last Modified:	10 Oct 2019 15:33
URI:	http://pubs.cs.uct.ac.za/id/eprint/697

Actions (login required)

View Item