UCT CS Research Document Archive

Online Gaming for Crowd-sourcing Phrase-equivalents

Kumaran, A, Melissa Densmore and Shaishav Kumar (2014) Online Gaming for Crowd-sourcing Phrase-equivalents. In Proceedings Computational Linguistics, pages 1238-1247, Dublin.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

We propose the use of a game with a purpose (GWAP) to facilitate crowd-sourcing of phrase-equivalents, as an alternative to expert or paid crowd-sourcing. Doodling is an online multiplayer game, in which one player (drawer), draws pictures on a shared board to get the other players (guessers) to guess the meaning behind an assigned phrase. In this paper we describe the system and results from several experiments intended to improve the quality of information generated by the play. In addition, we describe the mechanism by which we take candidate phrases generated during the games and filter out true phrase equivalents. We expect that, at scale, this game will be more cost-efficient than paid mechanisms for a similar task, and demonstrate this by comparing the productivity of an hour of game play to an equivalent crowd-sourced Amazon Mechanical Turk task to produce phrase-equivalents over one week.

EPrint Type:Conference Paper
Subjects:J Computer Applications: J.0 GENERAL
ID Code:955
Deposited By:Densmore, Melissa
Deposited On:03 September 2014