UCT CS Research Document Archive

An Approach to Better System Resource Utilization for Search Engine Clusters

Nakashole, Ndapandula, Calvin Pedzai and Hussein Suleman (2006) An Approach to Better System Resource Utilization for Search Engine Clusters. Technical Report CS06-10-00, Department of Computer Science, University of Cape Town.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

Better system resource utilization for search engine clusters can result in significant benefits. By allocating cluster machines to the job that requires the most computational power, indexing and querying both realize performance gains. In this paper we discuss an approach to better system resource utilization which was tested by implementing it in a cluster-based search engine. We test the approach on 100 000 webpages from the uct.ac.za domain. Our results show the benefits of enhanced system resource utilization in a search engine cluster.

EPrint Type:Departmental Technical Report
Keywords:Indexing, querying, search engine cluster, index updating, outdated results
Subjects:H Information Systems: H.3 INFORMATION STORAGE AND RETRIEVAL
C Computer Systems Organization: C.4 PERFORMANCE OF SYSTEMS
ID Code:363
Deposited By:nakashole, ndapandula
Deposited On:13 November 2006