An Approach to Better System Resource Utilization for Search Engine Clusters
Nakashole, Ndapandula, Calvin Pedzai and Hussein Suleman (2006) An Approach to Better System Resource Utilization for Search Engine Clusters. Technical Report CS06-10-00, Department of Computer Science, University of Cape Town.
Better system resource utilization for search engine clusters can result in significant benefits. By allocating cluster machines to the job that requires the most computational power, indexing and querying both realize performance gains. In this paper we discuss an approach to better system resource utilization which was tested by implementing it in a cluster-based search engine. We test the approach on 100 000 webpages from the uct.ac.za domain. Our results show the benefits of enhanced system resource utilization in a search engine cluster.
|EPrint Type:||Departmental Technical Report|
|Keywords:||Indexing, querying, search engine cluster, index updating, outdated results|
|Subjects:||H Information Systems: H.3 INFORMATION STORAGE AND RETRIEVAL|
C Computer Systems Organization: C.4 PERFORMANCE OF SYSTEMS
|Deposited By:||nakashole, ndapandula|
|Deposited On:||13 November 2006|