UCT CS Research Document Archive

Component-based Digital Library Scalability using Cluster Computing

Omar, Muammar Zamir and Hussein Suleman (2006) Component-based Digital Library Scalability using Cluster Computing. In Proceedings 8th Annual Conference on WWW Applications, Free State.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

Most institutions make use of digital library systems (DL) to deal with the information they use. DL systems allow them to provide information management services, including the ability to search through and browse the information they have made available. The current architecture of the systems however, does not scale well when the amount of information increases dramatically.

A good example of a digital library would be a national collection of academic theses. Such a system provides anyone the service of searching, browsing and viewing the theses in its collection. These services allow users to effectively and efficiently locate and make use of the materials available. With an increase in the number of users and underlying information these systems degrade quite rapidly though.

This research is therefore aimed at creating digital library systems using components or services with the ability to migrate and replicate themselves on a collection or cluster of computers. Component based systems have proven to be more extensible and maintainable than monolithic systems. Each component encapsulates the functionality it requires and can be tested, modified and used without affecting other parts of the system. The components in this experimental system consist of Web services and are mobile, in that they have the ability to move around the cluster. Migration allows services or components to move to different locations in order to maximally use available resources. Replication serves to improve performance by improving availability as well as creating duplicates of services as an increase in the need for them arises. These two service enhancements promote a dynamic architecture with a greater degree of system efficiency and reliability.

Currently, routing and migration modules have been implemented for the proposed system. Initial performance tests have been conducted and the results from these are discussed and analysed.

EPrint Type:Conference Paper
Keywords:digital library, scalability, migration, web services, components
Subjects:H Information Systems: H.3 INFORMATION STORAGE AND RETRIEVAL
ID Code:324
Deposited By:Omar, Muammar Zamir
Deposited On:03 October 2006