Large Scale Metadata Harvesting Over Low Bandwidth Connections

Mulder, Rickert (2010) Large Scale Metadata Harvesting Over Low Bandwidth Connections, CS10-05-00, Department of Computer Science, University of Cape Town.

[img] PDF

Download (121kB)


There seems to be a widespread perception that large scale metadata harvesting requires a large amount of bandwidth. In this study a simple Python-based metadata harvester was created and run over a residential broadband connection. Results show that it is possible to build a metadata collection in the order of millions of records in just a few days over such connections.

Item Type: Technical report
Uncontrolled Keywords: OAI-PMH, Low Bandwidth, Harvesting
Subjects: Information systems > Information retrieval
Date Deposited: 11 Mar 2010
Last Modified: 10 Oct 2019 15:33

Actions (login required)

View Item View Item