Mulder, Rickert (2010) Large Scale Metadata Harvesting Over Low Bandwidth Connections, CS10-05-00, Department of Computer Science, University of Cape Town.
![[img]](http://pubs.cs.uct.ac.za/style/images/fileicons/application_pdf.png) |
PDF
large_scale_metadata_harvesting.pdf Download (121kB) |
Abstract
There seems to be a widespread perception that large scale metadata harvesting requires a large amount of bandwidth. In this study a simple Python-based metadata harvester was created and run over a residential broadband connection. Results show that it is possible to build a metadata collection in the order of millions of records in just a few days over such connections.
| Item Type: | Technical report |
|---|---|
| Uncontrolled Keywords: | OAI-PMH, Low Bandwidth, Harvesting |
| Subjects: | Information systems > Information retrieval |
| Date Deposited: | 11 Mar 2010 |
| Last Modified: | 10 Oct 2019 15:33 |
| URI: | http://pubs.cs.uct.ac.za/id/eprint/602 |
Actions (login required)
 |
View Item |