Files/EThOS webservice download tool - Revision history

Libjlrs at 09:15, 10 July 2012

2012-07-10T09:15:59Z

Libjlrs@leeds.ac.uk at 10:11, 4 July 2012

2012-07-04T10:11:05Z

Libjlrs@leeds.ac.uk: Added files.eprints link

2012-07-04T10:10:43Z

Added files.eprints link

Libjlrs@leeds.ac.uk at 15:40, 28 June 2012

2012-06-28T15:40:13Z

Libjlrs@leeds.ac.uk: added 'in practice' section

2012-06-28T14:39:27Z

added 'in practice' section

Libjlrs@leeds.ac.uk: Added EThOS identifiers note

2012-06-28T14:24:47Z

Added EThOS identifiers note

Libjlrs@leeds.ac.uk at 14:18, 28 June 2012

2012-06-28T14:18:47Z

Libjlrs@leeds.ac.uk: Created page with 'The British Library EThOS service has a SOAP based webservice to allow institutions to pull digitized theses back from their collection. The code uses: * SOAP::Lite (to make the …'

2012-06-28T13:59:36Z

Created page with 'The British Library EThOS service has a SOAP based webservice to allow institutions to pull digitized theses back from their collection. The code uses: * SOAP::Lite (to make the …'

New page

The British Library EThOS service has a SOAP based webservice to allow institutions to pull digitized theses back from their collection.
The code uses:
* SOAP::Lite (to make the calls to the webservice)
* LWP (to download the Zip files)
* Archive::Zip (to extract the files)
* Time::Local (to generate timestamps for the webservice)

The code consists of two parts:
* a bin script (goes in ~/bin/)
* a config file (goes in ~/archives/ARCHIVEID/cfg/cfg.d/)

Run ~/bin/ethos to see usage

The following rules are used:
1) If an incoming thesis contains an institutionalReference (therefore has been harvested):
* A search is done on the reference
** If the eprint doesn't exist, no import is done.
** If the eprint exists and doesn't have an id_number, the id_number is added.
** If the eprint exists and the id_number matches the ethosId no import is done.
** If the eprint exists and the id_number doesn't match the ethosId, an error is reported.

2) If the incoming thesis does not have an institutionalReference, a search for the ethosId in the id_number field is conducted.
* If an eprint exists with that ethosId, no import is done.
* If the ethosId is not found, a new eprint is created. Files are downloaded, and added to the eprint. Any issues with the download are recorded in the 'suggestions' field.

The following fields are set in the EPrint:
* userid
* title
* date
* abstract
* id_number
* keywords
* creators_name
* thesis_type
* suggestions

@@ Line 1: / Line 1: @@
 The British Library EThOS service has a SOAP based webservice to allow institutions to pull digitized theses back from their collection.
-Some code is available [[http://files.eprints.org/778/ http://files.eprints.org/778/]] to pull the theses back from EThOS and to populate records that have been harvested by EThOS (via OAI-PMH) with their EThOS Ids.
+Some code is available http://files.eprints.org/778/ to pull the theses back from EThOS and to populate records that have been harvested by EThOS (via OAI-PMH) with their EThOS Ids.
 The eprints script uses:

@@ Line 1: / Line 1: @@
 The British Library EThOS service has a SOAP based webservice to allow institutions to pull digitized theses back from their collection.
-Some code is available [[http://files.eprints.org/778/]] to pull the theses back from EThOS and to populate records that have been harvested by EThOS (via OAI-PMH) with their EThOS Ids.
+Some code is available [[http://files.eprints.org/778/ http://files.eprints.org/778/]] to pull the theses back from EThOS and to populate records that have been harvested by EThOS (via OAI-PMH) with their EThOS Ids.
 The eprints script uses:

@@ Line 1: / Line 1: @@
 The British Library EThOS service has a SOAP based webservice to allow institutions to pull digitized theses back from their collection.
-Soon, some code will be released on files.eprints.org (it will be linked from here when available) to pull the theses back from EThOS and to populate records that have been harvested by EThOS (via OAI-PMH) with their EThOS Ids.
+Some code is available [[http://files.eprints.org/778/]] to pull the theses back from EThOS and to populate records that have been harvested by EThOS (via OAI-PMH) with their EThOS Ids.
 The eprints script uses:

@@ Line 36: / Line 36: @@
 The scripts were written based on the White Rose Etheses Online set up. This means the config file may seem a bit warped in it's structure - as it was designed to be able to cope with 3 institutions.
 == EThOS Identifiers ==
@@ Line 42: / Line 41: @@
 If you have ethos identifiers stored in your system in a different format, you will need to tweak the code to cope with your way of storing them.
 Any question/problems with the script, email the tech-list!

← Older revision		Revision as of 14:24, 28 June 2012
Line 37:		Line 37:
	The scripts were written based on the White Rose Etheses Online set up. This means the config file may seem a bit warped in it's structure - as it was designed to be able to cope with 3 institutions.		The scripts were written based on the White Rose Etheses Online set up. This means the config file may seem a bit warped in it's structure - as it was designed to be able to cope with 3 institutions.

		+
		+	== EThOS Identifiers ==
		+	EThOS identifiers are of the form: '''uk.bl.ethos.''xxxxx'''''.
		+	If you have ethos identifiers stored in your system in a different format, you will need to tweak the code to cope with your way of storing them.
	Any question/problems with the script, email the tech-list!		Any question/problems with the script, email the tech-list!

@@ Line 1: / Line 1: @@
 The British Library EThOS service has a SOAP based webservice to allow institutions to pull digitized theses back from their collection.
-The code uses:
 * SOAP::Lite (to make the calls to the webservice)
 * LWP (to download the Zip files)

← Older revision		Revision as of 14:18, 28 June 2012
Line 34:		Line 34:
	* thesis_type		* thesis_type
	* suggestions		* suggestions
		+
		+	The scripts were written based on the White Rose Etheses Online set up. This means the config file may seem a bit warped in it's structure - as it was designed to be able to cope with 3 institutions.
		+
		+	Any question/problems with the script, email the tech-list!