Batch Loading Collections into DSpace: Using Perl Scripts for Automation and Quality Control.

Saved in:
Bibliographic Details
Title: Batch Loading Collections into DSpace: Using Perl Scripts for Automation and Quality Control.
Authors: Walsh, Maureen P.1 walsh.260@osu.edu
Source: Information Technology & Libraries. Sep2010, Vol. 29 Issue 3, p117-127. 11p. 1 Black and White Photograph, 2 Diagrams, 1 Chart.
Subject Terms: *Information storage & retrieval systems, *Metadata, Batch processing, Perl (Computer program language), Quality control, Library storage centers, Table of contents (Documentation), Data quality, Workflow
Abstract: This paper describes batch loading workflows developed for the Knowledge Bank, The Ohio State University's institutional repository. In the five years since the inception of the repository approximately 80 percent of the items added to the Knowledge Bank, a DSpace repository, have been batch loaded. Most of the batch loads utilized Perl scripts to automate the process of importing metadata and content files. Custom Perl scripts were used to migrate data from spreadsheets or comma-separated values files into the DSpace archive directory format to build collections and tables of contents and to provide data quality control. Two projects are described to illustrate the process and workflows. [ABSTRACT FROM AUTHOR]
Copyright of Information Technology & Libraries is the property of American Library Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 52871761
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Batch Loading Collections into DSpace: Using Perl Scripts for Automation and Quality Control.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Walsh%2C+Maureen+P%2E%22">Walsh, Maureen P.</searchLink><relatesTo>1</relatesTo><i> walsh.260@osu.edu</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Information+Technology+%26+Libraries%22">Information Technology & Libraries</searchLink>. Sep2010, Vol. 29 Issue 3, p117-127. 11p. 1 Black and White Photograph, 2 Diagrams, 1 Chart.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Information+storage+%26+retrieval+systems%22">Information storage & retrieval systems</searchLink><br />*<searchLink fieldCode="DE" term="%22Metadata%22">Metadata</searchLink><br /><searchLink fieldCode="DE" term="%22Batch+processing%22">Batch processing</searchLink><br /><searchLink fieldCode="DE" term="%22Perl+%28Computer+program+language%29%22">Perl (Computer program language)</searchLink><br /><searchLink fieldCode="DE" term="%22Quality+control%22">Quality control</searchLink><br /><searchLink fieldCode="DE" term="%22Library+storage+centers%22">Library storage centers</searchLink><br /><searchLink fieldCode="DE" term="%22Table+of+contents+%28Documentation%29%22">Table of contents (Documentation)</searchLink><br /><searchLink fieldCode="DE" term="%22Data+quality%22">Data quality</searchLink><br /><searchLink fieldCode="DE" term="%22Workflow%22">Workflow</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This paper describes batch loading workflows developed for the Knowledge Bank, The Ohio State University's institutional repository. In the five years since the inception of the repository approximately 80 percent of the items added to the Knowledge Bank, a DSpace repository, have been batch loaded. Most of the batch loads utilized Perl scripts to automate the process of importing metadata and content files. Custom Perl scripts were used to migrate data from spreadsheets or comma-separated values files into the DSpace archive directory format to build collections and tables of contents and to provide data quality control. Two projects are described to illustrate the process and workflows. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Information Technology & Libraries is the property of American Library Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=52871761
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.6017/ital.v29i3.3137
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
        StartPage: 117
    Subjects:
      – SubjectFull: Information storage & retrieval systems
        Type: general
      – SubjectFull: Metadata
        Type: general
      – SubjectFull: Batch processing
        Type: general
      – SubjectFull: Perl (Computer program language)
        Type: general
      – SubjectFull: Quality control
        Type: general
      – SubjectFull: Library storage centers
        Type: general
      – SubjectFull: Table of contents (Documentation)
        Type: general
      – SubjectFull: Data quality
        Type: general
      – SubjectFull: Workflow
        Type: general
    Titles:
      – TitleFull: Batch Loading Collections into DSpace: Using Perl Scripts for Automation and Quality Control.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Walsh, Maureen P.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Text: Sep2010
              Type: published
              Y: 2010
          Identifiers:
            – Type: issn-print
              Value: 07309295
          Numbering:
            – Type: volume
              Value: 29
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Information Technology & Libraries
              Type: main
ResultId 1