Data Loader Subgroup: Scope

Owned by Ann-Marie Breaux (Deactivated)
Last updated: Sep 20, 2018

In Scope: as of August 2018

  • Functionality:
    • Retrieving files? Probably not for v1; interim solution: retrieve manually
    • Staging area? Yes
    • Matching & dup rules? Yes
    • Parsing the MARC files? Yes
    • Create, Overlay/Update, Delete? Yes
    • Loading files? Yes
    • Outcomes of those loads? Yes

  • FOLIO Records Affected:
    • MARCcat Bibliographic Record? Yes, via stored MARC Bib Record
    • MARCcat Holdings Record? Yes, via stored MARC Holdings Record
    • MARCcat Authority Record? Yes, via stored MARC Authority Record
    • Inventory Instance? Yes, via stored MARC Bib Record
    • Inventory Holdings? Yes, via stored MARC Bib or Holdings Record
    • Inventory Items? Yes
    • Inventory Container? TBD
    • Orders? Yes
    • Invoices? Yes, via MARC Bib Records and EDIFACT
    • ERM? No

  • Types of Source Records:
    • MARC-21 files? Yes
      • Binary? Yes
      • XML? Yes
      • JSON? Probably not for v1
      • UTF-8/Unicode character set? Yes
      • MARC-8 character set? Probably not for v1; interim solution: convert to UTF-8 before loading 
    • EDIFACT Invoice files? Yes
    • Delimited/flat files? Yes, but lowest priority; interim solution: convert to MARC before loading 
    • Order API data? Not through Batch Loader; will be handled in a different way

  • Miscellaneous
    • Load single records into FOLIO: TBD (needs further discussion); interim solution: use Batch Loader, but something more lightweight in the future

Out of scope: 

  • Exporting records from FOLIO
  • Complete bib/holdings/item data migration from previous system (may use some aspects of Batch Loader,  but probably more CLI/JSON oriented and less UI-oriented than Batch Loader)