/
Data Loader Subgroup: Scope

Data Loader Subgroup: Scope

Sep 20, 2018

In Scope: as of August 2018

  • Functionality:

    • Retrieving files? Probably not for v1; interim solution: retrieve manually

    • Staging area? Yes

    • Matching & dup rules? Yes

    • Parsing the MARC files? Yes

    • Create, Overlay/Update, Delete? Yes

    • Loading files? Yes

    • Outcomes of those loads? Yes

  • FOLIO Records Affected:

    • MARCcat Bibliographic Record? Yes, via stored MARC Bib Record

    • MARCcat Holdings Record? Yes, via stored MARC Holdings Record

    • MARCcat Authority Record? Yes, via stored MARC Authority Record

    • Inventory Instance? Yes, via stored MARC Bib Record

    • Inventory Holdings? Yes, via stored MARC Bib or Holdings Record

    • Inventory Items? Yes

    • Inventory Container? TBD

    • Orders? Yes

    • Invoices? Yes, via MARC Bib Records and EDIFACT

    • ERM? No

  • Types of Source Records:

    • MARC-21 files? Yes

      • Binary? Yes

      • XML? Yes

      • JSON? Probably not for v1

      • UTF-8/Unicode character set? Yes

      • MARC-8 character set? Probably not for v1; interim solution: convert to UTF-8 before loading 

    • EDIFACT Invoice files? Yes

    • Delimited/flat files? Yes, but lowest priority; interim solution: convert to MARC before loading 

    • Order API data? Not through Batch Loader; will be handled in a different way

  • Miscellaneous

    • Load single records into FOLIO: TBD (needs further discussion); interim solution: use Batch Loader, but something more lightweight in the future

Out of scope: 

  • Exporting records from FOLIO

  • Complete bib/holdings/item data migration from previous system (may use some aspects of Batch Loader,  but probably more CLI/JSON oriented and less UI-oriented than Batch Loader)