30 mins | Data Loader | Patty and Tod | Patty and Tod have put together a set of user stories for the data loader . They will be a presentation with discussion to follow: (feedback on this document is welcome) - Time was spent comparing data migration loader specs to batch loader specs for inventory because much of it is the same.
- After discussions it was decided (by Yakov ultimately) that the data migration loader & batch loader for inventory should be treated as the same thing. The only requirement that might have been different is performance. If the batch loader can meet that, the overlap is 100%.
- We need a set of rules to transform MARC into inventory - need a common way of specifying rules for batch and migration.
- Should be forming best practices and common strategies meaning...make the loading process uniform across data modules.
- Institutions migrating data will be required to produce a json document per record for data that needs to be migrated for each module other than inventory. This expectation can allow for commonalities across modules if it can always expect JSON.
- We should specify that when we load records, Folio will take care of getting the data into any module that needs it (MarcCat, Storage). For now this is just inventory.
- Action items for the data loader user stories:
- Possibly have Ann Marie attend our meeting?
- Work on the idea that for loading data, institutions will be responsible for getting their data into the json format...except for inventory.
- Have a single transformation for MARC schema for inventory
- The document should reflect that Folio will be responsible for getting data into all required modules via the data loader.
- Transformation is already a work in progress. See this spreadsheet. A POC has already been implemented. Ann successfully tested it.
|