2019-06-10 - Data Migration Subgroup Agenda and Notes

We will follow up on the presentation last week by Ann-Marie and Ann on the SRS data loader, and discuss the ways in which this work is relevant to our needs for migrating our institutional data. Ann and Jason may also have an update on their experience with getting the data loader CLI to work.

We reviewed the Copy of Capacity Planning vi. https://docs.google.com/spreadsheets/d/1vxytV2ctbxjXnUpMnogMU0XVWFa3iqGRgLdCLNPmvME/edit#gid=1252979472

3 items from Data Migration is in Red. Not in Ann Marie’s product Ownership. Own mapping rather than default mapping. They will probably be doing relevant work but we will want to submit it. Harry mentioned Ann Marie’s team will do it but …. We are moving forward though—testing, iterating loads, etc. Inventory is a big sticking point so far, people don’t know how to do the marc mapping. There won’t be any configurable mapping for a while. There is a simple UI. But we need to load a JSON map. UI is to tweak the Marc. If there is a UI, then there is an API. May be possible to customize the JSON record that gets created.

• Feels like it is in the pipeline to get addressed.

Dale will share some code he has that could be used to load inventory data.

Tech Council has this basic issue as a top priority as technical debt and it will be discussed in depth at Folio Day. 

Let’s assume Q3 dev cycle assignment and they will come to use to gain clarity. In the meantime, do we need a wiki for data migration? Should we be creating a Q&A how to do it resources pages until we get a formal documentation process? On what we can migrate right now step by step would be helpful. What are capable of handling for data formats.

Patty referenced the Record Update Testing Log spreadsheet. People appear to be using the User endpoint. It is showing how people are doing things but it is hard to find.   https://docs.google.com/spreadsheets/d/1Q3TtDtOaYYYdoH3JyzQasmVyvMmHZ9CbcW5-0UIX9Pk/edit#gid=1935814460 This document can help have benchmarks come to light.

bulk loading functionality story: https://issues.folio.org/browse/MODUSERS-3?jql=labels%20%3D%20migration-load

We should have a page “where to start and how” linked from the Data Migration Wiki page. Dale will add the links to the resources he has. Since we are a sub-group, Patty proposes this page have its own side bar navigation to make it easier to find.

• Latin group has a Katmandu tool to load data and posting info about this would be helpful.
• The implementation group could own supporting where to find resources. Point new implementers to that page –Patty suggests. “The implementation group is having trouble finding its feet”

Tod will first confirm that the Data Migration sessions will be Zoomed. If not, Dale will send note from SysOps to Confirm that the Data Migration will need a Zoom link. 

Next week is face to face only. And following week, will do a debriefing with follow up discussion. Please link your migration activities to the Record Update Testing Log spreadsheet.

(please correct anything that needs it.--Jackie)