2020-06-29 - Data Migration Subgroup Agenda and Notes

2020-06-29 - Data Migration Subgroup Agenda and Notes

Date

Jun 29, 2020

Attendees

  • @Anne L. Highsmith

  • @Tod Olson

  • @Michelle Suranofsky

  • @Former user (Deleted)

  • @Jenn Colt

  • @patty.wanninger

  • @Ingolf Kuss

  • @Ann-Marie Breaux (Deactivated)

  • @Jon Miller

  • @Dale Arntson

Meeting Link

Discussion items

Time

Item

Who

Notes

Time

Item

Who

Notes

5

Welcome

Dale

Someone who hasn't done it in a while should take notes.

5

Migration experiences and issues

Various

Where are we with bulk API support for data migration? Let's discuss this, what still needs to be done, and why it is taking so long. Also, Theodor may be able to report for us on a test harness he hoped to create for bugfest to see if a migration procedure can be properly integrated, tested and supported, along with the rest of the automated testing that goes on.

Notes

Ingolf: We need to talk anbout documentation of import mechanisms. Need a central place to start with.

Where do we stand with the development of the features that we requested ?

  • If an Import fails, which record(s) were causing the problem ?

  • A Delete and an Update is missing

Jon reports memory issues. For Inventory bulk queries there is a Docker max memory as well as a Java JVM memory limit. Java hits an "outOfMemory" in Heap Space.

We need Streaming on all APIs to avoid these memory limits.

Here are the Features that are assigned to Ian: project = "UX Product" AND assignee = sekjal ORDER BY key ASC
Whoops - the URL: https://issues.folio.org/issues/?jql=project%20%3D%20%22UX%20Product%22%20AND%20assignee%20%3D%20sekjal%20ORDER%20BY%20key%20ASC

Dale will get in touch with Ian to report about the progress in development.

Action items

@Dale Arntson will call special meeting to discuss improvements to migration of open loan data.

@Dale Arntson will facilitate agenda creation using the slack channel.

@Dale Arntson will set up a topic backlog page.