/
2020-11-09 - Data Migration Subgroup Agenda and Notes

2020-11-09 - Data Migration Subgroup Agenda and Notes

Nov 09, 2020

Date

Nov 9, 2020

Attendees

  • @Dale Arntson

  • @Ann-Marie Breaux (Deactivated)

  • @Anne L. Highsmith

  • @Ingolf Kuss

  • @Jon Miller

  • @Tod Olson

  • @Darsi Rueda

  • @Catherine Smith

  • @Michelle Suranofsky

  • @Charlotte Whitt

  • @Jenn Colt

  • @Theodor Tolstoy (One-Group.se)

Meeting Link

  • https://zoom.us/j/204980147

  • password: folio-lsp

Discussion items

Time

Item

Who

Notes

Time

Item

Who

Notes

5

Welcome

Dale

Someone who hasn't done it in a while should take notes

55

Bulk APIs

various

We will discuss how far along  current plans have progressed to create bulk APIs for migration. Hopefully, Ian will be able to provide an update. Also, there was work done since the last meeting on https://folio-org.atlassian.net/browse/RMB-743 to allow API users to supply their own metadata for migration. Jon or Dale should be able to provide an update. We should discuss whether the current set of jiras cover all of the issues we need raise with regard to specifications for the bulk APIs. Finally, we can discuss progress and issues that people are having in performing their migrations.

 

Question / Things You would like to talk about

all

  • problem with permission (Ingolf); Superuser lacks permissions; can't delete an instance, can't create an item via the API DELETE /inventory/instances/$instanceId and POST /item-storage/items, respectively.

    • Group: Hidden permissions; Add permissions via the UI (if it is not hidden), use SQL script instead

  • Jon: Problems with Updating using JSONB fields. Postgres double the size on disk when you do an update.

    • Group: JSONB is not the answer to everything. Architectural change, can't change it within the next 2 month.

  • Theo reports a bug https://folio-org.atlassian.net/browse/MODSOURCE-194 and a blocking bock, https://folio-org.atlassian.net/browse/MODSOURCE-194 . It is about UTF-8 encoded characters and MARC records stored as text in JSONB fields.

 

Topics for next meeting

Dale

  • Developing of bulk APIs: What has been prioritized ? Review prioritization.

Action items

@Dale Arntson will set up a topic backlog page.

@Ian Walls will talk to Cate and Jakub and move forward on JIRAs

@Dale Arntson and @Ian Walls will work on document clean up together