2020-11-09 - Data Migration Subgroup Agenda and Notes

Date

Attendees

Discussion items

TimeItemWhoNotes
5WelcomeDale

Someone who hasn't done it in a while should take notes

55Bulk APIsvarious

We will discuss how far along  current plans have progressed to create bulk APIs for migration. Hopefully, Ian will be able to provide an update. Also, there was work done since the last meeting on RMB-743 - Getting issue details... STATUS to allow API users to supply their own metadata for migration. Jon or Dale should be able to provide an update. We should discuss whether the current set of jiras cover all of the issues we need raise with regard to specifications for the bulk APIs. Finally, we can discuss progress and issues that people are having in performing their migrations.


Question / Things You would like to talk aboutall
  • problem with permission (Ingolf); Superuser lacks permissions; can't delete an instance, can't create an item via the API DELETE /inventory/instances/$instanceId and POST /item-storage/items, respectively.
    • Group: Hidden permissions; Add permissions via the UI (if it is not hidden), use SQL script instead
  • Jon: Problems with Updating using JSONB fields. Postgres double the size on disk when you do an update.
    • Group: JSONB is not the answer to everything. Architectural change, can't change it within the next 2 month.
  • Theo reports a bug MODSOURCE-194 - Getting issue details... STATUS and a blocking bock, MODSOURCE-194 - Getting issue details... STATUS . It is about UTF-8 encoded characters and MARC records stored as text in JSONB fields.

Topics for next meetingDale
  • Developing of bulk APIs: What has been prioritized ? Review prioritization.

Action items

Dale Arntson will set up a topic backlog page.

Ian Walls will talk to Cate and Jakub and move forward on JIRAs

Dale Arntson and Ian Walls will work on document clean up together