2020-03-09 - Data Migration Subgroup Agenda and Notes

We will meet for a half-hour to hear updates the migration efforts of our members.

2020-02-26 Special Data Migration Meeting Notes

Jason brings up Kafka to integrate to mod-pub-sub. We hope Okapi will be taking on some of these functionalities; all messaging goes through Okapi. Jason pulls the business logics out of SRM and SRS and run their own modules and feed it into the message queue. They would like to see this been properly handled by the two modules (SRM & SRS) in the future. They have written their own modules and published them on github.com .  There's an umbrella issue: MODSOURCE-97 - Getting issue details... STATUS (Improving performance when retrieving MARC source records).

TAMU Folio modules we run on our K8s cluster for data migration/workflow engine:

• https://github.com/TAMULib/mod-data-migration
• https://github.com/TAMULib/mod-data-extractor
• https://github.com/TAMULib/mod-external-reference-resolver
• https://github.com/TAMULib/mod-workflow
• https://github.com/TAMULib/mod-camunda

hbz : goal is to have one client productive by the end of 2020. 100,000 bib records, 5,000 users, but only ~10 concurrent users. Slow growth of titles, ca. 50 publications per month. Currently they have SAP. It's a storage library. They need: codex search, organisations, import/export, courses; NOT needed: acq, erm, agreements, licenses, eUsage, local KB, eHoldings. - Ingolf works in a group, but currently, he is the only "technical/IT" person in that group. The group plans to write out a position for a sys admin. Hbz is also working in cooperation with GBV/VZG.  - Ingolf currently experiments with a docker network. Besides, he is running single servers for demos.

GBV:  currently no migration tasks in GBV

Charlotte: Inventory app mockups that’s planned to implement in the data export: https://drive.google.com/drive/folders/1nydDr2SgRM4djFVFSf7lZcMhuImZj6ay

OAI-PMH vs. Inventory. OAI-PMH will first take SRS. If that does not exist, it will take the inventory record and convert that to MARC. But this information might be old.

New PO for OAI-PMH: Anastasiia Zakharova