/
2025-03-05 Sys Ops & Management SIG Agenda and Meeting Notes

2025-03-05 Sys Ops & Management SIG Agenda and Meeting Notes

Owned by Ingolf Kuss
Last updated: Apr 17, 2025
Translator

Date and time

12 EST

https://openlibraryfoundation.zoom.us/j/591934220?pwd=dXhuVFZoSllHU09qamZoZzZiTWhmQT09

Topics


Attendees

TimeItemWhoNotes

Welcome
New face:
David Noe: Library System Admin in Orlando - Actually early adopter in 2018 / Kuali OLE
went to Chicago - no hopes for self-hosting - 1,5 Mio titles
Currently running Sierra, for ten years
Welcome to FOLIO SysOps !


Migration to Postgres 16

Migration to Quesnelia

mod-srs time outs

Kafka Upgrades

Shelley
Migrated to Postgres 16
Upgraded to Quesnelia
a lot of issues where it is slow
mod-srs is getting time outs
re-indexing the database ; then data import seems to be fixed
Also Upgraded Kafka, but downgraded again; where have things been slow ?
Kafka 3.1.1 (TAMU), Kafka 3.2 (Shelley)
mod-source-record-storage is the bottle neck (Shelley); how many instances do you run
this really slows down data import
also scale source-record-manager
db_max_pull_size = 10
a new env variable: db_connection_timeout
Trent:
Is "-Dsrs.record.matching.fallback-query.enable" in the JAVA_OPTIONS variable for your mod-source-record-storage workload? If set to true it could be slowing down the modules


Chat Log
Shelley Doljack 18:06
Doubtful this okapi is related to folio okapi… okapi_BM: https://en.wikipedia.org/wiki/Okapi_BM25
David Noe an Alle 18:18
Shelley Doljack 18:36
Shelley Doljack 18:43
Here is the data import repo EBSCO now has that we are using with loading bibs and authority records: https://github.com/FOLIO-FSE/folio_data_import







Topics for next meetings

Next meeting in 4 weeks, on April 2nd.

Tentative Topic: Shelley / Migration with Apache Airflow


Action items

  • Type your task here, using "@" to assign to a user and "//" to select a due date

Related content