2025-03-05 Sys Ops & Management SIG Agenda and Meeting Notes
Translator
Date and time
Mar 5, 2025 12 EST
Zoom link
https://openlibraryfoundation.zoom.us/j/591934220?pwd=dXhuVFZoSllHU09qamZoZzZiTWhmQT09
Topics
Attendees
Time | Item | Who | Notes |
|
|---|---|---|---|---|
| Welcome |
| New face: David Noe: Library System Admin in Orlando - Actually early adopter in 2018 / Kuali OLE went to Chicago - no hopes for self-hosting - 1,5 Mio titles Currently running Sierra, for ten years Welcome to FOLIO SysOps ! |
|
| Migration to Postgres 16 Migration to Quesnelia mod-srs time outs Kafka Upgrades | Shelley | Migrated to Postgres 16 Upgraded to Quesnelia a lot of issues where it is slow mod-srs is getting time outs re-indexing the database ; then data import seems to be fixed Also Upgraded Kafka, but downgraded again; where have things been slow ? Kafka 3.1.1 (TAMU), Kafka 3.2 (Shelley) mod-source-record-storage is the bottle neck (Shelley); how many instances do you run this really slows down data import also scale source-record-manager db_max_pull_size = 10 a new env variable: db_connection_timeout Trent: Is "-Dsrs.record.matching.fallback-query.enable" in the JAVA_OPTIONS variable for your mod-source-record-storage workload? If set to true it could be slowing down the modules |
|
| Chat Log |
| Shelley Doljack 18:06 Doubtful this okapi is related to folio okapi… okapi_BM: https://en.wikipedia.org/wiki/Okapi_BM25 David Noe an Alle 18:18 https://folio-org.atlassian.net/wiki/spaces/FOLIJET/pages/441843733/Single+Server+Fresh+Install https://github.com/folio-org/eureka-platform-bootstrap/blob/master/README.md Shelley Doljack 18:36 https://github.com/sul-dlss/libsys-airflow Shelley Doljack 18:43 Here is the data import repo EBSCO now has that we are using with loading bibs and authority records: https://github.com/FOLIO-FSE/folio_data_import |
|
|
|
|
|
|
| Topics for next meetings |
| Next meeting in 4 weeks, on April 2nd. Tentative Topic: Shelley / Migration with Apache Airflow |
|