Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

TimeItemWhoNotes

Welcome
New face:
David Noe: Library System Admin in Orlando - Actually early adopter in 2018 / Kuali OLE
went to Chicago - no hopes for self-hosting - 1,5 Mio titles
Currently running Sierra, for ten years
Welcome to FOLIO SysOps !


Migration to Postgres 16

Migration to Quesnelia

mod-srs time outs

Kafka Upgrades

Shelley
Migrated to Postgres 16
Upgraded to Quesnelia
a lot of issues where it is slow
mod-srs is getting time outs
re-indexing the database ; then data import seems to be fixed
Also Upgraded Kafka, but downgraded again; where have things been slow ?
Kafka 3.1.1 (TAMU), Kafka 3.2 (Shelley)
mod-source-record-storage is the bottle neck (Shelley); how many instances do you run
this really slows down data import
also scale source-record-manager
db_max_pull_size = 10
a new env variable: db_connection_timeout
Trent:
Is "-Dsrs.record.matching.fallback-query.enable" in the JAVA_OPTIONS variable for your mod-source-record-storage workload? If set to true it could be slowing down the modules


Chat Log
Shelley Doljack 18:06
Doubtful this okapi is related to folio okapi… okapi_BM: https://en.wikipedia.org/wiki/Okapi_BM25
David Noe an Alle 18:18
Shelley Doljack 18:36
Shelley Doljack 18:43
Here is the data import repo EBSCO now has that we are using with loading bibs and authority records: https://github.com/FOLIO-FSE/folio_data_import







Topics for next meetings

Next meeting in 4 weeks, on March 5thApril 2nd.

Tentative Topic: Shelley / Migration with Apache Airflow


...