Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date

Attendees 

...

Date

Attendees 

Discussion items

...

Julian Ladisch is next, followed by Ingolf Kuss (Julian and Ingolf have swapped)

Reminder:  Please copy/paste the Zoom chat into the notes.  If you miss it, this is saved along with the meeting recording, but having it here has benefits.

...

...

  • CC: Maccabee Levine
    • Continued discussion about AWS cost increases, especially due to Eureka.  ACRG will present at next CC meeting on 9/9.
    • Agenda(s) for CC and cross-council meetings at WOLFcon.
  • PC: Tod Olson
    • Discussion of module review process, moved out of pilot into accepted
  • RMS Group (today):
    • CSP release cadence: Release on demand (not fixed 2 week or 4 week cadence)
    • Stay on Spring Boot 3.3 for Ramsons
      • Upgrade to 3.4 in Sunflower. This means we'd be unsupported for some period of time. If we're lucky and there aren't any Critical/High security vulnerabilities in these frameworks, all is good. However, if there are, we would be in the position where now we need to get teams to drop what their doing and upgrade unexpectedly, backporting the changes to Ramsons. 
      • Upgrade Ramsons to 3.4 if there's a security vulnerability between 2025-05-23 (End of Support of Spring Boot 3.3) and Trillium release Q4 2025 (= End of Support of Ramsons); this results in a huge CSP and requires extensive testing
    • TC - review possibility to get enterprise support from Spring Framework

    • Reserve time in Trillium to upgrade to version 3.5

      • This requires (milestone or) release candidate versions of Spring Boot for FOLIO bug fest if Trillium bug fest starts November 2025 or earlier.
  • Security Team: 
    • ongoing triage of potential vulnerabilities
    • Jiras gets unembargoed when closed (when fixed or security group approves as not affected).
  • Tri-council Application Formalization:  
    • Discussion of impact of dual okapi/eureka envs on cost and what exit from okapi in community envs would require
    • Discussion of application spreadsheets created by Charlotte and Kirstin
    • Discussion of WolfCon session

...

  •  - Dedicated Discussion: Refine the OST process to ensure better coordination between SysOps and the TC
  •  - US holiday (regular TC meeting moved to Wed)
  •  - Regular TC Meeting
  •  - Regular TC Meeting
  •  - Dedicated discussion: Continuation of architectural decision-making discussion

...

  • mod-marc-migrations working on game plan
  • tcr-42 waiting on PC approval
  • tcr-45 moved to Ingolf Kuss via rotation

...

Technical Council Sub-Groups Updates

...

All

...

All

...

Reminder(s)

  • Review of open items, such as the need for decision log records and the application of the "Go" RFC.

...

Need to log decisions for the following:  (see above)

...

Officially Supported Technologies (OST)

...

Check Recurring Calendar

  • Spring Boot 3.4 (and Spring Framework 6.2)
    • Today RMS group has made the decision, see Liaison Updates section above.
  • Sunflower
    • The Spring Boot support period of 12 months for a single minor release has the same length as FOLIO's support period of ~ 12 months, however, these periods usually don't align.
    • Regarding Backend "First Party Libraries / Frameworks": A library/framework needs to support only one of the versions allowed in the "Third Party Libraries / Frameworks" list. This should be clarified in the description.
    • Adding folio-s3-client to first party libraries and the AWS and MinIO clients to third party libraries. folio-s3-client is an abstraction for the AWS and MinIO client.
    • Java 21
      • No objections from developers, the migration from 17 to 21 will be easy, simply bump the folio-java-docker in the Dockerfile and the jenkins-slave-docker image in the Jenkinsfile.
      • Need to contact DevOps whether they can provide a Java 21 version of folio-java-docker and jenkins-slave-docker before the Sunflower development starts; recent commits (folio-java-docker history, jenkins-slave-docker history) have been made by David Crossley, John Malconian and Julian Ladisch.

...

Status of this?

Hold until after Aug 2.

In the Sys Ops SIG meeting the topic of Reference Data Upgrades came up. The SIG thinks that the solution of this problem for mod-inventory-storage is not enough, but that this problem needs to be solved in a general way, for all modules.

Discussion items

TimeItemWhoNotes
1 minScribeAll

Julian Ladisch is next, followed by Ingolf Kuss (Julian and Ingolf have swapped)

Reminder:  Please copy/paste the Zoom chat into the notes.  If you miss it, this is saved along with the meeting recording, but having it here has benefits.

5-10 minLiaison Updates
  • CC: Maccabee Levine
    • Continued discussion about AWS cost increases, especially due to Eureka.  ACRG will present at next CC meeting on 9/9.
    • Agenda(s) for CC and cross-council meetings at WOLFcon.
  • PC: Tod Olson
    • Discussion of module review process, moved out of pilot into accepted
  • RMS Group (today):
    • CSP release cadence: Release on demand (not fixed 2 week or 4 week cadence)
    • Stay on Spring Boot 3.3 for Ramsons
      • Upgrade to 3.4 in Sunflower. This means we'd be unsupported for some period of time. If we're lucky and there aren't any Critical/High security vulnerabilities in these frameworks, all is good. However, if there are, we would be in the position where now we need to get teams to drop what their doing and upgrade unexpectedly, backporting the changes to Ramsons. 
      • Upgrade Ramsons to 3.4 if there's a security vulnerability between 2025-05-23 (End of Support of Spring Boot 3.3) and Trillium release Q4 2025 (= End of Support of Ramsons); this results in a huge CSP and requires extensive testing
    • TC - review possibility to get enterprise support from Spring Framework

    • Reserve time in Trillium to upgrade to version 3.5

      • This requires (milestone or) release candidate versions of Spring Boot for FOLIO bug fest if Trillium bug fest starts November 2025 or earlier.
  • Security Team: 
    • ongoing triage of potential vulnerabilities
    • Jiras gets unembargoed when closed (when fixed or security group approves as not affected).
  • Tri-council Application Formalization:  
    • Discussion of impact of dual okapi/eureka envs on cost and what exit from okapi in community envs would require
    • Discussion of application spreadsheets created by Charlotte and Kirstin
    • Discussion of WolfCon session
1 minUpcoming MeetingsAll
  •  - Dedicated Discussion: Refine the OST process to ensure better coordination between SysOps and the TC
  •  - US holiday (regular TC meeting moved to Wed)
  •  - Regular TC Meeting
  •  - Regular TC Meeting
  •  - Dedicated discussion: Continuation of architectural decision-making discussion
5 minTCR Board ReviewAll
  • mod-marc-migrations working on game plan
  • tcr-42 waiting on PC approval
  • tcr-45 moved to Ingolf Kuss via rotation
5 min

Technical Council Sub-Groups Updates

All


1 minRFCs

All

Reminder(s)

  • Review of open items, such as the need for decision log records and the application of the "Go" RFC.
1 minDecision LogAll

Need to log decisions for the following:  (see above)

25 min

Officially Supported Technologies (OST)

All

Check Recurring Calendar

  • Spring Boot 3.4 (and Spring Framework 6.2)
    • Today RMS group has made the decision, see Liaison Updates section above.
  • Sunflower
    • The Spring Boot support period of 12 months for a single minor release has the same length as FOLIO's support period of ~ 12 months, however, these periods usually don't align.
    • Regarding Backend "First Party Libraries / Frameworks": A library/framework needs to support only one of the versions allowed in the "Third Party Libraries / Frameworks" list. This should be clarified in the description.
    • Adding folio-s3-client to first party libraries and the AWS and MinIO clients to third party libraries. folio-s3-client is an abstraction for the AWS and MinIO client.
    • Java 21
      • No objections from developers, the migration from 17 to 21 will be easy, simply bump the folio-java-docker image in the Dockerfile and the jenkins-slave-docker image in the Jenkinsfile.
      • Need to contact DevOps whether they can provide a Java 21 version of folio-java-docker and jenkins-slave-docker before the Sunflower development starts; recent commits (folio-java-docker history, jenkins-slave-docker history) have been made by David Crossley, John Malconian, and Julian Ladisch.
Time PermittingReference Data Upgrade

There has been a long discussion 3-4 years ago about how FOLIO should handle reference data upon upgrades. See these links for background:


Previous Notes:

Background and Problem Statement

  • The issue at hand involves the handling of reference data during system upgrades. In previous upgrades, some institutions experienced data loss where customized reference data was overwritten by default settings during the upgrade process.
  • This problem was particularly highlighted in recent upgrade cycles, prompting a need for a more robust solution to preserve institution-specific customizations.

Existing Solutions and Approaches

  • Circulation Module Example:

    • The circulation module had addressed this issue by implementing a solution where reference data is only installed during the initial setup and skipped in subsequent upgrades unless new data is introduced in the upgrade. This approach prevents the overwriting of existing customized data.
    • The TC discussed whether this solution could be standardized and applied across other modules facing similar issues.
  • Challenges with Current Approach:

    • While the circulation module's solution is effective for preserving existing data, it does not account for scenarios where the reference data schema changes in new versions (e.g., adding new fields or making structural changes). In such cases, simply skipping the installation might not be sufficient, and more complex handling might be required.

Discussion Points

  • Standardization Across Modules:
    • The TC debated whether a similar approach should be mandated across all modules to ensure consistency and prevent data loss during upgrades. However, it was noted that this might require module-specific adjustments, depending on how each module manages its reference data.
  • Need for a Broader Solution:
    • There was recognition that a broader, more flexible solution might be necessary to handle various scenarios, such as changes in reference data structures. This could involve more sophisticated checks during the upgrade process to determine whether and how data should be updated or preserved.

Potential Actions

  • Subgroup Formation:
    • The idea of forming a new subgroup to focus on developing a comprehensive strategy for reference data handling during upgrades was floated. This subgroup could explore creating an RFC (Request for Comments) to propose a standardized approach across the project.
  • Review of Previous Work:
    • It was suggested that before moving forward, the TC should review previous efforts and discussions on this topic, including past proposals and proof-of-concept work that may have stalled due to resource constraints. This review would help ensure that any new efforts build on previous work rather than starting from scratch.

Next Steps

  • Further Discussion:
    • The TC agreed to revisit this discussion in the next meeting, with members encouraged to review past work and consider whether they are interested in participating in a potential subgroup. The goal would be to establish a clear path forward for managing reference data during upgrades across all modules.

Today:

  • ..A subgroup should be formed to make progress on this.
NAZoom Chat


17:01:56 Von Jenn Colt an Alle:
https://folio-org.atlassian.net/wiki/spaces/TC/pages/418742317/2024-08-26+Meeting+notes
17:23:01 Von Jenn Colt an Alle:
Maybe that’s the sales mechanism for enterprise support!
17:24:12 Von Julian Ladisch an Alle:
There's a 6 month overlap of two consecutive minor releases of Spring Boot: https://spring.io/projects/spring-boot#support
17:38:33 Von Craig McNally an Alle:
Thanks for clarifying @Taras
17:41:11 Von Taras an Alle:
This is
https://github.com/folio-org/folio-s3-client
17:50:48 Von Root, Jason M an Alle:
Inside Tamu Lib’s MinIO instance - no reference directly to S3 API versions. This is all I see:
Version2021-06-17T03:17:14Z
PlatformHost: minio-0 | OS: linux | Arch: amd64
RuntimeVersion: go1.16.5 | CPUs: 8
17:54:54 Von Julian Ladisch an Alle:
Jenkins slave docker: https://github.com/folio-org/folio-tools/tree/master/jenkins-slave-docker
17:55:40 Von Maccabee Levine an Alle:
I do see Jenkins referenced in what Index Data proposed to support. Details IDK. https://folio-org.atlassian.net/wiki/spaces/CC/pages/68321283/2024-03-11+Community+Council+Meeting+Notes

...