Date
Attendees
- Craig McNally
- Ingolf Kuss
- Tod Olson
- Jeremy Huff
- Jenn Colt
- Julian Ladisch
- Maccabee Levine
- Patrick Pace (Unlicensed)
- VBar
- Taras Spashchenko
Discussion items
...
Jenn Colt is next, followed by Florian Gleixner
Reminder: Please copy/paste the Zoom chat into the notes. If you miss it, this is saved along with the meeting recording, but having it here has benefits.
...
...
- CC: Maccabee Levine
- No CC meeting today
- PC: Tod Olson
- Continued discussion on supporting Roadmap, prioritization process, etc.
- RMS Group:
- No meeting this week
- Security Team:
- No update
- Tri-council Application Formalization:
- No meeting last week, meet this week
...
- - Dedicated Discussion: Architectural decision making
- - Regular TC Meeting
- - Dedicated Discussion: Refine the OST process to ensure better coordination between SysOps and the TC
- - Regular TC Meeting
...
- mod-marc-migrations working on game plan
- tcr-42 waiting on PC approval
- tcr-45 assigned for now to Marc Johnson
...
Technical Council Sub-Groups Updates
...
All
...
- static code analysis
- discussion of scope - needed clarification on remit of the group, change name? automated testing vs code analysis, code coverage
- review sonar cloud settings and make recommendations for other tools
- make docs less sonar cloud centric has been worked on
- group decided need TC's opinion about scope of group
- original description doesn't mention automated testing
- goal was to make it less about sonar cloud
- should test coverage be separate group?
- coverage can be mentioned as something that needs to be measured by whatever tool is used but don't go beyond that
- the group should not expand its scope
...
All
...
Reminder(s)
- Review of open items, such as the need for decision log records and the application of the "Go" RFC.
...
Need to log decisions for the following: (see above)
- Discussions on the necessity of a Wednesday meeting to address the OST process and involvement of Sysops.
...
Officially Supported Technologies (OST)
...
Check Recurring Calendar
- Discuss message in #tech-council from Julian Ladisch...
- ...
...
Hold until after Aug 2.
In the Sys Ops SIG meeting the topic of Reference Data Upgrades came up. The SIG thinks that the solution of this problem for mod-inventory-storage is not enough, but that this problem needs to be solved in a general way, for all modules.
There has been a long discussion 3-4 years ago about how FOLIO should handle reference data upon upgrades. See these links for background:
- Original problem statement
- Input from SysOps SIG
- Proposals considered by Tech Council working group
- Recommendation from Tech Council working group
Previous Notes:
Background and Problem Statement
- The issue at hand involves the handling of reference data during system upgrades. In previous upgrades, some institutions experienced data loss where customized reference data was overwritten by default settings during the upgrade process.
- This problem was particularly highlighted in recent upgrade cycles, prompting a need for a more robust solution to preserve institution-specific customizations.
Existing Solutions and Approaches
Circulation Module Example:
- The circulation module had addressed this issue by implementing a solution where reference data is only installed during the initial setup and skipped in subsequent upgrades unless new data is introduced in the upgrade. This approach prevents the overwriting of existing customized data.
- The TC discussed whether this solution could be standardized and applied across other modules facing similar issues.
Challenges with Current Approach:
- While the circulation module's solution is effective for preserving existing data, it does not account for scenarios where the reference data schema changes in new versions (e.g., adding new fields or making structural changes). In such cases, simply skipping the installation might not be sufficient, and more complex handling might be required.
Discussion Points
- Standardization Across Modules:
- The TC debated whether a similar approach should be mandated across all modules to ensure consistency and prevent data loss during upgrades. However, it was noted that this might require module-specific adjustments, depending on how each module manages its reference data.
- Need for a Broader Solution:
- There was recognition that a broader, more flexible solution might be necessary to handle various scenarios, such as changes in reference data structures. This could involve more sophisticated checks during the upgrade process to determine whether and how data should be updated or preserved.
Potential Actions
- Subgroup Formation:
- The idea of forming a new subgroup to focus on developing a comprehensive strategy for reference data handling during upgrades was floated. This subgroup could explore creating an RFC (Request for Comments) to propose a standardized approach across the project.
- Review of Previous Work:
- It was suggested that before moving forward, the TC should review previous efforts and discussions on this topic, including past proposals and proof-of-concept work that may have stalled due to resource constraints. This review would help ensure that any new efforts build on previous work rather than starting from scratch.
Next Steps
- Further Discussion:
- The TC agreed to revisit this discussion in the next meeting, with members encouraged to review past work and consider whether they are interested in participating in a potential subgroup. The goal would be to establish a clear path forward for managing reference data during upgrades across all modules.
Today:
- ...
...
Date
Attendees
- Craig McNally
- Ingolf Kuss
- Tod Olson
- Jeremy Huff
- Jenn Colt
- Julian Ladisch
- Maccabee Levine
- Patrick Pace (Unlicensed)
- VBar
- Taras Spashchenko
- Jakub Skoczen
Discussion items
Time | Item | Who | Notes |
---|---|---|---|
1 min | Scribe | All | Jenn Colt is next, followed by Florian Gleixner Reminder: Please copy/paste the Zoom chat into the notes. If you miss it, this is saved along with the meeting recording, but having it here has benefits. |
5-10 min | Liaison Updates |
| |
1 min | Upcoming Meetings | All |
|
5-15 min | TCR Board Review | All |
|
5-15 min | Technical Council Sub-Groups Updates | All |
|
1 min | RFCs | All | Reminder(s)
|
1 min | Decision Log | All | Need to log decisions for the following: (see above)
|
< 5 min | All | Check Recurring Calendar
| |
Time Permitting | Reference Data Upgrade | Hold until after Aug 2. In the Sys Ops SIG meeting the topic of Reference Data Upgrades came up. The SIG thinks that the solution of this problem for mod-inventory-storage is not enough, but that this problem needs to be solved in a general way, for all modules. There has been a long discussion 3-4 years ago about how FOLIO should handle reference data upon upgrades. See these links for background:
Previous Notes: Background and Problem Statement
Existing Solutions and Approaches
Discussion Points
Potential Actions
Next Steps
Today:
| |
NA | Zoom Chat | 11:06:26 From Jenn Colt to Everyone: We agreed to the single 11:07:35 From Maccabee Levine to Everyone: Reacted to "We agreed to the sin..." with 👍🏻 11:16:41 From Julian Ladisch to Everyone: Remove "static" from the group name and the group goals. 11:16:55 From Huff, Jeremy T to Everyone: Reacted to "Remove "static" from..." with 🤔 11:27:59 From Julian Ladisch to Everyone: Does the TC agree to extend the scope of the group, or should we split off the test coverage and testing topic into a separate group? 11:39:50 From Maccabee Levine to Everyone: BugFest is Nov 11-29. 3.4.x initial release is 11/21. So right in the middle. https://folio-org.atlassian.net/wiki/spaces/REL/pages/5210877/Ramsons+R2+2024 11:41:39 From Craig McNally to Everyone: Reacted to "BugFest is Nov 11-29..." with 👍 11:45:10 From Marc Johnson to Everyone: Thanks Taras, that’s what I was trying to understand 11:48:16 From Jenn Colt to Everyone: Should we change release date? 11:50:12 From Patrick Pace to Everyone: I'm headed out for another meeting 11:52:23 From Julian Ladisch to Everyone: I don't think that we should change the release date. The option like upgrading in CSP is good enough. 11:54:02 From Julian Ladisch to Everyone: https://folio-org.atlassian.net/wiki/spaces/FOLIJET/pages/393150471/DRAFT+Migration+to+Spring+Boot+3.4+How+to 11:56:30 From Jakub Skoczen to Everyone: @Craig McNally the next one is on the 26th |
Topic Backlog | ||
Decision Log Review | All | Review decisions that are in progress. Can any of them be accepted? rejected? |
Translation Subgroup | All | Since we're having trouble finding volunteers for a subgroup, maybe we can make progress during a dedicated discussion session? |
Communicating Breaking Changes | All | Currently there is a PoC, developed by Maccabee Levine, of a utility to catalog Github PRs that have been labeled with the "breaking change" label. We would like to get developer feedback on the feasibility of this label being used more often, and the usefulness of this utility. |
Officially Supported Technologies - Upkeep | All | Previous Notes:
Stripes architecture group has some questions about the Poppy release. Zak: A handshake between developers, dev ops and the TC. Who makes that decision and how do we pass along that knowledge ? E.g. changes in Nodes and in the UI boxes. How to communicate this ? We have a large number of teams, all have to be aware of it. TC should be alerted that changes are happening. We have a couple of dedicated channels for that. Most dev ops have subscribed to these channels. How can dev ops folk raise issues to the next level of community awareness ? There hasn't been a specific piece of TC to move that along. Craig: There is a fourth group, "Capacity Planning" or "Release Planning". Slack is the de facto communication channel. There are no objections to using Slack. An example is the Java 17 RFC. Craig: The TC gets it on the agenda and we will discuss it. The TC gets the final say. Marc Johnson: We shouldn’t use the DevOps Channel. The dev ops folks have made it clear that it should only be used for support requests made to them. Jakub: Our responsibility is to avoid piling up technical debt. Marc: Some set of people have to actually make the call. Who lowers the chequered flag ? Craig: It needs to ultimately come to the TC at least for awareness. There is a missing piece. Capacity Planning needs to provide input here. Marc: Stakeholders / Capacity Planning could make that decision. Who makes the decision ? Is it the government or is it some parts of the body ? Marc: the developers community, the dev ops community and sys ops are involved. For example the Spring Framework discussion or the Java 17 discussion. But it was completely separate to the TC decision. It is a coordination and communication effort. Marc: Maybe the TC needs to let go that they are the decision makers so that they be a moderating group. Jakub: I agree with Marc. But we are not a system operating group. Dependency management should be in the responsibility of Release management. There are structures in the project for that. Jason Root: I agree with Jakub and with Marc also. Policies should drive operational/release/support aspects of Folio. Jason Root: If the idea of “support” is that frameworks are supported, then of course the project should meet that. Marc Johnson Craig: This is a topic for the next Monday session. Craig to see if Oleksii Petrenko could join us to discuss the process for updating the officially supported technologies lists. |
Dev Documentation Visibility | All | Possible topic/activity for a Wednesday session: Discuss/brainstorm:
|
API linting within our backend modules | All | https://folio-project.slack.com/archives/CAQ7L02PP/p1713343461518409 |
PR Templates | All | https://folio-project.slack.com/archives/CAQ7L02PP/p1713445649504769 Hello team, Small request to consider. Regarding pr templates.
What I suggest is that, pr template shouldn't be any instructions, because most developer who are creating pr have already understand the rules. If we put just two section into template, it will encourage developers to write more about their work and that lead to knowledge sharing among developers. |
Java 21 | All | https://folio-project.slack.com/archives/CAQ7L02PP/p1713445764285349 Is Tech Council considering to update to java 21, I head good things from Netflix engineering teams about Garbage collector |
Proposed Mod Kafka | All | https://folio-project.slack.com/archives/CAQ7L02PP/p1714471592534689 Mike Taylor Proposal. If and only if a FOLIO instance is running Kafka, it should insert and enable a module called mod-kafka, which consists entirely of a module descriptor that says it provides the interface kafka. The purpose is so that other modules can use the standard <IfInterface> and similar tools to determine whether they should attempt Kafka operations. Rationale: the FOLIO ILS depends absolutely on Kafka, but other uses of the platform will not. One such example: a dev platform that includes only mod-users, used as a source of change events for Metadb. |
...