mod-configuration has been discussed on the development channel recently. Developers like it because they can simply drop variables to the/configurations/entriesAPI. Simply use the "configuration.*" permission shared by all modules and you are done. No need to add schema validation, no need to add dedicated permissions, no need to add a dedicated API. Drawbacks:
A big institution need config write permissions with module granularity. One member of staff may be allowed to edit circulation config but not acquisition config.
No validation. mod-configuration cannot validate a POST or PUT request because it doesn't know. Only the module it belong to knows this. Relevant use case: Using curl/wget/postman/...
No documentation. mod-configuration has no documentation, one needs to search, maybe the module's README has some? A dedicated module API always publishes the API documentation athttps://dev.folio.org/reference/api/
Performance. Requests to mod-configuration result in latency. If the config API belongs to the module the module can cache it and can invalidate the cache if the config is changed. Caching requests to mod-configuration will always result in a time period with outdated values. In mod-inventory-storage we've combined fetching the HRID config and HRID generation into a single SQL query.
Coupling. Modules should be loosely coupled and therefore each module should store its own configs.
It was requested that a formalRFC/Architecture Decision Recordbeen created if mod-configuration should no longer been used for module-specific configurations.
Team decided we want to have this as a RFC. Target should be to have this implemented within Nolana. Could discuss in your meetings while the RFC process moves on.
TC was asked to weigh in... is now looking for a champion or someone to sponsor the writing of an RFC... (sound familiar? )
0 min
Kafka security
Team
The topic of Kafka security was raised as part of a conversation at the TC yesterday.
The Security Team should be aware of this and probably should weigh in on the topic, or even generate proposals if we have ideas for how to solve the problem.
User Story: FOLIO-3584SPIKE - investigate OWASP Zed Attack Proxy (ZAP)
Progress on FOLIO-3584?
Skott ran a scan against MG Bugfest
Skott Klebe and Craig McNally to review results... weed out false positives, then bring results to next week's meeting.
Scan stopped at 95% (OOM issue in Firefox)
Any other features/stories we want to create?
Not related to OWASP, but I think Skott Klebe suggested that our SNYK could be tuned/adjusted to better suit our needs.
Maybe make the Epic more generic – "Security Fitness Functions" or Create another epic to track the non-OWASP stuff?
SNYK
Should define JIRAs
Spike to investigate how we can tune snyk to better suit our needs – Craig McNally to create this.
Provided some background/history about SNYK in the FOLIO community
Stripes architecture reviews dependencies every other flower release (1-2x/year)
Currently only looking at platform level (with package.json/lock files)
Avoids a lot of the dev/peer dependency false alarms
Today:
5 min
Cumulative upload problem
Team
Regarding file upload size issues (SeeFOLIO-3317-Spike - investigate possible file upload vulnerabilityOPEN), let's brainstorm ideas for mitigating the cumulative upload problem, not just the large file upload size problem.
Some APIs are more vulnerable to this than others, such as those not protected by permissions - e.g. mod-login, edge APIs, etc.
Axel provided some background/context. We still need to give this some thought and possibly suggest a solution
Use case 1: Some script unintentionally sends endless data to some API. This is caught by a maximum upload size.
Use case 2: Denial of service. Difficult to address in Okapi. Might be better handled in other tools like nginx or firewalls that can limit requests. Unlikely that a denial of service attack has a valid login / access token.
TODO: For use case 2: Only add documentation that implementers should use an external firewall (or external nginx) to limit requests.
Some investigation is required, let's capture this in a spike (JIRA).
Axel Dörrer to help define this. – Started, not finished yet.
We can review together and find someone to work on this... maybe have a champion on this team work with someone in the Sys-ops SIG/community.
I've added versions for the Spring components to theOfficially Supported Technologies list. For Orchid it's easy:https://wiki.folio.org/display/TC/OrchidFor Nolana it's more complicated:https://wiki.folio.org/display/TC/NolanaThe OSS support of several Spring components ends in May 2023. This is more than three months before the end of the Nolana support period that end in August or September 2023. The next minor version of those Spring components will be released in November 2022, this is during Nolana bug fest. We need to bump to this next minor version and release a bug fix for all affected FOLIO Spring libraries and FOLIO modules in November 2022.Running unsupported Spring components is a security risk. If there is a security issue in asupportedSpring component we simply can bump the patch version, no risk. If there is a security issue in anunsupportedSpring component we don't get notified because it's unsupported, and if we know of an issue we need to bump the minor version, this comes with some risk. Bumping the minor version as early as possible gives more testing time and is less risky. We can discuss this today.
How do we want to approach this?
Consult the Spring Force team... Is this feasible? Do you have better suggestions?
Craig McNally to post in #folio-spring-base, at-mentioning Petrenko.
How do we communicate this out?
Coordinate with the release manager (Oleksii Petrenko)
How much work is expected to be required?
Craig McNally to follow up with Oleksii P. again to see if the team has discussed this yet.
Met with Oleksii P. and Spring-force. They're onboard with this proposal and will take it from here.
There are complications with this... conversations in #folio-spring-base:
Spring Boot 2.7 has extended OSS support until 2023-11-18, this completely covers the Nolana support period (~ August 2023), no need to switch to Spring Boot 3, but see below
However, folio-spring-base also uses Spring Cloud, and other Spring way modules also use other Spring components without extended OSS support
Spring Cloud 3.1 support ends 2023-05-18, this is at least three months before the end of the Nolana support period around August 2023.
Spring Cloud 4.0 GA release will be in November 2022.
Spring Force team has agreed that Milestone versions can be used. These need to be replaced by the GA version. Nolana GA release will be in December 2022.
Only recently (2022-10-04) Spring Force noticed that Spring Cloud 4 requires Java 17 and only (officially) supports Spring Boot 3.
Also introduced the topic at the Technical Council meeting yesterday but ran out of time. The TC will discuss more in slack and if necessary at next week's TC meeting.
Last week it was decided that the Spring Upgrade (Spring Boot from 2.7 to 3, Spring Cloud from 3.1 to 4) and the Java Upgrade from 11 to 17 is postponed to Orchid; and:
Two options that need to be discussed in January 2023
Limit support of Nolana release up to May 2023
Backport of Orchid spring-based changes to Nolana HF
Today:
Postpone for now – at some point we need to check in with spring-force to see how things are going