Time | Item | Who | Notes |
---|
60 min | Eureka Adoption | All | Notes | Expand |
---|
|
|
Notes:
Image Removed
Jenn Colt: Community will not be able to run a bugfest
Marc Johnson: bugfests need capacity for people to do the testing, and this would cause double work
Wayne Schneider: do we already have bugfests for the two platforms
Craig McNally: yes
Jenn Colt: bugfixing has to done for the two platforms, and do functional tests have to be done in both platforms?
Ingolf Kuss: do we have resources for two platforms in devops/bugfest?
Craig McNally: CSPs documentation says, that bugs shall be fixed in current and the 2 releases before
Marc Johnson: in reality: the last two generally available releases.
Wayne Schneider: is this document (table above) a proposal the TC wants to decide to?
Craig McNally / Marc Johnson: Just a idea to start discussion
Jenn Colt: Is this Ebscos timeline
Craig McNally: will check
Ingolf Kuss: Difference between CSP and bugfixes
Jenn Colt and Marc Johnson: Does the community commit to support Okapi or will the community switch to Eureka due to lack of possibility to support Okapi further?
Marc Johnson: Will bug reports will be accepted, if the reproduction is only done in one of the platforms?
Marc Johnson: Developers and implementers need to get kickstarted for Eureka
Craig McNally: Early adopters already committed - knowledge spreads
Wayne Schneider: different people and groups are trying to get involved with Eureka already
Marc Johnson: what information does the community need for a decision in the tri-council in january to be able to commit to the plan to be Eureca-centric for sunflower.
Jenn Colt: If something goes wrong and Eureka will not work, then the decision has to be rethinked.
Craig McNally: How could proposals for decisions look at?
Jenn Colt: All energy goes to Eureka or we try to support both for a transition time.
Mark Veksler: Community could help enhancing development documentation
Marc Johnson: Investment will be lower when we only have to support one platform
Craig McNally: Benefits also from external managed parts like keycloak and kong
Mark Veksler: Do we all agree, that Eureka is the right way, and are we talking about timing? And can Maccabee Levine or others help on developer documentation?
Craig McNally and Jenn Colt will outline a proposal - we will need another discussion.
Wayne Schneider: do we need CSPs or do we provide CSPs for Sunflower with Okapi?
_____
Craig: What happens if the adoption gets pushed further to another FOLIO release?
List of modules for an RFC? - impressive list
Julian:
2 decisions here: Do we adopt for Sunflower even though it's technically past that deadline? The approved technology stack is already approved for Sunflower.
Is there an overlap period for supporting both Okapi/Eureka?
SSO/login modules have completely changed in Eureka.
Marc Johnson:
Does the community approve adopting Eureka in the first place?
Do we have a special process for this?
Points out Ebsco is a large contributor to the community technically
The assumption - At some point if Eureka is adopted by the community at large, is it a given that Okapi envs will stop being supported by the community at large?
There are a set of decisions that need to be made - Community support? Adoption? Need a transition plan? How do we structure these decisions?
Multiple options on the table:
Support Eureka and Eureka only from Sunflower.
Combined support from Sunflower until a future release.
Support Okapi for more long term with transition plan
Next steps? Experience in early adopter program?
Craig:
There are cost implications for supporting both Okapi/Eureka.
Several back-end modules for login no longer needed in Eureka.
Over time less code that needs to be maintained, management users and tokens handled at a higher level.
Concrete action items for next meeting?
Jen:
Isn't the community technically supporting both platforms at the moment?
We are making a decision for the whole community here..
Is it true that development is supported with Okapi on Sunflower? Or after?
Is the early adopter program an actual program?
Vince:
Lots of effort to test both environments.
Development could shift to primarily Eureka environments in Rancher.
New modules have a different workflows, and a different permissions model on the management level.
New development is being done on Eureka, if it needs to be tested on Okapi - but who would be addressing these issues? Another way is not to do that, and support the other way around.
Jason:
Putting the cart before the horse - still need to vote on adoption or not.
Asks about what development resources would be shifted or different with Okapi vs Eureka.
We need to decide if there's a transition plan, because some have stated you can just run on Okapi as a fall-back?
Who in the community would support this? Not many outside of Ebsco who have exp. with running the platform right now..
Kristin:
Needs to be able to organize their platform upgrades/transitions.
Points out that this platform is currently only running on AWS infra - no other "local" or "non-AWS" examples out there.
Will Eureka be supported for local installations? Adoption needs to be planned securely and sustainably.
Needs to be vetted for local installations by the community.
Mark V:
The more people that start getting involved in the early adoption, the better off we'll be.
...
(More notes to come after I review the recording, hard to keep up with the convo...)
Overall chicken in egg scenario: Community is blocked on adoption until TC agrees, but community doesn't have experience to help in deciding to adopt or to support.
Craig, Mark and Vince will come up with narrowed options based on discussion.
Today:
Follow up on action items from last week...- Craig: A list of new components has been added to the Eureka RFC. See 0010-eureka#New-Components
- Jenn: Draft of the proposal?
- Marc: Fill in notes from meeting recording
Adopting Eureka for Sunflower means that the new Eureka modules get accepted even if the there's not enuogh time for the module acceptance workflow.Adopting Eureka means that platform-complete is not longer needed and gets replaced by application descriptors.The folio-keycloak is based on the keycloak docker images and adds customization for FOLIO; the same for folio-kong.Where is documentation for https://github.com/folio-org/mod-scheduler ?A complete documentation won't be in place for Sunflower, but this is acceptable for adoption of Eureka.The RFC lists all new modules needed for Eureka.Regarding the Tri-Council-Meeting: The chairs will meet a week before and plan how the meeting will run.Draft report on adoption and timeline of the Eureka platformThe shift from Okapi to Eureka is probably the most important decision for FOLIO (apart from human readable IDs).The report should be less opiniated than the RFC but can link to the RFC for details.What is needed to make the Eureka decision? What is needed after the decision?- Support for hosting (operational support) and for development teams.
- The Christmas break doesn't allow to get substantial additional information before the decision in the tri-council meeting.
Jenn will expand the reportReport on the timeline for adoption of the Eureka platform
| Notes |
| - Jenn Colt Discussed proposal document with tri-council co-chairs meeting. They thought yes/no question was unnecessary, go right to timeline for Eureka official and Okapi end of support. Although not setting a timeline is also a no.
- Marc Johnson We should document if that's what we've done, i.e. that the decision has been made. Understand the timeline framing, and why people think no-adoption is not viable. But that makes timeline equally pointless to discuss, if chairs already have that sense from the community. Chairs need to figure how we document that.
- Jenn Colt We can attribute it to the FOLIO chairs.
- Craig McNally Add that to this document.
- Maccabee Levine Deciding 'yes' still doesn't answer the 'how' part, which is what the single RFC addresses.
- Marc Johnson Disagree. If we frame this doc as a decision, then the "what" and "how" of technical architecture, all of that stuff is a waste of time to discuss with RFC process and debates, in any of the councils. The purpose of going through and RFC is to provide feedback to the folks making the proposal to make changes, then to decide whether to adopt. If underlying assumption is that community is adopting this and the question is when, then there is no value in talking about the 'how' or what components. Except as a learning / sharing knowledge exercise, good to do, but addressed through different mechanisms that EBSCO is already doing (i.e. documentation efforts and early adopter programs). Maybe also room for feedback on potential changes in the future, but that's not a timely matter, can come later.
- Jenn Colt One thing is that TC is providing a service to the other councils. RFC question may be internal to the TC if the community says "yes and aiming for particular release." So may be for us but not answered at tri-council level.
- Marc Johnson Agree with Jenn. Impact of tri-council decision can be discussed at each council. But no value to discussing RFC etc. until after tri-council meeting. Should remove any 'if' references from this doc, except the RFC providing info that's not available elsewhere. So RFC not part of decision-making process, but to fill in gaps.
- Jenn Colt did restructure doc to focus on the timeline aspect.
- Tod Olson Constraining the timeline makes sense. Only two options I see are to target Sunflower or Trillium as when Eureka becomes the primary.
- Jenn Colt In the doc: assumption is that EBSCO will shift in Sunflower. In order for the community to transition as well, here are the requirements. Folks have added detail. Option 2 is that if the community can't shift in Sunflower, other high-level requirements need to be met. Could be specific that the second option is Trillium.
- Tod Olson Didn't mean to say frame as a choice of Sunflower or Trillium. Personally think we should be bullish. But if Sunflower can't make it, Trillium would have to be the hard deadline.
- Jenn Colt We have no control over release management. Sunflower will probably be postponed as Ramsons was, but we have no say.
- Marc Johnson With 'if' off the table, does 'when' matter anymore? Bugfest operated by EBSCO at their cost for community. If the council makes no decision about when until Sunflower bugfest, my understanding is that would be a Eureka-based bugfest. So the only testing then would be on Eureka.
- Craig McNally That is correct. Table on doc indicates this. If community wants to do separate Okapi-based testing, that's up to community.
- Jenn Colt The 'when' decision matters because it's an issue of focusing resources. Keeping community together if major developer moves to a new platform and no one else can go with them.
- Marc Johnson EBSCO process is happening from Sunflower irrespective of community action. Eureka already in production (on previous flower release). If we're reframing, it's not Sunflower vs. Trillium, it's we're going in Sunflower, what do we need to do to get there or to catch up as quickly as possible if not. If community says not Sunflower, it doesn't change bugfest, we don't have capacity to do that separately. So realistically we might as well take the 'when' off the table as well. Not a decision-making process, but a planning process, it's happening in Sunflower, how fast can we catch up all relevant parts of the community to get to that place ASAP. How long after sunflower to get hosted reference environments swapped over, all the other things. Disconnect from the releases, except the small things like platform definitions. Effectively offering minimal dual support in Sunflower unless we can catch up fast enough, and that's it, after that it's Eureka-only.
- Jenn Colt That makes sense to me. This is recommendation for doing the best we can in Sunflower. Good to still acknowledge that Option 2 would be a lot of work to maintain an Okapi version somewhere, and that's why it's not reasonable. Can also simplify the timeline table, remove some of the community rows.
- Marc Johnson We don't have to say it's a recommendation. If the actual decisions have already been made, then this becomes a report, of the things that have to happen. And the question becomes can we get there in time for Sunflower.
- Jason Root Community meeting next week to on-board devops to early adopters program. Will work with German library consortia to get something running. Want to keep reference environments, get those retooled. Vagrant boxes still useful to many in the community for development support, Eureka has tiering to levels of the platform, that could make the Vagrant boxes easier to run on machines. Eureka environments right now are being handled by Kitfox; the reference environments and Vagrants by FOLIO devops, by Index Data right now. Early adopters program will involved Index Data devops, community devops, German libraries devops.
- Marc Johnson So there is work for the community devops team to do with the hosted reference environments. Enough for meeting to just say that community devops has work to do on this. If someone has already put the effort in that satisfies the same need as snapshot env, what's the need for community devops to do that. Since that work comes from community council funds.
- Jenn Colt There are ongoing discussions for community responsibility for community infrastructure. For us, wrote with assumption that ID has been doing devops and will continue, so they need to be ready to take over doing Eureka devops.
- Craig McNally Hosted reference environments are slightly different, just running the tip of master and rebuilt regularly. Wayne or Jason noted that the current tech stack for hosted reference environments is being replaced with Kubernetes, which aligns closer with what kitfox is using, so opportunities to reuse helm charts etc.
- Jason Root Yes that is on the table, decisions not made yet.
- Craig McNally Devops also hosts release-specific environments.
- Jason Root Yes. Ramsons one not there yet.
- Marc Johnson Nothing else for the communities to do on this – little other governance. Just the various devops operations.
- Maccabee Levine We should actually make the decision official. We've been talking in TC about voting minimum numbers of people, and here we have effectively made a decision with two TC members (the co-chairs). 60 seconds of lazy consensus at the start of the tri-council meeting will make it official.
- Jenn Colt Yes, to vote on this as TC after tri-council.
- Marc Johnson Why would we do that, beyond upholding governance policies. If we ask the councils to vote on this, our community never says 'no' on things, but if we ask the question we leave open the door to some folks saying no. If that happens, we need to have an answer to what that means.
- Jenn Colt Voting rqeuires people to be informed, lazy consensus easier.
- Maccabee Levine Majority of all councils will say yes, and by lazy consensus.
- Marc Johnson So first order of business is to do this by lazy consensus, and if no one objects, then that's the formal process. Nothing in the agenda if anyone does object. Rest of the meeting is the plan to get there.
- Tod Olson Agree. Once concern is about framing the initial statement so it's not 20 minutes of discussion. Something like "we the three councils are resolved that FOLIO will be moving to the Eureka architecture. This meeting is about the timeline."
- Marc Johnson Specific language up to chairs. They made the pre-emptive decision. So wrangling how to frame it in a way that doesn't encourage active voting, but acknowledges that it's happened, is a challenge for the chairs.
- Jenn Colt agrees.
- Craig McNally Regardless what's in the report, someone will raise this. How do we make it more productive. Discussions at WOLFcon etc. have pointed to community embracing this. If we frame it as an assmption it's the best we can do.
- Maccabee Levine Just asking us to make it explicit, since we've been discussing how to make it official for a long time. If it comes up organically it can be a long meeting again. Get it over quick at the start.
- Jenn Colt If the meeting doesn't go as we want to, there will be options.
- Craig McNally Tri-council audience will be diverse, some technical and some not. Tricky to know what level of detail the doc should be. Can't make assumptions about level of understanding, should use layman's terms.
|
| Background |
| Slack conversations: RFC in preparation: Relevant dates: - Sunflower OST acceptance: Sept 27, 2024
- Sunflower scope deadline: Sept 27, 2024
- January tri-council meeting: Jan 13, 2025
- Sunflower API freeze? Jan 24 2025
- Sunflower module acceptance deadline: Jan 24, 2025
- FOLIO support period is the next release (currently in development) and the two latest GA (General availability) releases: PC Supports long-term release and regular release recommendations
- RFC public review timebox: 1 month
|
- | Zoom Chat17:04:27 Jenn Colt: https://folio-org.atlassian.net/wiki/spaces/TC/pages/676855870/Draft+report+on+adoption+and+timeline+of+the+Eureka+platform 17:09:43 Wayne Schneider: platform-complete is also technically a yarn platform and performs the function of a reference UI build platform. 17:10:05 Wayne Schneider: Oh, I see, platform-lsp fills that? 17:16:46 Julian Ladisch: OpenAPI documentation: https://github.com/folio-org/mod-scheduler/tree/master/src/main/resources/swagger.api 17:17:09 Wayne Schneider: Actually the Okapi timer is a little more flexible than that FWIW (doesn't really matter at this point) 17:20:28 Tod Olson: I think useful to include the non-code repositories for completeness, even if there's an explicit statement that we don't need formal review for those. 17:20:39 Craig McNally: Reacted to "OpenAPI documentatio..." with 👍 17:21:26 Marc Johnson: Reacted to "I think useful to in…" with 👍 17:22:09 Ingolf Kuss: Reacted to "I think useful to in..." with 👍 17:23:20 Day, Kevin: I agree with Marc's statement about referencing the ~OKAPI~ Eureka functionality. 17:29:40 Tod Olson: Agreed w/ @Craig McNally , the other councils are looking to TC for guidance on Eureka. 17:34:00 Craig McNally: No, that would be human readable IDs 17:34:04 Craig McNally: ;) 17:34:14 Tod Olson: Reacted to "No, that would be hu..." with 😆 17:37:27 Wayne Schneider: FWIW regarding community devop -- not sure more information will be available by early January. We have internally addressed next steps and are planning to engage Eureka pretty deeply in the new year. 17:52:26 Tod Olson: Also hard to quantify say "reduced" in this context without measurements to refer to. |
| Jenn Colt to Everyone 11:08 AM @Maccabee Levine are you up for scribe?
Jenn Colt to Everyone 11:09 AM Remember Tod’s trillium comments when we get to the table
Charlotte to Everyone 11:17 AM Will the Sunflower Release be postponed as a consequent of this potential decision? Or are will still thinking feature Freeze as of 2/7/2025 realistic?? + 1 Jenn
Tod Olson to Everyone 11:26 AM @Marc Johnson , I think that sounds like a solid practical assessment.
Julian Ladisch to Everyone 11:29 AM The question when we get Eureka Snapshot environments is no longer relevant because they already exist, see the link in the "Eureka adopter support" section of the document.
Jason Root to Everyone 11:30 AM (Edited) Right - and the hourly/daily reference/snapshot environments* will all need to be retooled by FOLIO DevOps.
I do wonder what might become of the Vagrant box - in theory the Eureka platform will be more low-overhead to be able to do so once more.
Kirstin Kemner-Heek to Everyone 11:36 AM Yes, we start officially next week and will closely with ID and the community.
Kirstin Kemner-Heek to Everyone 11:36 AM will work :-)
Marc Johnson to Everyone 11:40 AM Craig, is the Eureka Snapshot a different name for a part of the rancher stuff then?
Charlotte to Everyone 11:45 AM Do we need to plan for more thorough testing of all test rail tickets in Bugfest Ramsons Eureka environment? I believe this environment has only been sporadic tested
Craig McNally to Everyone 11:46 AM So there are a few different things in play here... there's "edev" rancher env, which is what devs use for integration/dev work. They sometimes deploy code from feature branches, etc. There's also the "etesting" which is what QA and others (POs, etc.) use to verify work. It's etesting which I think is analogous to the hosted reference "snapshot" envs. Both etesting and edev are updated on a regular (nightly?) basis. Once the community devops have eureka-based snapshot envs up and running, we might not need etesting anymore.
Craig McNally 11:54 AM If I understand correctly the question posed earlier was along the lines of "so if kitfox already has snapshot-like envs running, why do we need folio devops to do the same work?" I think the answer has a couple aspects to it, and they aren't necessarily technical.
- capacity... maintaining the hosted reference envs is not zero effort. Kitfox may or may not have capacity to take this responsibility on long term, especially when considering #3 below.
- cost... I believe the rancher envs are paid for by EBSCO, and the hosted reference envs are not
- scope... As mentioned earlier, it's not only snapshot envs, but also the "release" envs
|