Dec 2023 Meeting
Attendees
@Ian Walls
@Jeremy Huff
@jpnelson
@Kevin Day
@Jenn Colt
@Joseph A Molloy
@Lloyd Chittenden
@Maccabee Levine
@Martina Schildt
@Rajdeep Hundal
@Darsi Rueda
@Robert Roose
@Robert Heaton
@jroot (Unlicensed)
@Amanda Ros
Agenda
Regular Meeting time for 2024
Agreed to every 2 weeks, with a re-evaluation of how that works in April. Demos of code will be every 3 weeks with TAMU, so those meetings will be open and separate from regular SIG scheduling. @Ian Walls will put out the exact timing polling for folks asynchronously in Slack, trying to be cognizant of timing for non-North American community members.
Airflow demonstration
Makes use of Directed Acyclic Graphs to build workflows, using Python. Running in Kubernetes at Stanford.
Some key features:
Lots of community-generated 'operators' to connect into different kinds of services
Lists history of executions of DAGs, with filtering by status (succeeded/failed)
Includes the ability to automatically retry if workflow steps fail
Can be run in parallel (with sufficient underlying resources); Stanford used this to migrate millions of bibs in less than 24 hours
DAGs can be triggered within DAGs, allowing for workflow composition
There is a Dynamic DAG generator plugin for Airflow which would be necessary for a mod-airflow (as a drop-in replacement to mod-camunda). Replicating all the affordances within the FOLIO UI would be daunting (same with Camunda). Perhaps having a simplified FOLIO UI for doing some basic customized workflow design, but a 'pre-built' mode for workflows that are more complex and require administration through the Workflow Engine's native UI.
See recording for the demo itself.
User Stories
In Slack, take a look!
TAMU sprints starting up
Introducting @Kevin Day and @Rajdeep Hundal from TAMU team. Talk to @Jeremy Huff to get connected with the new sprint cycle.