2023-01-25 Meeting notes: workflow management with Prefect

Date

25 Jan 2023

Housekeeping

• Convener and notes: Martina Schildt
• Next meeting: 30 Jan 2023

Discussion items

1. Using Prefect for managing workflows | Jenn Colt from Cornell

Minutes

Chat

Transcript

Future topics

• Topic proposal by Owen Stephens for October:
  • Use of shortcut keys and macros for more effective cross-app working  - it also be good to have UX and Stripes/dev knowledge for this discussion I think. I know @Laura (she/they) uses macros so might have insights into the potential for cross-app working
  • Potential for external 'workflow' solutions for cross-app interactions
    • I think 'workflow' is a dangerous term here - in this context it's more about automation than user workflows, although I think there is overlap
    • I was particularly struck by the solution in production at TAMU (Jeremy Huff and Sebastian Hammer presented, the recording is at https://prod-zoom-recordings-openlibraryfoundation-org.s3.amazonaws.com/50dc6c87-3912-43fa-8287-56ec73b12bbb%2Fshared_screen_with_speaker_view%28CC%29.mp4 starting at 3 hrs, 14 min) - I think getting someone from TAMU to talk about how this is used would be v interesting
    • There was also a presentation on the use of a tool called Airflow at Stanford for "bibliographic workflow" but I've not watched that yet so not 100% sure if it is completely applicable - I think the core use case there was systems migration but it may go beyond that
    • Jenn Colt on using Prefect
    • does not need to be workflow across apps
• UX/UI and implementers topics
  • should be Wednesdays
• Comprehensive look at where data is copied and stored as opposed to live data | how it is represented
• Date filters and how they work in different apps

Attendees

Action items