Introduction

<<explanation of the testing process, generally>>

Testing Process: Examples From Live Libraries

5 Colleges

• Negotiate scheduled upgrade with our hosting vendor. We make sure that the upgrade schedule happens when a majority of our committee members are available. 

• We always use the same dry run environment that is a snapshot of our production

• Rename our Slack Channel from last flower to current release. When we get back to Massachusetts, this will be from #poppy-upgrade to #quesnelia-upgrade

• Our FOLIO Systems Coordinator ensures environment is ready (upgrade scripts are run, permissions are set, etc.)

• Prepare spreadsheet to log issues. This is where we track if the issue is fixable, blocked, or just beware of unforeseen functionality or issues

• Committees review their UAT forms to make sure it covers new functionality

• Committees also request if new functionality needs additional time to be reviewed before being rolled out to staff (Lists App Beta)

• We have 1 week for all committees to do UAT

• Each committee have their own process. The focus is End to End tasks and workflows that involve multiple FOLIO Apps or cross app interaction

• Issues are tracked in our spreadsheet. Issues are determined to be fixable, blocking or “beware”. Issues with beware are often surprising functionality that we didn’t see or experience before (Call Number Browse). For some issues, we report this to our hosting vendor.

• Some committees work together in a meeting to do parts of the UAT. Others work asynchronously

• At the end of the week, the chairs of the committees approve or don’t approve of the upgrade. And yes, there was a time when we didn’t approve an upgrade. We want “Can we live with it” rather than “Is everything perfect”

Cornell

SPL

Stanford

TAMU

Tips and Takeaways

<<maybe add some tips and takeaways that don’t fit anywhere else, or fold these into the examples from libraries>>

Sample Checklists and Documents

<<This is the most important part. Pull out links to documents here.>>

• The “HC” checklist

• Another google sheet?

• Five Colleges

  • Example of Metadata Management Committee’s UAT for Poppy

  • Example of ERM Committee’s UAT for Poppy

  • Google Form used for all FOLIO flower releases for Data Import/Data Export/Bulk Edit

  • Log of issues encountered with Poppy upgrade

FAQ

Glossary

• API

• Bugfest

• CSP

• Flower Release

• Google Sheets

• Integration

• Migration

• QaraTMS

• Quack

• Release Digest

• Release Notes

• TestRails

• Upgrade

See Also

FOLIO Implementers Presentation, WOLFcon 2024 <<link to recording here>>