Sunflower (R1 2025): AQA environment verification suite
- Kyrylo Brener
Overall approach
During each Bugfest update job with sanity AQA tests is started automatically for each tenant in the related cluster. This gives quick feedback on overall environment health.
Tests are executed for the following tenants:
Results of tests are automatically posted to the special private Slack channel with allure report URL:
Since these are basic sanity checks, baseline for pass rate is 100%.
Duration of tests execution for all 4 tenants is ~15 minutes.
Test suite information
Number of tests per 1 non-ECS tenant: 49
Number of tests per 1 ECS central tenant: 52
Overall number of tests executed for 4 tenants: 199
Test set is fixed and does not change during Bugfest period.
Test suite does not manipulate any data, nothing is created, updated or deleted.
Test suite is based on environment verification set of tests which is used for verification of any folio environment, including production.
Test suite contains both UI and API checks.
Job automatically identifies installed edge modules, installed UI modules, checks ECS settings for consortia tenant - and executes related tests for related tenants. E.g. consortia checks will be executed only for consortia tenants automatically, and it doesn’t require any additional actions from person who runs/sets up the job.
Applications and modules covered
List of folio applications covered by environment verification suite:
agreements, bulk-edit, circulation log, dashboard, export-manager, data-import, data-export, copycat, settings, users, finance, inventory, invoice, licenses, lists, organizations, receiving, requests, serials
consortia settings, consortium manager
edge modules: edge-erm, edge-ncip, edge-orders, edge-rtac, edge-patron, edge-oai-pmh