Bug Fest Q3.2 2019 Report

Summary

We run full regression test during Q3.2 Bug Fest. 77% of the test cases has been marked as PASSED. It is lower by 7% compare to Bug Fest 3.1. That being said we had fewer test cases scheduled - 554 in 3.1 vs 606 in 3.2. Overall, FOLIO did well during this test run. We were able fix all P1 and practically all P2 issues that has been found during this test cycle. FOLIO Q3.2 2019 release will become available as scheduled without delays.

Bug Fest notes:

Record number of testers participated - 43! Previously, similar amount of work was performed by about 14 people.
Testing community has been a great help! 37 people from different institutions helped us to complete this test cycle.
9% of test cases were marked as failed.
We have 13% of test cases that didn't get to be worked on at all.
All P1 and P2 defects required for Q3.2 release has been fixed before deadline.
We had several environment issues when additional modules need to be deployed to enable testing.
Also, overlapping permission problem that caused a lot of confusion with testers was addressed
Overall, system performance was good even when higher than usual number of testers were using the system.

Individual Participation:

Participation by Institution:

Highlights of the results:

43 defects has been logged.
13 defects has been closed as "duplicate", "cannot reproduce", or "won't do".
Defects were created by 14 different participants.
Micah Walter is leading the pack with 12 submitted defects.
Testers logged the most number for defects against ui-users and ui-inventory modules. 8 defects each.
ui-orders (6), ui-requests (8), ui-users (6) received the highest defect count.
All 5 P1 defects were addressed during Bug Fest. All fixes will be included into Q3.2 release.
There were 10 P2 defects. 8 of them has been fixed. The rest has been assigned to the future releases.
Link to the live JIRA dashboard is here