Bug Fest Q1 2020 Report

Summary

We run full regression test during Q1 2020 Bug Fest. 91% of the test cases has been marked as PASSED. 

Bug Fest notes:

Please see table below that compares results for the pas 3 Bug Fest Cycles.

  • We had fewer testers to participate in this  Bug Fest: 36 vs 39

  • Product Owners picked up more test cases this time. A lot of test cases were added the last minute and cannot be delegated to community testers.

  • It was the first time we were using large inventory dataset (almost 9M items). It allowed us to uncover a lot of issues that didn't manifest themselves with a smaller dataset.

  • Most of schema updates issues were relatively easy to resolve. However, we had to delay Bug Fest start by 1 day.  

  • Overall, system performance was good. 

Individual Participation:

Participation by Institution:

Highlights of the results:

  • 117 defects has been logged.

  • 19 defects has been closed as "duplicate", "cannot reproduce", or "won't do". It is about the same compare to previous BugFest.

  • Testers didn't create defects in Jira this time. This task was assigned to product owners. Therefore we cannot provide number of defects per tester report

  • ui-users module receive the highest number of defects(31) again.

  • Notably, mod-circulation (14), ui-inventory(18), ui-requests(10) did not as good as the other modules.

  • All 21 P1 defects were addressed before release. 

  • There were 46 out of 54 P2 defects were fixed before release or included into Hot Fixes.

  • Q1 release was delivered as planned on time.