Bug Fest Q2 2020 Report

Owned by Anton Emelianov (Deactivated)
Last updated: Aug 24, 2020

Summary

We run full regression test during Q2 2020 Bug Fest. 93% of the test cases has been marked as PASSED. 


Bug Fest notes:

Please see table below that compares results for the pas 4 Bug Fest Cycles.

  • We had record number of testers to participate in this  Bug Fest: 60!

  • Product Owners picked up fewer test cases this time (only 16%).

  • We had fair share of schema update problems. 

  • Overall, system performance was good. 

Individual Participation:

Participation by Institution:

Highlights of the results:

  • 137 defects has been logged.

  • 35 defects has been closed as "duplicate", "cannot reproduce", or "won't do". It is a higher number compare to previous BugFest.

  • Testers didn't create defects in Jira for failed test cases.  It allowed them to take on more test cases.

  • ui-users module receive the highest number of defects(31) again.

  • Notably, mod-circulation (25), mod-source-record-storage (16), mod-oai-pmh (14) , mod-data-export (11), and stripes-smart-components (11) did not as good as the other modules.

  • All 27 P1 defects were addressed before release. 

  • All but one of 83 P2 defects were fixed before release or resolved in Q2 2020 Hot Fix release.

  • Q2 release was delivered only 1 day late. 


Additional charts available at Jira Dashboard