Summary
Our goal was to test Q4 release and see if our current process can provide desired quality level. The conclusion is that we have a lot of work ahead of us to make it better. Hopefully, we'll get better results when we run the next Bug Fest.
It was the first time we attempted to execute such an extensive manual product test run.
That being said, it went relatively smooth for the first try:
- There were relatively few questions about the process in the bug-fest Slack channel at the beginning of the week.
- Participants did't require a lot of support in following the directions for Bug Fest.
- We incurred one performance issue on Tuesday that blocked all the testing activities. It was quickly resolved by Hongwei.
- We were not able to execute all test tasks in the first 2 days and event had to be extended for another 3 days.
- Some areas of Folio included into test plan didn't get executed. We have to do a better job planning task assignments next time.
Here are the highlights of the results:
- 82 defect has been logged over the course of 5 days.
- We had 14 participants from across FOLIO (admin, POs, regular testers, library staff)
- Testers logged the most number for defects against ui-users, ui-inventory, and ui-requests modules (please see chart below.
