It was the first time we attempted to execute such an extensive manual product test run.
That being said, it went relatively smooth for the first try:
- There were relatively few questions about the process in the bug-fest Slack channel at the beginning of the week.
- Participants did't require a lot of support in following the directions for Bug Fest.
- We incurred one performance issue on Tuesday that blocked all the testing activities. It was quickly resolved by Hongwei.
- We were not able to execute all test tasks in the first 2 days and event had to be extended for another 3 days.
- Some areas of Folio included into test plan didn't get executed. We have to do a better job planning task assignments next time.
Our goal was to test Q4 release and see if our current process can provide desired quality level.
The executive summary: we have a lot of work ahead of us to make it better.
Hopefully, we'll get better results when we run the next Bug Fest.
Here are the highlights of the results:
- 82 defect has been logged over the course of 5 days.
- We had 14 participants from across FOLIO (admin, POs, regular testers, library staff)
- Testers logged the most number for defects against ui-users, ui-inventory, and ui-requests modules (please see chart below.
