Background
Improving of testing process for FOLIO UI.
Current state
- No formal testing approach (it might be looking like a Tests Pyramid, but we don't actually work on E2E tests, only support existing)
- Tests are for coverage
- Some tests cover a lot of, but test nothing
- Some modules don’t meet acceptance criteria
- No defined toolset
- No manual testers (only BugFest phase, what sometimes looks not good for testing due it's limited time)
- Regression testing during quarter releases
Suggestion
- Follow honeycomb approach (UI part is marked with bold lines on picture)
- 70-80% unit/integration tests coverage - it's possible to use one testing tool for that so it shouldn't be a problem to count coverage for both test types;
- Per commit unit tests execution
- POs/QAs define set of e2e scenarios (for existing features they could be gathered from testrail, but for new features PO can define scenarios in the tickets itself, so e2e tests could be counted in ticket's estimation)
- e2e tests are executed frequently (after merge to master, 1 per day, etc ?)
- e2e tests don’t block environments
- e2e tests reporting (e.g. reportportal.io)
Initial presentation from Mikita Siadykh https://drive.google.com/file/d/1kM7OO2LmeB6YGHyYmPFvpIljHj74BFz4/view?usp=sharing
Action items
- to review initial document Anton Emelianov (Deactivated)