[FOLIO-1647] Local performance test strategy Created: 12/Dec/18 Updated: 21/Oct/22 Resolved: 21/Oct/22 |
|
| Status: | Closed |
| Project: | FOLIO |
| Components: | None |
| Affects versions: | None |
| Fix versions: | None |
| Type: | New Feature | Priority: | P3 |
| Reporter: | William Welling | Assignee: | Adam Dickmeiss |
| Resolution: | Won't Do | Votes: | 0 |
| Labels: | ci, core, performance, sprint53, sprint54 | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original estimate: | Not Specified | ||
| Issue links: |
|
||||||||||||
| Sprint: | |||||||||||||
| Development Team: | Core: Platform | ||||||||||||
| Description |
|
In order to reproduce and debug performance issues, it would be desirable to have a testbed deployed and loaded in local development environment. The testbed should provide ability to perform load tests against FOLIO ecosystem as a whole and isolated individual modules or subset of modules. Testing against FOLIO as a whole will provide overhead testing metrics for filtering and routing through Okapi and ensure it is constant for all test plans. Testing modules in isolation will enable isolation and debugging for quick turn around for tuning. To be consistent with Jenkins performance testing and to afford reusability of tests, Apache JMeter should be used. The current suite of test plans can be found https://github.com/folio-org/folio-perf-test. Therefore, analysis of this repo and how it works will be a prerequisite. This repo contains references to load data hosted on AWS. This may be reusable, but should ensure test data is of most recent schema. In addition, a documented baseline with environment specifications and persistent and concurrent load metrics should be produced. |
| Comments |
| Comment by Jakub Skoczen [ 16/Jan/19 ] |
|
Kurt Nordstrom Nassib Nassar do we need Adam to continue working on this issue? Do we need the ability to run the perf tests locally? If so, Varun Javalkar can help setting up the test and running them locally. |
| Comment by Nassib Nassar [ 18/Jan/19 ] |
|
I think it would be very helpful for anyone looking at performance testing to have a local development environment with the complete ecosystem installed from source. |
| Comment by Kurt Nordstrom [ 18/Jan/19 ] |
|
Would it be worth it for me to take the time massage my folio testing environment repo to make the installation a little more scripted? Basically it provides a set up scripts to start okapi and load a basic set of back end modules and populate them with data. It's what I've been using to provide an environment that I can run the jmeter stuff in. |