- PERF-146Getting issue details... STATUS
Overview:
The purpose of these tests is to compare results from two identical test runs on different environment. Find the reason of slownesses if any will be there.
Summary:
Bot system shows stable work, and test passed without errors. Environments has a different logic on modules usage, so there is a difference in response times there.
GCP1 env. shows faster response than BHS1, less than 10 milliseconds difference on 75 percentile and less than 50 milliseconds on 95 percentile.
It's not a big difference, however with such request per second rates it causes a visible difference in total count of calls.
Version:
- mod-circulation:19.2.7;
- mod-circulation-storage:12.1.4;
- okapi:4.3.3;
- mod-inventory-storage:19.4.4.
Tests:
Test # | Virtual Users | Duration (sec) | Env | Comment |
---|---|---|---|---|
1 | 10 | 1800 | BHS1 | - |
2 | 10 | 1800 | GCP1 | - |
3 | 10 | 1800 | BHS1 | Modules restarted* |
4 | 10 | 1800 | GCP1 | Modules restarted* |
*Circulation, inventory-storage, feesfines, mod-pubsub, okapi, mod-patron-blocks
Results comparison:
Requests | Total | Req/s | Response times (Seconds) | ||||
50th pct | 75th pct | 95th pct | |||||
1 set | BHS1 | GET_item-storage/items?query=id==("" or "")&limit=2147483647 | 369877 | 205.487 | 0.039 | 0.051 | 0.107 |
GCP1 | 429003 | 238.329 | 0.038 | 0.045 | 0.061 | ||
2 set | BHS1 | 283019 | 197.750 | 0.043 | 0.055 | 0.101 | |
GCP1 | 412260 | 229.030 | 0.039 | 0.046 | 0.065 |
Delta
Response times (Seconds) | ||||||
Min | 50th pct | 75th pct | 95th pct | 99th pct | Max | |
1 set | -0.004 | 0.001 | 0.006 | 0.046 | 0.035 | -6.088 |
2 set | -0.004 | 0.004 | 0.009 | 0.036 | 0.042 | -2.504 |
Set 1 resource usage:
BHS1 Service CPU usage for relevant modules:
BHS1 Service memory usage for relevant modules:
BHS1 RDS CPU usage
GCP 1 Service CPU usage for relevant modules:
GCP1 Service memory usage for relevant modules:
GCP1 RDS CPU usage:
Set 2 resource usage
BHS1 Service CPU usage for relevant modules:
BHS1 Service memory usage for relevant modules:
BHS1 RDS CPU usage:
GCP1 Service CPU usage for relevant modules:
GCP1 Service memory usage for relevant modules:
GCP1 RDS CPU usage: