Overview

The purpose of these tests is to compare results from two identical test runs on different environment. Find the reason of slowness if any will be there.

Summary

Both system are stable under load and test passed without errors. Environments have a different logic in modules, so there is a difference in response times there.

GCP1 env. shows faster response time than BHS1, less than 10 milliseconds difference on 75 percentile and less than 50 milliseconds on 95 percentile.

It's not a big difference, however with such request per second rates it causes a visible difference in total count of calls.

Version

mod-circulation:19.2.7;
mod-circulation-storage:12.1.4;
okapi:4.3.3;
mod-inventory-storage:19.4.4.

Tests

Test #	Virtual Users	Duration (sec)	Env	Comment

Test #	Virtual Users	Duration (sec)	Env	Comment
1	10	1800	BHS1	-
2	10	1800	GCP1	-
3	10	1800	BHS1	Modules restarted*
4	10	1800	GCP1	Modules restarted*

*Circulation, inventory-storage, feesfines, mod-pubsub, okapi, mod-patron-blocks

Results comparison

Requests			Total	Req/s	Response times (Seconds)
Requests			Total	Req/s	50th pct	75th pct	95th pct
1 set	BHS1	GET_item-storage/items?query=id==("" or "")&limit=2147483647	369877	205.487	0.039	0.051	0.107
1 set	GCP1		429003	238.329	0.038	0.045	0.061
2 set	BHS1		283019	197.750	0.043	0.055	0.101
2 set	GCP1		412260	229.030	0.039	0.046	0.065

Delta

Response times (Seconds)
	Min	50th pct	75th pct	95th pct	99th pct	Max
1 set	-0.004	0.001	0.006	0.046	0.035	-6.088
2 set	-0.004	0.004	0.009	0.036	0.042	-2.504

Set 1 resource usage

BHS1 Service CPU usage for relevant modules:

BHS1 Service memory usage for relevant modules:

BHS1 RDS CPU usage

GCP 1 Service CPU usage for relevant modules:

GCP1 Service memory usage for relevant modules:

GCP1 RDS CPU usage:

Set 2 resource usage