...

Overview

The test's target is to investigate the behaviour of the Check-In/Check-Out activities during fixed load tests.

Jira Legacy

server	System Jira
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	01505d01-b853-3c2e-90f1-ee9b165564fc
key	PERF-879

Summary IN-PROGRESS

Check-In/Check-Out tests on Quesnelia release (Eureka) in QECP1 environment carried out with 8, 20, 30, 75 virtual users during 45 minutes and with 30 virtual users during longevity test (24 hours) to detect any trends in resource utilization

45 minute tests

Longevity test

Comparison with Poppy Results:

Resources

CPU utilization

Memory consumption

RDS CPU utilization average

CPU (User) usage by broker

Common notes

Recommendations

Test Runs

The following table contains tests configuration information

...

Test #

...

Duration, sec

...

1

...

Results

Errors:

Error messages: POST_circulation/check-out-by-barcode (Submit_barcode_checkout)_POST_422. 422/Unprocessable Entity. Happen expectedly if instance was checked out already. Error rate - 0.06% which is acceptable.

Response time

The table contains results of Check-in, Check-out tests in Quesnelia release (Eureka).

45 minute tests

...

Response Times (ms)

...

#Samples

...

Average

...

95th pct

...

#Samples

...

Average

...

95th pct

...

#Samples

...

Average

...

95th pct

...

#Samples

...

Average

...

95th pct

...

Longevity test (with absent dcb-system-user)

...

Comparisons

This table has comparison between average values of response times of Quesnelia and Quesnelia (Eureka) releases

...

Comparison of Longevity test (absent dcb-system-user in Quesnelia)

...

API requests where response times >= 100 ms

...

API

...

30 vUsers Poppy

Average, ms

...

30 vUsers Quesnelia

Average, ms

...

Resources Utilization

CPU Utilization

45 minute and longevity tests used CPU in correspondence with number of vUsers but there are some modules that spiked during 75 vUsers test - mod-users-b - 132%, mod-authtoken-b - 98%, nginx-okapi - 84%.
45 minute tests

...

title	CPU by modules

Longevity test (with absent dcb-system-user)

Memory Consumption

45 minute and longevity tests didn't reveal some problems with memory usage by modules. So no memory leaks detected. Modules that consumed max memory - mod-search - 94%, mod-oa - 78%, mod-inventory - 72%, mod-dcb - 71%

...

title	Memory usage by modules

45 minute tests

Longevity test

RDS CPU Utilization

RDS CPU utilized:

8 vUsers - 13%, 20 vUsers - 22%, 30 vUsers - 30%, 75 vUsers - 50% During longevity test CPU grew from 30% to 45%. So it has growing trend during longevity test.

45 minute tests

Longevity test

RDS Database Connections

For both 45 minute and longevity tests RDS used max 615-630 connections. Without test it was 550 connections.

45 minute tests

Longevity test

CPU (User) usage by broker

Common CPU utilization by broker during all tests was 15% with equal distribution between brokers

45 minute tests

Longevity test

Database load

75 vUsers

...

title	Resources Utilization

CPU Utilization

45 minute and longevity tests used CPU in correspondence with number of vUsers but there are some modules that spiked during 75 vUsers test - mod-dcb-b - 407% with 128 CPU, mod-authtoken-b - 120%, nginx-okapi - 102%.
Additional test was carried out with changed configuration for mod-dcb-b (raised from 128 to 256). It helped to decrease CPU utilization for mod-dcb-b twice from 407% to 202% and nginx-okapi from 102% to 70% which helped to decrease response times more than 20% if to compare results with 128 CPU and 256 CPU.

45 minute tests

...

title	CPU utilization by modules

...

45 minute test with 75 vUsers (revision with 256 CPU for mod-dcb-b)

Longevity test

Memory Consumption

45 minute and longevity tests didn't reveal some problems with memory usage by modules. So no memory leaks detected.

...

title	Memory usage by modules

...

45 minute tests

Longevity test

RDS CPU Utilization

45 minute tests

Longevity test

RDS Database Connections

45 minute tests

Longevity test

CPU (User) usage by broker

45 minute tests

...

Database load

Appendix

Infrastructure

...

11 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 instance of db.r6.xlarge database instance: Writer instance
MSK tenant [ kafka configurations]
- 4 kafka.m5.2xlarge brokers in 2 zones
- Apache Kafka version 2.8.0
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3

...

DB table records size:

fs09000000
- instances - 24493326
- items - 25662862
- holding records - 24459683

Modules

...

title	Check-In / Check-Out related modules

...

title	All modules

...

Overview

The test's target is to investigate the behaviour of the Check-In/Check-Out activities during fixed load tests.

Jira Legacy

server	System Jira
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	01505d01-b853-3c2e-90f1-ee9b165564fc
key	PERF-879

Summary

Check-In/Check-Out tests on Quesnelia release (Eureka) in QECP1 environment carried out with 8, 20, 30, 75 virtual users during 45 minutes and with 30 virtual users during longevity test (24 hours) to detect any trends in resource utilization

45 minute tests

Response times in tests with 8, 20, 30 virtual users delta was 200 ms. The lowest average response times were with 20 virtual users test: Check-In - 625 ms, average Check-Out - 1356 ms
The highest average response times showed 75 vUsers test: Check-In - 4 sec 610 ms, Check-Out - 12 sec 589 ms (whole test), Check-In - 622 ms, Check-Out - 1540 ms (before saturation point with 33 vUsers)

Longevity test

Longevity test was running 10 hours and began failing because of token expiration. Possible reason here is SSO Session Max limitation 10 hours (fs09000000/realm-settings/sessions).
- Average response times in 10 hours test for Check-In - 1003 ms, Check-Out - 2870 ms
- First 5 hours 30 minutes average response times Check-In - 770 ms, Check-Out - 1773 ms, the next 4 hours 30 minutes - Check-In - 1295 ms, Check-Out - 4280 ms
Longevity during 24 hours (after session expiration issue was resolved by increasing SSO session Max parameter from 10 to 24 hours)
- Average response times for all 24 test Check-In - 1311 ms, Check-Out - 4541 ms
- The same degradation observed as in 10 hours test. Response time increased significantly in 6 hours after test start - Check-In from 1045 ms to 1526 ms, Check-out from 2523 ms to 5262 ms. See Graphs for response times.

Comparison with previous results in Quesnelia (qcp1 environment):

8, 20, 30 vUsers tests were stable. And 75 vUsers test revealed saturation point during ramp-up period with 33 vUsers. After this point response times increased significantly with the same throughput.
There's a significant performance degradation compared to previous results from tests in quesnelia release on qcp1 environment (non-eureka):
- 8 vUsers - Check-out - 96%, Check-in - 48%
- 20 vUsers - Check-out - 61%, Check-in - 33%
- 30 vUsers - Check-out - 89%, Check-in - 55%
- 75 vUsers - Check-out - 1111%, Check-in - 695% (during whole test)
- 75 vUsers - Check-out - 48 %, Check-in - 7 % (before saturation point was found)
- 30 vUsers (Longevity) - Check-out - 326%, Check-in - 188% (24 hours test)

Resources

CPU utilization
- 45 minute and longevity tests used CPU in correspondence with number of vUsers but there's module that used about 16% - mod-inventory-storage-b. We do not observe expected growth for module CPU utilization in 75 vUsers because of saturation point.

Memory consumption
- 45 minute and longevity tests didn't reveal some problems with memory usage by modules. So no memory leaks detected. Modules that consumed max memory - mod-search - 94%, mod-oa - 78%, mod-inventory - 72%, mod-dcb - 71%

RDS CPU utilization average
- For both 45 minute and longevity tests RDS used max 867 connections. Without test it was 812 connections.

CPU (User) usage by broker
- Common CPU utilization by broker during longevity was 18, 18, 16, 14% accordingly to broker distribution. Resource utilization decreased significantly after 6 hours 20 minutes (17:40 UTC) to 14, 12, 12, 11%

Notes:

The reason of degradation, which occurs after 6 hours of testing, has not yet been found.

Recommendations

Investigate degradation after 6 hours of longevity test.

Test Runs

The following table contains tests configuration information

Test #	vUsers	Ramp-up, sec	Duration, sec
1	8	80	2700
2	20	200	2700
3	30	300	2700
4	75	750	2700
5	30	300	86400

Results

Response time

The table contains results of Check-in, Check-out tests in Quesnelia release (Eureka). All requests that are >= 100 ms (in average response times)

45 minute tests

	8 vUsers			20 vUsers			30 vUsers			75 vUsers
Requests	Response Times (ms)			Response Times (ms)			Response Times (ms)			Response Times (ms)
Label	#Samples	Average	95th pct	#Samples	Average	95th pct	#Samples	Average	95th pct	#Samples	Average	95th pct
Check-out Controller	1745	1459.64	1694	4140	1356.82	1569.95	6047	1646.96	2725.6	6567	12589.1	19031
Check-In Controller	1288	603.95	706	3297	625.78	665	4560	748.3	1340.05	4957	4610.3	8229.2
POST_circulation/check-out-by-barcode (Submit_barcode_checkout)	1746	661.9	755.95	4142	613.14	659	6047	729.59	1242.8	6594	3868.57	7169.25
POST_circulation/check-in-by-barcode (Submit_barcode_checkin)	1289	240.43	287.5	3305	277.17	293	4572	286.61	363	4969	1642.04	3832.5
GET_circulation/loans (Submit_barcode_checkout)	1745	285.6	340	4141	275.47	307	6047	347.89	640.6	6571	2528.16	5109
GET_circulation/loans (Submit_patron_barcode)	1746	36.23	262							6599	1548.85	3773
GET_circulation/requests (Submit_barcode_checkin)										4960	1171.58	3366.5
GET_circulation/requests_status_Open (Submit_patron_barcode)										6596	1120.86	3117.2
GET_circulation/requests (Submit_barcode_checkout)										6565	997.17	3095.7
GET_users (Submit_patron_barcode)	1747	121.36	129				6050	136.53	368.45	6603	872.72	2508.6
GET_inventory/items (Submit_barcode_checkin)	1289	107.55	130.5	3305	111.12	136	4576	165.7	469.15	4970	848.62	2773
GET_users (Get_check_in_page)	1290	120.27	140				4577	165.61	506.3	4977	836.34	2577.1
GET_inventory/items (Submit_barcode_checkout)	1746	107.88	130	4143	110.18	136	6048	160.44	468.55	6594	757.24	2602
GET_circulation/requests_status_openAwaitingPickup (Submit_patron_barcode)										6594	718.98	2636

empty cells - response times less than 100 ms

Longevity test

Expand

title	Graphs (Response times)

Longevity 24 hours
Image Added
Throughput
Image Added

Image Added

30 vUsers Longevity 10 hours
Requests	Samples, Response Times
Label	#Samples	Average	95th pct
Check-Out Controller	77197	2870	8510
Check-In Controller	58806	1003	3320
POST_circulation/check-out-by-barcode (Submit_barcode_checkout)	77205	1100	4050
POST_circulation/check-in-by-barcode (Submit_barcode_checkin)	58817	290	390

30 vUsers Longevity 24 hours
Requests	Samples, Response Times
Label	#Samples	Average	95th pct
Check-Out Controller	162392	4541	10100
Check-In Controller	122061	1311	4546
POST_circulation/check-out-by-barcode (Submit_barcode_checkout)	162392	1688	3364
POST_circulation/check-in-by-barcode (Submit_barcode_checkin)	122068	297	428

Comparisons

This table has comparison between average values of response times of Quesnelia (Check-in-check-out Test Report (Quesnelia)) and Quesnelia (Eureka) releases

	8 Users				20 Users				30 Users				75 Users				75 Users, upto 33 vUsers rampup
Requests	Response Times				Response Times				Response Times				Response Times				Response Times
	Quesnelia	Eureka			Quesnelia	Eureka			Quesnelia	Eureka			Quesnelia	Eureka			Quesnelia	Eureka
Label	Average		Delta,ms	Difference,%	Average		Delta,ms	Difference,%	Average		Delta,ms	Difference,%	Average		Delta,ms	Difference,%	Average		Delta,ms	Difference,%
Check-Out Controller	741	1459	718	96.90%	842.65	1356	513.35	60.92%	870.2	1646	775.8	89.15%	1039	12589	11550	1111.65%	1039	1541	502	48.32%
Check-In Controller	408	603	195	47.79%	467.71	625	157.29	33.63%	480.62	748	267.38	55.63%	580	4610	4030	694.83%	580	623	43	7.41%

Comparison of Longevity test

30 vUsers Longevity 10 hours
Response Times
Quesnelia	Eureka
Average		Delta,ms	Difference,%
1065	2870	1805	169.48%
454	1003	549	120.93%

30 vUsers Longevity 24 hours
Response Times
Quesnelia	Eureka
Average		Delta,ms	Difference,%
1065	4541	3476	326.38%
454	1311	857	188.77%

Resources Utilization

CPU Utilization

45 minute and longevity tests used CPU in correspondence with number of vUsers but there's module that used about 16% - mod-inventory-storage-b. We do not observe expected growth for module CPU utilization in 75 vUsers.

45 minute tests

Expand

title	CPU by modules

CPU parameter in revisions set to 0 (containers use all available resources)

Service Name	CPU 8 vUsers	CPU 20 vUsers	CPU 30 vUsers	CPU 75 vUsers
mod-inventory-storage-b				16.8
kong-b				5.27
mod-inventory-b				4.7
mod-circulation-b				3.57
mod-circulation-storage-b				3.36
mod-users-keycloak-b				2.38
mod-permissions-b				2.2
mod-pubsub-b				2.08
mod-users-b				2.01
mod-feesfines-b				1.64
mod-roles-keycloak-b				1.4
mod-configuration-b				1.12
edge-patron-b				1.11
mod-remote-storage-b				1.07
mod-patron-blocks-b				0.83
mod-audit-b				0.6
mgr-tenant-entitlements-b				0.6
mgr-tenants-b				0.58
mgr-applications-b				0.56
mod-source-record-manager-b				0.54

Image Added

Longevity test 10 hours

Image Added

Longevity test 24 hours

Image Added

Memory Consumption

45 minute and longevity tests didn't reveal some problems with memory usage by modules. So no memory leaks detected. Modules that consumed max memory - mod-search - 94%, mod-oa - 78%, mod-inventory - 72%, mod-dcb - 71%

Expand

title	Memory usage by modules

Service Name	Memory 75 vUsers	Service Name	Memory 30 vUsers Longevity 10 hours
mod-inventory-b	81.19	mod-search-b	90.1
mod-search-b	68.23	mod-inventory-b	70.6
mod-agreements-b	65.43	mod-scheduler-b	69.72
mod-users-keycloak-b	64.15	mod-agreements-b	67.9
mgr-applications-b	63.73	mod-users-keycloak-b	64.95
mod-scheduler-b	63.36	folio-keycloak-b	64.87
mgr-tenant-entitlements-b	61.72	mgr-applications-b	64.62
mod-roles-keycloak-b	61.5	mgr-tenant-entitlements-b	63.84
folio-keycloak-b	57.62	mod-roles-keycloak-b	62.91
mod-notes-b	56.01	mod-notes-b	59.3
mod-lists-b	55.4	mod-lists-b	57.03
mod-data-export-worker-b	54.31	mod-data-export-worker-b	56.41
mod-users-b	53.11	mod-patron-blocks-b	55.2
mgr-tenants-b	53.01	mgr-tenants-b	54.02
mod-feesfines-b	52.16	mod-users-b	53.98
mod-login-keycloak-b	51.31	mod-feesfines-b	53.8
mod-service-interaction-b	50.98	mod-invoice-b	53.13
mod-orders-b	50.98	mod-serials-management-b	53
mod-invoice-b	50.74	mod-login-keycloak-b	52.52
mod-audit-b	50.59	mod-service-interaction-b	52.26

45 minute tests

Image Added

Longevity test 10 hours

Image Added

Longevity test 24 hours

Image Added

RDS CPU Utilization

RDS CPU utilized:

8 vUsers - 14%, 20 vUsers - 26%, 30 vUsers - 35%, 75 vUsers - 36% During longevity test CPU stayed on the same level - 38%

45 minute tests

Image Added

Longevity test 10 hours

Image Added

Longevity test 24 hours

During the test RDS grew from 32% to 40% in average. Spikes observed after 10 hours

Image Added

RDS Database Connections

For both 45 minute and longevity tests RDS used max 867 connections. Without test it was 812 connections.

45 minute tests

Image Added

Longevity test

Image Added

CPU (User) usage by broker

Common CPU utilization by broker during all tests was 18, 15, 15, 13 % accordingly to broker distribution in 45 min tests

Common CPU utilization by broker during longevity was 18, 18, 16, 14% accordingly to broker distribution. Resource utilization decreased significantly after 6 hours 20 minutes (17:40 UTC) to 14, 12, 12, 11%

45 minute tests

Image Added

Longevity test

Image Added

Database load

45 minute tests

Image Added

Longevity

Image Added

Target Group 5XX Count

Longevity test 24 hours

Image Added

Appendix

Infrastructure

PTF environment qecp1
11 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 1 instance of db.r6.xlarge database instance: Writer instance MSK tenant [ kafka configurations] 4 kafka.m5.2xlarge brokers in 2 zones Apache Kafka version 2.8.0 EBS storage volume per broker 300 GiB auto.create.topics.enable=true log.retention.minutes=480 default.replication.factor=3

DB table records size:

fs09000000
- instances - 24493326
- items - 25662862
- holding records - 24459683

Modules

Expand

title	All modules

Module	Task Definition Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft Limit	CPU Units	Xmx	Metaspace Size	Max Metaspace Size
mod-remote-storage	3	mod-remote-storage:3.2.0	2	4920	4472	0	3960	512	512
mod-remote-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-ncip	3	mod-ncip:1.14.5	2	1024	896	0	768	88	128
mod-ncip - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-finance-storage	3	mod-finance-storage:8.6.1	2	1024	896	0	700	88	128
mod-finance-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-agreements	3	mod-agreements:7.0.6	2	1592	1488	0	0	0	0
mod-agreements - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-ebsconet	3	mod-ebsconet:2.2.0	2	1248	1024	0	700	128	256
mod-ebsconet - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-organizations	3	mod-organizations:1.9.2	2	1024	896	0	768	88	128
mod-organizations - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-sip2	2	edge-sip2:3.2.5	2	1024	896	0	768	88	128
mod-settings	3	mod-settings:1.0.3	2	1024	896	0	768	88	128
mod-settings - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-serials-management	3	mod-serials-management:1.0.3	2	2480	2312	0	1792	384	512
mod-serials-management - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-search	3	mod-search:3.2.6	2	2592	2480	0	1440	512	1024
mod-search - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-import	3	mod-data-import:3.1.1	1	2048	1844	0	1292	384	512
mod-data-import - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-dematic	2	edge-dematic:2.2.3	1	1024	896	0	768	88	128
mod-tags	3	mod-tags:2.2.0	2	1024	896	0	768	88	128
mod-tags - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-courses	2	edge-courses:1.4.3	2	1024	896	0	768	88	128
mod-notify	3	mod-notify:3.2.0	2	1024	896	0	768	88	128
mod-notify - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory-update	3	mod-inventory-update:3.3.1	2	1024	896	0	768	88	128
mod-inventory-update - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-configuration	3	mod-configuration:5.10.0	2	1024	896	0	768	88	128
mod-configuration - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-orders-storage	3	mod-orders-storage:13.7.4	2	1024	896	0	700	88	128
mod-orders-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
folio-keycloak	3	folio-keycloak:25.0.3	1	2400	2048	0	2048	0	0
edge-caiasoft	2	edge-caiasoft:2.2.4	2	1024	896	0	768	88	128
mod-licenses	3	mod-licenses:6.0.3	2	2480	2312	0	1792	384	512
mod-licenses - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-gobi	3	mod-gobi:2.8.1	2	1024	896	0	768	88	128
mod-gobi - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-password-validator	3	mod-password-validator:3.2.1	2	1440	1298	0	768	384	512
mod-password-validator - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-fqm-manager	3	mod-fqm-manager:2.0.5	0	1024	896	0	768	88	128
mod-fqm-manager - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-bulk-operations	3	mod-bulk-operations:2.0.2	2	3072	2600	0	1536	384	512
mod-bulk-operations - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-graphql	3	mod-graphql:1.12.1	2	1024	896	0	768	88	128
mod-graphql - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-finance	3	mod-finance:4.9.0	2	1024	896	0	768	88	128
mod-finance - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-roles-keycloak	3	mod-roles-keycloak:1.4.5	2	1024	896	0	512	88	256
mod-roles-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-batch-print	3	mod-batch-print:1.1.0	2	1024	896	0	768	88	128
mod-batch-print - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-copycat	3	mod-copycat:1.6.0	2	1024	896	0	768	88	128
mod-copycat - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-lists	4	mod-lists:2.0.6	2	1024	896	0	768	88	128
mod-lists - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-entities-links	3	mod-entities-links:3.0.2	2	2592	2480	0	1440	0	1024
mod-entities-links - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-permissions	6	mod-permissions:6.5.0	2	1684	1544	512	1024	384	512
mod-permissions - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
pub-edge	1	pub-edge:2023.06.14	2	1024	896	0	768	0	0
mod-orders	3	mod-orders:12.8.8	2	2048	1740	0	1024	384	512
mod-orders - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
kong	9	kong:3.7.1	1	6144	6144	2048	768	88	128
edge-patron	2	edge-patron:5.1.2	2	1024	896	256	768	88	128
mod-users-keycloak	3	mod-users-keycloak:1.5.3	2	1024	896	0	512	88	256
mod-users-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-ncip	2	edge-ncip:1.10.1	2	1024	896	0	768	88	128
mgr-applications	2	mgr-applications:1.3.3	1	1024	896	512	512	88	256
mod-users-bl	3	mod-users-bl:7.8.0	2	1440	1152	0	922	88	128
mod-users-bl - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mgr-tenants	2	mgr-tenants:1.3.3	1	1024	896	512	512	88	256
mod-invoice	3	mod-invoice:5.8.2	2	1440	1152	0	922	88	128
mod-invoice - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory-storage	4	mod-inventory-storage:27.1.4	2	4096	3690	0	3076	384	512
mod-inventory-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	256	0	0
mod-user-import	3	mod-user-import:3.8.0	2	1024	896	0	768	88	128
mod-user-import - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-sender	3	mod-sender:1.12.0	2	1024	896	0	768	88	128
mod-sender - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-oai-pmh	2	edge-oai-pmh:2.9.2	2	1512	1360	1024	1440	384	512
mod-login-keycloak	8	mod-login-keycloak:1.4.4	2	1024	896	0	512	88	256
mod-login-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mgr-tenant-entitlements	2	mgr-tenant-entitlements:1.2.4	1	1024	896	512	512	88	256
mod-data-export-worker	3	mod-data-export-worker:3.2.4	2	3072	2800	0	2048	384	512
mod-data-export-worker - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-rtac	4	mod-rtac:3.6.0	2	1024	896	0	768	88	128
mod-rtac - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	256	0	0
mod-circulation-storage	4	mod-circulation-storage:17.2.3	2	2880	2592	0	1814	384	512
mod-circulation-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	256	0	0
mod-source-record-storage	4	mod-source-record-storage:5.8.6	2	5600	5000	0	3500	384	512
mod-source-record-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-scheduler	3	mod-scheduler:1.2.3	2	1024	896	0	512	88	256
mod-scheduler - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-calendar	4	mod-calendar:3.1.0	2	2048	1536	0	768	88	128
mod-calendar - Sidecar 1	N/A	folio-module-sidecar:1.0.0.317	N/A	665	512	0	128	0	0
mod-event-config	3	mod-event-config:2.7.1	2	1024	896	0	768	88	128
mod-event-config - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-courses	3	mod-courses:1.4.10	2	1024	896	0	768	88	128
mod-courses - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory	5	mod-inventory:20.2.7	2	2881	2592	0	1814	384	512
mod-inventory - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-email	3	mod-email:1.17.0	2	2800	2550	0	1800	384	512
mod-email - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-di-converter-storage	3	mod-di-converter-storage:2.2.2	2	1024	896	0	768	88	128
mod-di-converter-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-pubsub	3	mod-pubsub:2.14.0	2	1536	1440	0	922	384	512
mod-pubsub - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-circulation	4	mod-circulation:24.2.5	2	2880	2592	0	1814	384	512
mod-circulation - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	256	0	0
edge-orders	2	edge-orders:3.0.3	2	1024	896	0	768	88	128
edge-rtac	2	edge-rtac:2.7.3	2	1024	896	0	768	88	128
mod-template-engine	3	mod-template-engine:1.20.0	2	1024	896	0	768	88	128
mod-template-engine - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-users	3	mod-users:19.3.1	2	1024	896	0	768	88	128
mod-users - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-patron-blocks	3	mod-patron-blocks:1.10.0	2	1024	896	0	768	88	128
mod-patron-blocks - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-audit	3	mod-audit:2.9.0	2	1024	896	0	768	88	128
mod-audit - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-fqm	2	edge-fqm:2.0.2	2	1024	896	0	768	88	128
mod-source-record-manager	3	mod-source-record-manager:3.8.6	2	5600	5000	0	3500	384	512
mod-source-record-manager - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
nginx-edge	1	nginx-edge:2023.06.14	1	1024	896	0	0	0	0
mod-quick-marc	3	mod-quick-marc:5.1.1	1	2288	2176	0	1664	384	512
mod-quick-marc - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-feesfines	3	mod-feesfines:19.1.0	2	1024	896	0	768	88	128
mod-feesfines - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-invoice-storage	3	mod-invoice-storage:5.8.2	2	1872	1536	0	1024	384	512
mod-invoice-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-service-interaction	3	mod-service-interaction:4.0.2	2	2048	1844	0	1290	384	512
mod-service-interaction - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-export	11	mod-data-export:5.0.4	1	2592	2480	0	1440	88	1024
mod-data-export - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-patron	3	mod-patron:6.1.0	2	1024	896	0	768	88	128
mod-patron - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-oai-pmh	3	mod-oai-pmh:3.13.2	2	4096	3690	0	3076	384	512
mod-oai-pmh - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-connexion	2	edge-connexion:1.3.1	2	1024	896	0	768	88	128
mod-kb-ebsco-java	3	mod-kb-ebsco-java:4.0.0	2	1024	896	0	768	88	128
mod-kb-ebsco-java - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-notes	3	mod-notes:5.2.0	2	1024	896	0	952	384	512
mod-notes - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-organizations-storage	3	mod-organizations-storage:4.7.0	2	1024	896	0	768	88	128
mod-organizations-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-export-spring	3	mod-data-export-spring:3.2.2	1	2048	1844	0	1536	384	512
mod-data-export-spring - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-erm	2	edge-erm:1.2.1	2	1024	896	0	768	88	128

Methodology/Approach

Steps to avoid possible session or token expiration:
- modify tenant/realm-settings/sessions in keycloaks UI to 24 hours (1 day) Default - 10 hours

Run data preparation script before each CI/CO test
Update .jmx file script for Quesnelia release
Create artefact and upload to carrier-io
Use Jenkins job to change parameters and run tests
Test CI/CO with 8, 20, 30, 75 concurrent users for 45 minutes each.
Test CI/CO with 30 users for 24 hours to detect any trends in memory.

...

Versions Compared

Old Version 1

New Version Current

Key

Overview

Summary IN-PROGRESS

Recommendations

Test Runs

Results

Errors:

Comparisons

Resources Utilization

CPU Utilization

Memory Consumption

RDS CPU Utilization

RDS Database Connections

CPU (User) usage by broker

Database load

Appendix

Infrastructure

Table of Contents

Overview

Summary

Recommendations

Test Runs

Results

Comparisons

Resources Utilization

CPU Utilization

Memory Consumption

RDS CPU Utilization

RDS Database Connections

CPU (User) usage by broker

Database load

Target Group 5XX Count

Appendix

Infrastructure

Methodology/Approach

Page Comparison

Versions Compared

Old Version 1

New Version Current

Key

<span class="diff-html-changed" data-a11y-before="Start of changed content" data-a11y-after="End of changed content" id="changed-diff-0">[data-colorid=</span>

Overview

Summary IN-PROGRESS

Recommendations

Test Runs

Results

Errors:

Comparisons

Resources Utilization

CPU Utilization

Memory Consumption

RDS CPU Utilization

RDS Database Connections

CPU (User) usage by broker

Database load

Appendix

Infrastructure

<span class="diff-html-added" data-a11y-before="Start of added content" data-a11y-after="End of added content" id="added-diff-37">kr93uriccp]{color:#e0e3e9}</span> Table of Contents

Overview

Summary

Recommendations

Test Runs

Results

Comparisons

Resources Utilization

CPU Utilization

Memory Consumption

RDS CPU Utilization

RDS Database Connections

CPU (User) usage by broker

Database load

Target Group 5XX Count

Appendix

Infrastructure

Methodology/Approach

Table of Contents