Table of Contents

Overview

In this workflow, we perform a load test on mod-search for the Quesnelia release.
Run these tests in both Quesnelia (qcp1) for baseline numbers and Eureka Quesnelia (qep1) environments and compare results
Run test with 1, 20 virtual users on non-Eureka and Eureka environments.
Jira Legacy
server System Jira
serverId 01505d01-b853-3c2e-90f1-ee9b165564fc
key PERF-993

Summary

For a single user, performance is better in the Eureka environment. However, when scaled to 20 vusers, there is a performance degradation of approximately 7.8%
Very high load for the OpenSearch cluster with more than 52 search operations per second. ERROR: "Too Many Requests" observed during the test with 20 vusers - non-Eureka.
Service CPU utilization was up to 14% for mod-search, for all other services CPU did not exceed 6%.
Memory utilization was stable and no memory leaks or OOM issues were observed.
RDS CPU utilization was about up to 10% for all tests.
Non-Eureka environment uses 50 fewer database connections than Eureka.
Open search CPU utilization was up to 100% with 20 user tests.

Recommendations & Jiras

Errors during 20 vusers - non-Eureka test are due to a very high load for the OpenSearch cluster. For this test we have a throughput of about 55 ops/s and the maximal Elastic Search throughput is 52 search operations (https://repost.aws/knowledge-center/opensearch-resolve-429-error) according to our cluster configurations.

Use the following formula to calculate maximum active threads for search requests:int ((# of available_processors * 3) / 2) + 1.
For an r6g.2xlarge.search node, you can perform a maximum of 13 search operations:
(8 VCPUs * 3) / 2 + 1 = 13 operations
For an OpenSearch Service cluster with four nodes, you can perform a maximum of 52 search operations:
4 nodes * 13 = 52 operations

To avoid this error, either increase the number of OpenSearch data nodes to 5 or scale the size of the data nodes to a bigger one.

Test Runs

60 minutes tests

...

Results and Comparison Eureka and non-Eureka

mod-search performance is good, maximal Elastic Search throughput is 52 search operations (https://repost.aws/knowledge-center/opensearch-resolve-429-error).

Show total requests processed increase as we increase the number of users concurrently.

...

55.2 ops/s

...

Test Details

1 vuser - non-Eureka

...

Table of Contents

Overview

In this workflow, we perform a load test on mod-search for the Quesnelia release.
Run these tests in both Quesnelia (qcp1) for baseline numbers and Eureka Quesnelia (qep1) environments and compare results
Run test with 1, 20 virtual users on non-Eureka and Eureka environments.
Jira Legacy
server System Jira
serverId 01505d01-b853-3c2e-90f1-ee9b165564fc
key PERF-993

Summary

For a single user, performance is better in the Eureka environment. However, when scaled to 20 vusers, there is a performance degradation of approximately 7.8%
Very high load for the OpenSearch cluster with more than 52 search operations per second. ERROR: "Too Many Requests" observed during the test with 20 vusers - non-Eureka.
Service CPU utilization was up to 14% for mod-search, for all other services CPU did not exceed 6%.
Memory utilization was stable and no memory leaks or OOM issues were observed.
RDS CPU utilization was about up to 10% for all tests.
Non-Eureka environment uses 50 fewer database connections than Eureka.
Open search CPU utilization was up to 100% with 20 user tests.

Recommendations & Jiras

Errors during 20 vusers - non-Eureka test are due to a very high load for the OpenSearch cluster. For this test we have a throughput of about 55 ops/s and the maximal Elastic Search throughput is 52 search operations (https://repost.aws/knowledge-center/opensearch-resolve-429-error) according to our cluster configurations.

Use the following formula to calculate maximum active threads for search requests:int ((# of available_processors * 3) / 2) + 1.
For an r6g.2xlarge.search node, you can perform a maximum of 13 search operations:
(8 VCPUs * 3) / 2 + 1 = 13 operations
For an OpenSearch Service cluster with four nodes, you can perform a maximum of 52 search operations:
4 nodes * 13 = 52 operations

To avoid this error, either increase the number of OpenSearch data nodes to 5 or scale the size of the data nodes to a bigger one.

Test Runs

60 minutes tests

Test#	Test name	results	Comments
1	1 vuser - non-Eureka	Success	0 errors
2	20 vusers - non-Eureka	Completed with errors	3224 errors out of 199179 API calls ERROR: "Too Many Requests"
3	20 vusers - non-Eureka retest	Completed with errors	41894 errors out of 252249 API calls ERROR: "Too Many Requests"
4	1 vuser - Eureka	Success	0 errors
5	20 vusers - Eureka	Success	0 errors

Results and Comparison Eureka and non-Eureka

mod-search performance is good, maximal Elastic Search throughput is 52 search operations (https://repost.aws/knowledge-center/opensearch-resolve-429-error).

Show total requests processed increase as we increase the number of users concurrently.

	1 vuser - non-Eureka(avg)	1 vuser - Eureka (avg)	%	20 vusers - non-Eureka(avg)	20 vusers - Eureka (avg)	%
Total requests processed in 60 minutes test run	19657	20811	5.9%	199179 (3224 errors)	183864	-7.6%
Average throughput	5.44 ops/s	5.77 ops/s	6%	55.2 ops/s	50.9 ops/s	-7.8%
Average response time	194	185	-4.6%	365	382	4.7%

	1 vuser - non-Eureka		1 vuser - Eureka			20 vusers - non-Eureka		20 vusers - Eureka
transaction	Number Of Samples	Average	Number Of Samples	Average	%	Number Of Samples	Average	Number Of Samples	Average	%
MSF_GET /search/authorities keyword <> random sentence	393	207	416	200	-3.38164	3943	540	3682	477	-11.6667
MSF_GET /search/authorities keyword <> randomword	393	202	417	194	-3.9604	4104	516	3684	462	-10.4651
MSF_GET /search/authorities keyword = random sentence	393	1224	416	1142	-6.69935	3933	2120	3682	1545	-27.1226
MSF_GET /search/authorities keyword = random sentence	393	30	416	23	-23.3333	3937	95	3682	245	157.8947
MSF_GET /search/authorities keyword = randomword	393	44	417	32	-27.2727	4246	127	3684	234	84.25197
MSF_GET /search/authorities keyword == random sentence	393	29	416	22	-24.1379	3949	92	3683	225	144.5652
MSF_GET /search/authorities keyword == randomword	393	43	417	31	-27.907	4041	138	3683	244	76.81159
MSF_GET /search/authorities keyword all randomword	393	891	417	821	-7.85634	3997	1626	3683	1191	-26.7528
MSF_GET /search/authorities keyword all random sentence	393	32	417	25	-21.875	3979	104	3683	243	133.6538
MSF_GET /search/authorities keyword all randomword	394	67	417	54	-19.403	5481	141	3686	262	85.8156
MSF_GET /search/authorities keyword any random sentence	393	99	416	86	-13.1313	3958	226	3683	272	20.35398
MSF_GET /search/authorities keyword any randomword	394	55	417	43	-21.8182	4618	129	3685	232	79.84496
MSF_GET /search/instances: contributors <> 2random words	393	158	416	152	-3.79747	3877	379	3679	408	7.651715
MSF_GET /search/instances: contributors = *randomword	393	198	416	192	-3.0303	3889	429	3680	441	2.797203
MSF_GET /search/instances: contributors = randomword*	393	57	416	46	-19.2982	3892	101	3680	227	124.7525
MSF_GET /search/instances: contributors == 2random words	393	23	416	17	-26.087	3880	78	3679	217	178.2051
MSF_GET /search/instances: contributors all 2random words	393	23	416	16	-30.4348	3876	85	3677	231	171.7647
MSF_GET /search/instances: contributors all randomword	393	58	416	47	-18.9655	3896	109	3680	232	112.844
MSF_GET /search/instances: contributors any 2random words	393	65	416	51	-21.5385	3885	115	3680	244	112.1739
MSF_GET /search/instances: keyword all random sentence AND languages == randomlang	786	40	832	35	-12.5	7747	98	7354	233	137.7551
MSF_GET /search/instances: languages == (lang) AND items.status.name == ("Available" OR "In transit")	786	119	832	113	-5.04202	7743	273	7350	346	26.73993
MSF_GET /search/instances: languages == lang	786	110	832	104	-5.45455	7743	260	7349	344	32.30769
MSF_GET /search/instances: languages == lang AND items.status.name == "Available"	786	123	832	114	-7.31707	7744	287	7350	353	22.99652
MSF_GET /search/instances: subjects <> 1randomword	393	70	416	59	-15.7143	3867	126	3670	338	168.254
MSF_GET /search/instances: subjects = (randomword OR randomword)	393	67	416	52	-22.3881	3905	129	3682	247	91.47287
MSF_GET /search/instances: subjects = *1randomword	393	314	416	318	1.273885	3868	645	3672	601	-6.82171
MSF_GET /search/instances: subjects = 1randomword*	393	70	416	58	-17.1429	3869	113	3672	235	107.9646
MSF_GET /search/instances: subjects == 1randomword	393	40	416	32	-20	3868	123	3670	232	88.61789
MSF_GET /search/instances: subjects all 1randomword	393	47	416	37	-21.2766	3869	124	3672	241	94.35484
MSF_GET /search/instances: subjects all randomword AND title all randomword	393	36	416	27	-25	3930	98	3682	237	141.8367
MSF_GET /search/instances: subjects all randomword NOT title all randomword	393	81	416	67	-17.284	3900	125	3681	235	88
MSF_GET /search/instances: subjects all randomword OR title all randomword	393	96	416	83	-13.5417	3913	165	3682	261	58.18182
MSF_GET /search/instances: subjects any 2random words	393	63	416	52	-17.4603	3868	133	3670	255	91.72932
MSF_GET /search/instances: title <> 3 word sentence	393	167	416	167	0	3863	403	3670	415	2.977667
MSF_GET /search/instances: title == 3 word sentence	393	36	416	29	-19.4444	3866	93	3670	237	154.8387
MSF_GET /search/instances: title all *1randomword	393	3403	416	3465	1.821922	3859	5471	3670	3984	-27.1797
MSF_GET /search/instances: title all 1randomword*	393	94	416	78	-17.0213	3860	144	3670	264	83.33333
MSF_GET /search/instances: title all 3 word sentence	393	40	416	38	-5	3867	101	3670	236	133.6634
MSF_GET /search/instances: title any 3 word sentence	393	408	416	395	-3.18627	3867	735	3670	653	-11.1565
Total	16901	194.1087	17895	185.1522	-4.61418	170397	365.1304	158131	382.1522	4.661824

Test Details

1 vuser - non-Eureka

transaction	Number Of Samples	Average	Median	pct90	pct95	pct99	Min	Max
MSF_GET /search/authorities keyword <> random sentence	393	207	206	241	252	266	171	266
MSF_GET /search/authorities keyword <> randomword	393	202	202	241	250	311	165	311
MSF_GET /search/authorities keyword = random sentence	393	1224	1220	1468	1481	1509	921	1509
MSF_GET /search/authorities keyword = random sentence	393	30	30	39	53	115	22	116
MSF_GET /search/authorities keyword = randomword	393	44	44	91	134	201	19	201
MSF_GET /search/authorities keyword == random sentence	393	29	28	40	46	64	21	65
MSF_GET /search/authorities keyword == randomword	393	43	44	112	136	175	19	175
MSF_GET /search/authorities keyword all randomword	393	891	895	1331	1343	1382	500	1382
MSF_GET /search/authorities keyword all random sentence	393	32	30	43	65	196	23	196
MSF_GET /search/authorities keyword all randomword	394	67	64	173	332	383	19	383
MSF_GET /search/authorities keyword any random sentence	393	99	83	218	305	310	23	310
MSF_GET /search/authorities keyword any randomword	394	55	55	140	152	244	18	244
MSF_GET /search/instances: contributors <> 2random words	393	158	158	183	188	225	131	225
MSF_GET /search/instances: contributors = *randomword	393	198	189	394	646	668	157	668
MSF_GET /search/instances: contributors = randomword*	393	57	48	210	221	263	17	264
MSF_GET /search/instances: contributors == 2random words	393	23	23	34	51	144	16	145
MSF_GET /search/instances: contributors all 2random words	393	23	23	32	44	103	17	103
MSF_GET /search/instances: contributors all randomword	393	58	58	159	225	396	17	398
MSF_GET /search/instances: contributors any 2random words	393	65	66	134	187	434	18	437
MSF_GET /search/instances: keyword all random sentence AND languages == randomlang	786	40	29	131	257	294	22	294
MSF_GET /search/instances: languages == (lang) AND items.status.name == ("Available" OR "In transit")	786	119	119	264	271	319	41	319
MSF_GET /search/instances: languages == lang	786	110	110	248	252	294	40	294
MSF_GET /search/instances: languages == lang AND items.status.name == "Available"	786	123	121	262	270	331	41	331
MSF_GET /search/instances: subjects <> 1randomword	393	70	69	115	159	228	18	229
MSF_GET /search/instances: subjects = (randomword OR randomword)	393	67	67	118	192	565	19	565
MSF_GET /search/instances: subjects = *1randomword	393	314	309	475	543	546	259	546
MSF_GET /search/instances: subjects = 1randomword*	393	70	63	208	309	322	17	322
MSF_GET /search/instances: subjects == 1randomword	393	40	40	73	94	258	16	259
MSF_GET /search/instances: subjects all 1randomword	393	47	46	91	124	442	18	444
MSF_GET /search/instances: subjects all randomword AND title all randomword	393	36	33	76	124	136	19	136
MSF_GET /search/instances: subjects all randomword NOT title all randomword	393	81	77	162	302	407	19	409
MSF_GET /search/instances: subjects all randomword OR title all randomword	393	96	96	199	298	670	30	673
MSF_GET /search/instances: subjects any 2random words	393	63	60	125	228	380	19	381
MSF_GET /search/instances: title <> 3 word sentence	393	167	167	197	207	218	138	218
MSF_GET /search/instances: title == 3 word sentence	393	36	29	134	200	218	21	218
MSF_GET /search/instances: title all *1randomword	393	3403	3401	4602	7838	9273	2276	9273
MSF_GET /search/instances: title all 1randomword*	393	94	87	230	270	722	22	727
MSF_GET /search/instances: title all 3 word sentence	393	40	31	135	153	186	20	186
MSF_GET /search/instances: title any 3 word sentence	393	408	384	1498	1611	1820	39	1823
MSF_TC: mod search by auth query fs09000000	393	2923	2895	3552	3735	3778	2040	3778
MSF_TC: mod search by boolean query fs09000000	393	280	274	550	616	1012	112	1014
MSF_TC: mod search by contributors query fs09000000	393	583	567	998	1149	1687	392	1696
MSF_TC: mod search by filter query fs09000000	393	396	377	886	1066	1080	150	1080
MSF_TC: mod search by keyword query fs09000000	393	394	378	864	974	990	151	990
MSF_TC: mod search by subject query fs09000000	393	603	587	903	944	1578	365	1583
MSF_TC: mod search by title query fs09000000	393	4149	4084	5985	8930	10027	2617	10027

Image Added

1 vuser - Eureka

transaction	Number Of Samples	Average	Median	pct90	pct95	pct99	Min	Max
MSF_GET /search/authorities keyword <> random sentence	416	200	199	233	240	276	167	276
MSF_GET /search/authorities keyword <> randomword	417	194	192	227	268	293	161	293
MSF_GET /search/authorities keyword = random sentence	416	1142	1144	1352	1381	1412	913	1412
MSF_GET /search/authorities keyword = random sentence	416	23	22	26	84	98	18	98
MSF_GET /search/authorities keyword = randomword	417	32	31	79	104	127	14	127
MSF_GET /search/authorities keyword == random sentence	416	22	21	26	79	92	18	92
MSF_GET /search/authorities keyword == randomword	417	31	29	66	90	174	14	174
MSF_GET /search/authorities keyword all randomword	417	821	824	1216	1236	1345	492	1346
MSF_GET /search/authorities keyword all random sentence	417	25	23	31	151	181	19	181
MSF_GET /search/authorities keyword all randomword	417	54	48	152	234	544	15	548
MSF_GET /search/authorities keyword any random sentence	416	86	67	182	563	581	18	581
MSF_GET /search/authorities keyword any randomword	417	43	41	134	229	249	14	249
MSF_GET /search/instances: contributors <> 2random words	416	152	151	173	184	195	129	195
MSF_GET /search/instances: contributors = *randomword	416	192	181	271	670	676	158	676
MSF_GET /search/instances: contributors = randomword*	416	46	36	203	245	379	12	379
MSF_GET /search/instances: contributors == 2random words	416	17	16	34	58	224	12	225
MSF_GET /search/instances: contributors all 2random words	416	16	15	19	23	41	13	41
MSF_GET /search/instances: contributors all randomword	416	47	44	132	227	336	12	338
MSF_GET /search/instances: contributors any 2random words	416	51	51	110	177	407	13	410
MSF_GET /search/instances: keyword all random sentence AND languages == randomlang	832	35	22	178	372	510	17	510
MSF_GET /search/instances: languages == (lang) AND items.status.name == ("Available" OR "In transit")	832	113	111	259	373	375	38	375
MSF_GET /search/instances: languages == lang	832	104	103	242	247	255	36	255
MSF_GET /search/instances: languages == lang AND items.status.name == "Available"	832	114	113	252	259	314	37	314
MSF_GET /search/instances: subjects <> 1randomword	416	59	55	121	151	182	13	183
MSF_GET /search/instances: subjects = (randomword OR randomword)	416	52	51	98	121	309	14	310
MSF_GET /search/instances: subjects = *1randomword	416	318	306	481	843	870	264	870
MSF_GET /search/instances: subjects = 1randomword*	416	58	47	239	269	538	12	538
MSF_GET /search/instances: subjects == 1randomword	416	32	32	56	72	243	12	245
MSF_GET /search/instances: subjects all 1randomword	416	37	35	78	114	239	13	240
MSF_GET /search/instances: subjects all randomword AND title all randomword	416	27	22	87	108	141	14	141
MSF_GET /search/instances: subjects all randomword NOT title all randomword	416	67	57	164	261	277	15	278
MSF_GET /search/instances: subjects all randomword OR title all randomword	416	83	76	197	399	686	22	690
MSF_GET /search/instances: subjects any 2random words	416	52	47	102	182	361	14	362
MSF_GET /search/instances: title <> 3 word sentence	416	167	163	204	410	448	136	448
MSF_GET /search/instances: title == 3 word sentence	416	29	22	88	241	258	16	258
MSF_GET /search/instances: title all *1randomword	416	3465	3402	4696	7599	7650	2261	7650
MSF_GET /search/instances: title all 1randomword*	416	78	66	272	363	701	16	707
MSF_GET /search/instances: title all 3 word sentence	416	38	23	155	251	263	17	263
MSF_GET /search/instances: title any 3 word sentence	416	395	373	1534	1684	1792	32	1795
MSF_TC: mod search by auth query fs09000000	416	2673	2633	3179	3948	4137	2021	4137
MSF_TC: mod search by boolean query fs09000000	416	229	207	495	769	1002	89	1005
MSF_TC: mod search by contributors query fs09000000	416	521	497	807	1311	1566	361	1575
MSF_TC: mod search by filter query fs09000000	416	375	348	854	1303	1357	133	1357
MSF_TC: mod search by keyword query fs09000000	416	369	348	820	1289	1336	133	1336
MSF_TC: mod search by subject query fs09000000	416	555	525	933	1383	1427	353	1427
MSF_TC: mod search by title query fs09000000	416	4172	4034	6379	9095	9209	2558	9209

Image Added

20 vusers - non-Eureka

transaction	NumberOf Samples	Average	Median	pct90	pct95	pct99	Min	Max	Error Count
MSF_GET /search/authorities keyword <> random sentence	3943

393

540

207

553

206

982

241

1317

252

2853

266

28

171

2868

266

5
MSF_GET /search/authorities keyword <> randomword	4104

393

516

202

532

202

934

241

1283

250

3170

311

27

165

3177

311

61
MSF_GET /search/authorities keyword = random sentence	3933

393

2120

1224

2166

1220

2965

1468

3249

1481

4537

1509

37

921

4539

1509

2
MSF_GET /search/authorities keyword = random sentence	3937

393

95

30

96

30

283

39

513

53

1499

115

20

22

1510

116

4
MSF_GET /search/authorities keyword = randomword	4246

393

127

44

130

44

422

91

666

134

2186

201

17

19

2199

201

142

MSF_GET /search/authorities keyword == random sentence

393

3949

29

92

28

95

40

285

46

485

64

1442

21

1452

65

6
MSF_GET /search/authorities keyword == randomword	4041

393

138

43

140

44

439

112

844

136

2044

175

18

19

2049

175

43
MSF_GET /search/authorities keyword all randomword	3997

393

1626

891

1668

895

2593

1331

2876

1343

4135

1382

24

500

4148

1382

17
MSF_GET /search/authorities keyword all random sentence	3979

393

104

32

106

30

338

43

565

65

2167

196

22

23

2173

196

21
MSF_GET /search/authorities keyword all randomword	5481

394

141

67

146

64

466

173

760

332

2589

383

16

19

2606

383

863
MSF_GET /search/authorities keyword any random sentence	3958

393

226

99

233

83

620

218

953

305

2603

310

22

23

2618

310

8

MSF_GET /search/authorities keyword any randomword

394

4618

55

129

55

132

140

426

152

758

244

2308

18

2324

244

372

MSF_GET /search/instances: contributors <> 2random words

393

3877

379

158

389

158

677

183

953

188

2098

225

75

131

2108

225

1
MSF_GET /search/instances: contributors = *randomword	3889

393

429

198

439

189

760

394

1099

646

2051

668

25

157

2062

668

1
MSF_GET /search/instances: contributors = randomword*	3892

393

101

57

104

48

343

210

666

221

1841

263

15

17

1852

264

3

MSF_GET /search/instances: contributors == 2random words

393

3880

78

23

79

23

268

34

475

51

1580

144

15

16

1592

145

2
MSF_GET /search/instances: contributors all 2random words	3876

393

85

23

87

23

289

32

511

44

1806

103

16

17

1816

103

2
MSF_GET /search/instances: contributors all randomword	3896

393

109

58

111

58

376

159

612

225

2466

396

15

17

2481

398

4
MSF_GET /search/instances: contributors any 2random words	3885

393

115

65

117

66

378

134

635

187

1942

434

17

18

1951

437

4
MSF_GET /search/instances: keyword all random sentence AND languages == randomlang	7747

786

98

40

100

29

305

131

530

257

2357

294

20

22

2374

294

3

MSF_GET /search/instances: languages == (lang) AND items.status.name == ("Available" OR "In transit")

786

7743

119

273

119

278

264

699

271

963

319

2421

41

40

319

2424
MSF_GET /search/instances: languages == lang

786

7743

110

260

110

265

248

677

252

919

294

2186

40

2190

294

1

MSF_GET /search/instances: languages == lang AND items.status.name == "Available"

786

7744

123

287

121

292

262

738

270

986

331

2456

41

331

2470
MSF_GET /search/instances: subjects <> 1randomword

393

3867

70

126

69

121

115

388

159

732

228

2354

18

17

229

2358
MSF_GET /search/instances: subjects = (randomword OR randomword)	3905

393

129

67

129

67

422

118

663

192

2617

565

18

19

2631

565

5

MSF_GET /search/instances: subjects = *1randomword

393

3868

314

645

309

659

475

1014

543

1405

546

3126

259

261

546

3133
MSF_GET /search/instances: subjects = 1randomword*	3869

393

113

70

114

63

361

208

642

309

2184

322

16

17

2192

322

1

MSF_GET /search/instances: subjects == 1randomword

393

3868

40

123

40

124

73

410

94

707

258

2189

16

2195

259

1

MSF_GET /search/instances: subjects all 1randomword

393

3869

47

124

46

127

91

392

124

607

442

2507

18

16

444

2519
MSF_GET /search/instances: subjects all randomword AND title all randomword	3930

393

98

36

99

33

326

76

590

124

2195

136

17

19

2211

136

17
MSF_GET /search/instances: subjects all randomword NOT title all randomword	3900

393

125

81

127

77

374

162

615

302

1971

407

18

19

1980

409

4
MSF_GET /search/instances: subjects all randomword OR title all randomword	3913

393

165

96

169

96

465

199

761

298

2590

670

27

30

2604

673

8

MSF_GET /search/instances: subjects any 2random words

393

3868

63

133

60

138

125

399

228

663

380

2313

19

381

2325
MSF_GET /search/instances: title <> 3 word sentence	3863

393

403

167

411

167

737

197

1022

207

2582

218

30

138

2596

218

3
MSF_GET /search/instances: title == 3 word sentence	3866

393

93

36

93

29

301

134

541

200

1697

218

18

21

1705

218

3
MSF_GET /search/instances: title all *1randomword	3859

393

5471

3403

5549

3401

8145

4602

8699

7838

10240

9273

26

2276

10241

9273

4
MSF_GET /search/instances: title all 1randomword*	3860

393

144

94

147

87

410

230

654

270

2262

722

20

22

2278

727

1

MSF_GET /search/instances: title all 3 word sentence

393

3867

40

101

31

102

135

336

153

535

186

1924

20

19

186

1932
MSF_GET /search/instances: title any 3 word sentence

393

3867

408

735

384

741

1498

2713

1611

3093

1820

4191

39

34

1823

4203
MSF_TC: mod search by auth query fs09000000	5475

393

5724

2923

6037

2895

7625

3552

8208

3735

10745

3778

24

2040

10772

3778

1544
MSF_TC: mod search by boolean query fs09000000	3930

393

515

280

536

274

1199

550

1765

616

3572

1012

27

112

3587

1014

34
MSF_TC: mod search by contributors query fs09000000	3891

393

1295

583

1339

567

2194

998

2721

1149

4735

1687

30

392

4750

1696

17
MSF_TC: mod search by filter query fs09000000	3874

393

917

396

944

377

2108

886

2543

1066

4522

1080

147

150

4540

1080

1

MSF_TC: mod search by keyword query fs09000000

393

3872

913

394

937

378

2115

864

2485

974

4516

990

35

151

4530

990

3
MSF_TC: mod search by subject query fs09000000	3869

393

1262

603

1291

587

2177

903

2853

944

5627

1578

379

365

5640

1583

2
MSF_TC: mod search by title query fs09000000	3866

393

6939

4149

7072

4084

10201

5985

11284

8930

14160

10027

355

2617

14171

10027

11

...

Image Added

...

20 vusers - Eureka

transaction	Number Of Samples	Average	Median	pct90	pct95	pct99	Min	Max
MSF_GET /search/authorities keyword <> random sentence

416

3682

200

477

199

487

233

862

240

1148

276

2214

167

175

276

2400

MSF_GET /search/authorities keyword <> randomword

417

3684

194

462

192

472

227

850

268

1108

293

2423

161

166

293

2848

MSF_GET /search/authorities keyword = *random sentence*

416

3682

1142

1545

1144

1555

1352

2153

1381

2548

1412

4332

913

941

1412

4350

MSF_GET /search/authorities keyword = random sentence

416

3682

23

245

22

252

26

653

84

993

98

2623

18

19

98

2635

MSF_GET /search/authorities keyword = randomword

417

3684

32

234

31

236

79

608

104

973

127

3428

14

16

127

3451

MSF_GET /search/authorities keyword == random sentence

416

3683

22

225

21

233

26

591

79

885

92

1783

18

20

92

1792

MSF_GET /search/authorities keyword == randomword

417

3683

31

244

29

252

66

625

90

965

174

3221

14

16

174

3239

MSF_GET /search/authorities keyword all *randomword*

417

3683

821

1191

824

1206

1216

1816

1236

2117

1345

4118

492

518

1346

4139

MSF_GET /search/authorities keyword all random sentence

417

3683

25

243

23

251

31

631

151

936

181

3322

19

21

181

3341

MSF_GET /search/authorities keyword all randomword

417

3686

54

262

48

266

152

660

234

1035

544

2643

15

17

548

2652

MSF_GET /search/authorities keyword any random sentence

416

3683

86

272

67

279

182

603

563

902

581

2910

18

20

581

2920

MSF_GET /search/authorities keyword any randomword

417

3685

43

232

41

237

134

592

229

947

249

3309

14

16

249

3332

MSF_GET /search/instances: contributors <> 2random words

416

3679

152

408

151

418

173

786

184

1073

195

2685

129

133

195

2702

MSF_GET /search/instances: contributors = *randomword

416

3680

192

441

181

451

271

844

670

1064

676

2958

158

162

676

2969

MSF_GET /search/instances: contributors = randomword*

416

3680

46

227

36

234

203

561

245

882

379

3076

12

14

379

3094

MSF_GET /search/instances: contributors == 2random words

416

3679

17

217

16

226

34

594

58

902

224

2062

12

14

225

2073

MSF_GET /search/instances: contributors all 2random words

416

3677

16

231

15

239

19

613

23

952

41

3320

13

14

41

3338

MSF_GET /search/instances: contributors all randomword

416

3680

47

232

44

239

132

592

227

973

336

3142

12

14

338

3157

MSF_GET /search/instances: contributors any 2random words

416

3680

51

244

51

252

110

622

177

984

407

2020

13

15

410

2030

MSF_GET /search/instances: keyword all random sentence AND languages == randomlang

832

7354

35

233

22

237

178

614

372

901

510

3484

17

19

510

3511

MSF_GET /search/instances: languages == (lang) AND items.status.name == ("Available" OR "In transit")

832

7350

113

346

111

356

259

772

373

1084

375

3477

38

39

375

3501

MSF_GET /search/instances: languages == lang

832

7349

104

344

103

350

242

797

247

1114

255

3435

36

38

255

3458

MSF_GET /search/instances: languages == lang AND items.status.name == "Available"

832

7350

114

353

113

360

252

775

259

1085

314

3426

37

39

314

3449

MSF_GET /search/instances: subjects <> 1randomword

416

3670

59

338

55

255

121

926

151

1177

182

2866

13

14

183

2880

MSF_GET /search/instances: subjects = (randomword OR randomword)

416

3682

52

247

51

256

98

609

121

918

309

2879

14

16

310

2896

MSF_GET /search/instances: subjects = *1randomword

416

3672

318

601

306

610

481

1032

843

1365

870

2939

264

268

870

2940

MSF_GET /search/instances: subjects = 1randomword*

416

3672

58

235

47

241

239

589

269

877

538

3489

12

14

538

3509

MSF_GET /search/instances: subjects == 1randomword

416

3670

32

232

32

238

56

595

72

1004

243

2564

12

15

245

2573

MSF_GET /search/instances: subjects all 1randomword

416

3672

37

241

35

248

78

635

114

898

239

3062

13

16

240

3082

MSF_GET /search/instances: subjects all randomword AND title all randomword

416

3682

27

237

22

243

87

620

108

976

141

2919

14

13

141

2935

MSF_GET /search/instances: subjects all randomword NOT title all randomword

416

3681

67

235

57

242

164

580

261

853

277

2493

15

16

278

2508

MSF_GET /search/instances: subjects all randomword OR title all randomword

416

3682

83

261

76

270

197

637

399

998

686

2581

22

26

690

2582

MSF_GET /search/instances: subjects any 2random words

416

3670

52

255

47

264

102

640

182

1031

361

2757

14

15

362

2759

MSF_GET /search/instances: title <> 3 word sentence

416

3670

167

415

163

424

204

770

410

1087

448

2284

136

140

448

2295

MSF_GET /search/instances: title == 3 word sentence

416

3670

29

237

22

244

88

634

241

1073

258

2361

16

18

258

2367

MSF_GET /search/instances: title all *1randomword

416

3670

3465

3984

3402

3988

4696

5754

7599

6226

7650

7451

2261

2260

7650

7453

MSF_GET /search/instances: title all 1randomword*

416

3670

78

264

66

273

272

678

363

977

701

2829

16

17

707

2839

MSF_GET /search/instances: title all 3 word sentence

416

3670

38

236

23

243

155

628

251

891

263

3082

17

18

263

3091

MSF_GET /search/instances: title any 3 word sentence

416

3670

395

653

373

642

1534

1974

1684

2483

1792

5288

32

36

1795

5311

MSF_TC: mod search by auth query fs09000000

416

3682

2673

5627

2633

5750

3179

7399

3948

8206

4137

10533

2021

2217

4137

10551

MSF_TC: mod search by boolean query fs09000000

416

3681

229

980

207

1015

495

1870

769

2341

1002

4271

89

107

1005

4272

MSF_TC: mod search by contributors query fs09000000

416

3677

521

1998

497

2069

807

3160

1311

3756

1566

6881

361

423

1575

6898

MSF_TC: mod search by filter query fs09000000

416

3677

375

1267

348

1310

854

2360

1303

2812

1357

5026

133

144

1357

5043

MSF_TC: mod search by keyword query fs09000000

416

3672

369

1273

348

1315

820128913361331336MSF_TC: mod search by subject query fs09000000416555525933138314273531427

2334	2785	6416	142	6444
MSF_TC: mod search by

title

subject query fs09000000

416

3670

4172

1900

4034

1881

6379

3226

9095

3637

9209

5916

2558

391

9209

Image Removed

20 vusers - non-Eureka

...

Image Removed

20 vusers - Eureka

...

Image Removed

Resource Utilization

Memory Utilization

1 vuser - non-Eureka

Image Removed

1 vuser - Eureka

Image Removed

20 vusers - non-Eureka

Image Removed

20 vusers - Eureka

Image Removed

Service CPU Utilization

1 vuser - non-Eureka

Image Removed

1 vuser - Eureka

Image Removed

20 vusers - non-Eureka

Image Removed

20 vusers - Eureka

Image Removed

RDS CPU Utilization

1 vuser - non-Eureka

Image Removed

1 vuser - Eureka

Image Removed

20 vusers - non-Eureka

Image Removed

20 vusers - Eureka

Image Removed

RDS Connections count

1 vuser - non-Eureka

Image Removed

1 vuser - Eureka

Image Removed

20 vusers - non-Eureka

Image Removed

20 vusers - Eureka

Image Removed

OpenSearch metrics

Image Removed

Appendix

Infrastructure

...

11 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 instance of db.r6.xlarge database instance: Writer instance
MSK tenant [ kafka configurations]
- 4 kafka.m5.2xlarge brokers in 2 zones
- Apache Kafka version 2.8.0
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3

...

DB table records size:

fs09000000
- instances - 24493326
- items - 25662862
- holding records - 24459683

Files

Modules

...

title	All modules

...

5920
MSF_TC: mod search by title query fs09000000	3670	5787	5851	8198	9116	11512	2621	11530

Image Added

Resource Utilization

Memory Utilization

1 vuser - non-Eureka

Image Added

1 vuser - Eureka

Image Added

20 vusers - non-Eureka

Image Added

20 vusers - Eureka

Image Added

Service CPU Utilization

1 vuser - non-Eureka

Image Added

1 vuser - Eureka

Image Added

20 vusers - non-Eureka

Image Added

20 vusers - Eureka

Image Added

RDS CPU Utilization

1 vuser - non-Eureka

Image Added

1 vuser - Eureka

Image Added

20 vusers - non-Eureka

Image Added

20 vusers - Eureka

Image Added

RDS Connections count

1 vuser - non-Eureka

Image Added

1 vuser - Eureka

Image Added

20 vusers - non-Eureka

Image Added

20 vusers - Eureka

Image Added

OpenSearch metrics

Image Added

Appendix

Infrastructure

PTF environment qecp1
11 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 1 instance of db.r6.xlarge database instance: Writer instance MSK tenant [ kafka configurations] 4 kafka.m5.2xlarge brokers in 2 zones Apache Kafka version 2.8.0 EBS storage volume per broker 300 GiB auto.create.topics.enable=true log.retention.minutes=480 default.replication.factor=3

DB table records size:

fs09000000
- instances - 24493326
- items - 25662862
- holding records - 24459683

Files

Modules

Expand

title	All modules

pub-edge:2023.06.14

Module	Task Definition Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft Limit	CPU Units	Xmx	Metaspace Size	Max Metaspace Size
mod-remote-storage	3	mod-remote-storage:3.2.0	2	4920	4472	0	3960	512	512
mod-remote-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-ncip	3	mod-ncip:1.14.5	2	1024	896	0	768	88	128
mod-ncip - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-finance-storage	3	mod-finance-storage:8.6.1	2	1024	896	0	700	88	128
mod-finance-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-agreements	3	mod-agreements:7.0.6	2	1592	1488	0	0	0	0
mod-agreements - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-ebsconet	3	mod-ebsconet:2.2.0	2	1248	1024	0	700	128	256
mod-ebsconet - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-organizations	3	mod-organizations:1.9.2	2	1024	896	0	768	88	128
mod-organizations - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-sip2	2	edge-sip2:3.2.5	2	1024	896	0	768	88	128
mod-settings	3	mod-settings:1.0.3	2	1024	896	0	768	88	128
mod-settings - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-serials-management	3	mod-serials-management:1.0.3	2	2480	2312	0	1792	384	512
mod-serials-management - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-search	3	mod-search:3.2.6	2	2592	2480	0	1440	512	1024
mod-search - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-import	3	mod-data-import:3.1.1	1	2048	1844	0	1292	384	512
mod-data-import - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-dematic	2	edge-dematic:2.2.3	1	1024	896	0	768	88	128
mod-tags	3	mod-tags:2.2.0	2	1024	896	0	768	88	128
mod-tags - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-courses	2	edge-courses:1.4.3	2	1024	896	0	768	88	128
mod-notify	3	mod-notify:3.2.0	2	1024	896	0	768	88	128
mod-notify - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory-update	3	mod-inventory-update:3.3.1	2	1024	896	0	768	88	128
mod-inventory-update - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-configuration	3	mod-configuration:5.10.0	2	1024	896	0	768	88	128
mod-configuration - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-orders-storage	3	mod-orders-storage:13.7.4	2	1024	896	0	700	88	128
mod-orders-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
folio-keycloak	3	folio-keycloak:25.0.3	1	2400	2048	0	2048	0	0
edge-caiasoft	2	edge-caiasoft:2.2.4	2	1024	896	0	768	88	128
mod-licenses	3	mod-licenses:6.0.3	2	2480	2312	0	1792	384	512
mod-licenses - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-gobi	3	mod-gobi:2.8.1	2	1024	896	0	768	88	128
mod-gobi - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-password-validator	3	mod-password-validator:3.2.1	2	1440	1298	0	768	384	512
mod-password-validator - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-fqm-manager	3	mod-fqm-manager:2.0.5	0	1024	896	0	768	88	128
mod-fqm-manager - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-bulk-operations	3	mod-bulk-operations:2.0.2	2	3072	2600	0	1536	384	512
mod-bulk-operations - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-graphql	3	mod-graphql:1.12.1	2	1024	896	0	768	88	128
mod-graphql - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-finance	3	mod-finance:4.9.0	2	1024	896	0	768	88	128
mod-finance - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-roles-keycloak	3	mod-roles-keycloak:1.4.5	2	1024	896	0	512	88	256
mod-roles-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-batch-print	3	mod-batch-print:1.1.0	2	1024	896	0	768	88	128
mod-batch-print - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-copycat	3	mod-copycat:1.6.0	2	1024	896	0	768	88	128
mod-copycat - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-lists	4	mod-lists:2.0.6	2	1024	896	0	768	88	128
mod-lists - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-entities-links	3	mod-entities-links:3.0.2	2	2592	2480	0	1440	0	1024
mod-entities-links - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-permissions	6	mod-permissions:6.5.0	2	1684	1544	512	1024	384	512
mod-permissions - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
pub-edge	1	pub-edge:2023.06.14	2	1024	896	0	768	0	0
mod-orders	3	mod-orders:12.8.8	2	2048	1740	0	1024	384	512
mod-orders - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
kong	9	kong:3.7.1	1	6144	6144	2048	768	88	128
edge-patron	2	edge-patron:5.1.2	2	1024	896	256	768	88	128
mod-users-keycloak	3	mod-users-keycloak:1.5.3	2	1024	896	0	512	88	256
mod-users-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-ncip	2	edge-ncip:1.10.1	2	1024	896	0	768	88	128
mgr-applications	2	mgr-applications:1.3.3	1	1024	896	512	512	88	256
mod-users-bl	3	mod-users-bl:7.8.0	2	1440	1152	0	922	88	128
mod-users-bl - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mgr-tenants	2	mgr-tenants:1.3.3	1	1024	896	512	512	88	256
mod-invoice	3	mod-invoice:5.8.2	2	1440	1152	0	922	88	128
mod-invoice - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory-storage	4	mod-inventory-storage:27.1.4	2	4096	3690	0	3076	384	512
mod-inventory-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	256	0	0
mod-user-import	3	mod-user-import:3.8.0	2	1024	896	0	768	88	128
mod-user-import - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-sender	3	mod-sender:1.12.0	2	1024	896	0	768	88	128
mod-sender - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-oai-pmh	2	edge-oai-pmh:2.9.2	2	1512	1360	1024	1440	384	512
mod-login-keycloak	8	mod-login-keycloak:1.4.4	2	1024	896	0	512	88	256
mod-login-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mgr-tenant-entitlements	2	mgr-tenant-entitlements:1.2.4	1	1024	896	512	512	88	256
mod-data-export-worker	3	mod-data-export-worker:3.2.4	2	3072	2800	0	2048	384	512
mod-data-export-worker - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-rtac	4	mod-rtac:3.6.0	2	1024	896	0	768	88	128
mod-rtac - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	256	0	0
mod-circulation-storage	4	mod-circulation-storage:17.2.3	2	2880	2592	0	1814	384	512
mod-circulation-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128256	0	0
mod-source-record-ncipstorage	34	mod-source-record-ncipstorage:15.148.56	2	10245600	8965000	0	7683500	88384	128512
mod-source-ncip record-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-finance-storagescheduler	3	mod-finance-storagescheduler:81.62.13	2	1024	896	0	700512	88	128256
mod-finance-storage scheduler - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-agreementscalendar	34	mod-agreementscalendar:73.1.0.6	2	15922048	14881536	00	768	0880	128
mod-agreements calendar - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312317	N/A	665	512	0	128	0	0
mod-event-ebsconetconfig	3	mod-event-ebsconetconfig:2.27.01	2	124810241024	896	0	768	70088	128256
mod-event-ebsconet config - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-organizationscourses	3	mod-organizationscourses:1.94.210	2	1024	896	0	768	88	128
mod-organizations courses - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory	5	mod-inventory:20.2.7	2	2881	2592	0
edge-sip2	2	edge-sip2:3.2.5	2	1024	896	0	768	88	128
mod-settings1814	384	512
mod-inventory - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-email	3	mod-settingsemail:1.17.0.3	2	10242800	8962550	0	7681800	88384	128512
mod-settings email - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-di-serialsconverter-managementstorage	3	mod-serialsdi-converter-managementstorage:12.02.32	2	24801024	2312896	0	1792768	38488	512128
mod-di-serialsconverter-management storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-searchpubsub	3	mod-searchpubsub:32.214.60	2	25921536	24801440	0	922	1440384	5121024
mod-search pubsub - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-importcirculation	34	mod-data-importcirculation:324.12.151	2	20482880	18442592	0	12921814	384	512
mod-data-import circulation - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128256	0	0
edge-orders	2	edge-dematicorders:3.0.3	2	1024	896	0	768	88	128
edge-rtac	2	edge-dematicrtac:2.27.3	12	1024	896	0	768	88	128
mod-tagstemplate-engine	3	mod-template-tagsengine:21.220.0	2	1024	896	0	768	88	128
mod-tags template-engine - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edgemod-coursesusers	23	edgemod-coursesusers:119.43.31	2	1024	896	0	768	88	128
mod-users - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-notifypatron-blocks	3	mod-patron-notifyblocks:31.210.0	2	1024	896	0	768	88	128
mod-patron-notify blocks - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory-updateaudit	3	mod-inventory-updateaudit:32.39.10	2	1024	896	0	768	88	128
mod-inventory-update audit - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
modedge-configurationfqm	32	modedge-configurationfqm:52.100.02	2	1024	896	0	768	88	128
mod-configuration -source-record-manager	3	mod-source-record-manager:3.8.6	2	5600	5000	0	3500	384	512
mod-source-record-manager - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
nginx-edge	1	nginx-edge:2023.06.14	1	1024	896	0	0	0	0
mod-ordersquick-storagemarc	3	mod-ordersquick-storagemarc:135.71.41	21	10242288	8962176	0	7001664	88384	128512
mod-ordersquick-storage marc - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
foliomod-keycloakfeesfines	3folio	mod-keycloakfeesfines:2519.0.3	1	2400	2048	0	2048	0	0	edge-caiasoft	2	edge-caiasoft:2.2.4	2	1.0	2	1024	896	0	768	88	128
mod-licenses	3	mod-licenses:6.0.3	2	2480	2312	0	1792	384	512	mod-licenses feesfines - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-invoice-gobistorage	3	mod-invoice-gobistorage:25.8.12	2	10241872	8961536	0	7681024	88384	128512
mod-invoice-gobi storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-passwordservice-validatorinteraction	3	mod-passwordservice-validatorinteraction:34.0.2.1	2	14402048	12981844	0	7681290	384	512
mod-passwordservice-validator interaction - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-fqmdata-managerexport	311	mod-fqmdata-managerexport:25.0.540	1	10242592	8962480	0	7681440	88	1281024
mod-fqmdata-manager export - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-bulk-operationspatron	3	mod-bulk-operations:2patron:6.1.0.2	2	30721024	2600896	0	1536768	38488	512128
mod-bulk-operations patron - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-oai-graphqlpmh	3	mod-graphqloai-pmh:13.1213.12	2	10244096	8963690	0	7683076	88384	128512
mod-oai-graphql pmh - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-connexion	2	edge-connexion:1.3.1	2	1024	896	0	768	88	128
mod-kb-ebsco-financejava	3	mod-kb-financeebsco-java:4.90.0	2	1024	896	0	768	88	128
mod-kb-finance ebsco-java - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-roles-keycloaknotes	3	mod-roles-keycloaknotes:15.42.50	2	1024	896	0	512952	88384	256512
mod-roles-keycloak notes - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-batchorganizations-printstorage	3	mod-batchorganizations-printstorage:14.17.0	2	1024	896	0	768	88	128
mod-batchorganizations-print storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-export-copycatspring	3	mod-data-export-copycatspring:13.62.022	1	10242048	8961844	0	7681536	88384	128512
mod-data-export-copycat spring - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
modedge-listserm	42	modedge-listserm:1.2.0.61	2	1024	896	0	768	88	128
mod-lists - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-entities-links	3	mod-entities-links:3.0.2	2	2592	2480	0	1440	0	1024
mod-entities-links - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-permissions	6	mod-permissions:6.5.0	2	1684	1544	512	1024	384	512
mod-permissions - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
pub-edge	1

PTF - QCP1 environment configuration

10 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 database instance, writer

Name Memory GIB vCPUs
db.r6g.xlarge
32 GB 4 vCPUs
Open Search ptf-test
- Data nodes
  - Instance type - r6g.2xlarge.search
  - Number of nodes - 4
  - Version: OpenSearch_2_7_R20240502
- Dedicated master nodes
  - Instance type - r6g.large.search
  - Number of nodes - 3
MSK fse-tenant
- 2 brokers, kafka.m7g.xlarge brokers in 2 zones
- Apache Kafka version 3.7.x
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3

mod-users-keycloak:1.5.3

Expand

title	qcp1 modules memory and CPU parameters

Cluster Resources - qcp1-pvt

Module	Task Definition Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft Limit	CPU Units	Xmx	Metaspace Size	Max Metaspace Size
mod-remote-storage	9	mod-remote-storage:3.2.0	2	4920	4472	1024	3960	512	512
mod-ncip	9	mod-ncip:1.14.4	2	1024	896	0	768

0

88

0

128

mod-

orders

finance-storage

3

9	mod-finance-

orders

storage:

12

8.

8

6.

8

0

2

2048

1024

1740

896

0

1024

700

384

88

512

128

mod-

orders - Sidecar 1

N/A

folio-module-sidecar:1.0.0.312

N/A

665

512

0

128

0

kong

9

kong:3.7.1

1

6144

2048

768

88

128

edge-patron

2

edge-patron:5.1.2

2

1024

896

256

768

88

128

mod-users-keycloak

3

sudoc	3	mod-sudoc:1.0	2	1024	896	0	768	88	128
mod-agreements	9	mod-agreements:7.0.0	2	1592	1488	0	0	0	0
mod-ebsconet	9	mod-ebsconet:2.2.0	2	1248	1024	128	700	128	256
mod-organizations	9	mod-organizations:1.9.0	2	1024	896	0

data-import	12	mod-data-import:3.1.0	1	2048	1844	256	1292	384	512
edge-dematic	9	edge-dematic:2.2.0	1	1024	896

reach	7	mod-inn-reach:3.2.0-SNAPSHOT.86	2	3600	3240	1024	2880	512	1024
mod-tags	9	mod-tags:2.2.0	2	1024	896	0	768	88	128
edge-courses	9	edge-courses:1.4.0	2	1024	896	0	768	88	128
mod-authtoken	13	mod-authtoken:2.15.1	2	1440	1152	512	922	88	128
mod-inventory-update	9	mod-inventory-update:3.3.0	2	1024	896	0	768	88	128
mod-

notify	9	mod-notify:3.2.0	2	1024	896	0	768	88	128
mod-configuration	9	mod-configuration:5.10.0	2	1024	896	0	768	88	128
mod-

storage	9	mod-orders-storage:13.7.0	2	1024	896	512	700	88	128
edge-caiasoft	9	edge-caiasoft:2.2.0	2	1024	896	0	768	88	128
mod-login-

harvester	9	mod-erm-usage-harvester:4.5.0	2	1024	896	0	768	88	128
mod-licenses	9	mod-licenses:6.0.0	2	2480	2312	512	1792	384	512
mod-gobi	9	mod-gobi:2.8.0	2	1024	896	0	768	88	128
mod-password-validator	9	mod-password-validator:3.2.0	2	1440	1298	0	768	384	512
mod-bulk-operations	9	mod-bulk-operations:2.0.0	2	3072	2600	0	1536	384	512
mod-fqm-manager	9	mod-fqm-manager:2.0.1	2	1024	896	0	768	88	128
edge-dcb	9	edge-dcb:1.1.0	2	1024	896	0	768	88	128
mod-graphql	10	mod-graphql:1.12.1	2	1024	896	0	768	88	128
mod-finance	9	mod-finance:4.9.0	2	1024	896	0	768	88	128
mod-erm-usage	9	mod-erm-usage:4.7.0	2	2800	2550	1024	1800	384	512
mod-batch-print	10	mod-batch-print:1.1.0	2	1024	896	0

edge-patron	10	edge-patron:5.1.0	2	1024	896	256	768	88	128
edge-ncip	9	edge-ncip:1.9.2	2	1024	896	0	768	88	128
mod-marc-migrations	7	mod-marc-migrations:1.0.0-SNAPSHOT.

bl	9	mod-users-bl:7.7.0	2	1440	1152	512	922	88	128
mod-oa	8	mod-oa:2.1.0-SNAPSHOT.62	2	1024	896	0	768	88	128
mod-

import	9	mod-user-import:3.8.0	2	1024	896	0	768	88	128
mod-sender	10	mod-sender:1.12.0	2	1024	896	0	768	88	128
edge-oai-pmh	9	edge-oai-pmh:2.9.0	2	1512	1360	1024	1440	384	512
mod-data-export-worker	9	mod-data-export-worker:3.2.1	2	3072	2800	1024	2048	384	512
mod-rtac	10	mod-rtac:3.6.0	2	1024	896	0	768	88	128
mod-

calendar	9	mod-calendar:3.1.0	2	1024	896	0	768	88	128
mod-source-record-storage	21	mod-source-record-storage:5.8.7	2	5600	5000	2048	3500	384	512
mod-event-config	9	mod-event-config:2.7.0	2	1024	896	0	768	88	128
mod-courses	9	mod-courses:1.4.10	2	1024	896	0	768	88	128
mod-

converter-storage	9	mod-di-converter-storage:2.2.0	2	1024	896	0	768	88	128
edge-rtac	9	edge-rtac:2.7.1	2	1024	896	0

users	10	mod-users:19.3.1	2	1024	896	0	768	88	128
mod-template-engine	9	mod-template-engine:1.20.0	2	1024	896	0	768	88	128
mod-

feesfines	9	mod-feesfines:19.1.0	2	1024	896	0	768	88	128
mod-invoice-storage	9	mod-invoice-storage:5.8.0	2	1872	1536	1024	1024	384	512
mod-

patron	10	mod-patron:6.1.0	2	1024	896	0	768	88	128
mod-oai-pmh	9	mod-oai-pmh:3.13.0	2

notes	9	mod-notes:5.2.0	2	1024	896	0	952	384	512
mod-data-export-spring

organizations-storage	9	mod-organizations-storage:4.7.0	2	1024	896	0	768	88	128
mod-login	9	mod-login:7.11.0	2	1440	1298	1024	768	384	512
pub-okapi	5	pub-okapi:2023.06.14	2	1024	896	2	768	0	0

Page Comparison

Versions Compared

Old Version 13

New Version Current

Key

Overview

Summary

Recommendations & Jiras

Test Runs

Results and Comparison Eureka and non-Eureka

Test Details

1 vuser - non-Eureka

Overview

Summary

Recommendations & Jiras

Test Runs

Results and Comparison Eureka and non-Eureka

Test Details

1 vuser - non-Eureka

Image Added

1 vuser - Eureka

Image Added

20 vusers - non-Eureka

20 vusers - Eureka

Image Removed

20 vusers - non-Eureka

20 vusers - Eureka

Image Removed

Resource Utilization

Memory Utilization

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

Service CPU Utilization

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

RDS CPU Utilization

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

RDS Connections count

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

OpenSearch metrics

Image Removed

Appendix

Infrastructure

Image Added

Resource Utilization

Memory Utilization

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

Service CPU Utilization

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

RDS CPU Utilization

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

RDS Connections count

1 vuser - non-Eureka

1 vuser - Eureka

20 vusers - non-Eureka

20 vusers - Eureka

OpenSearch metrics

Image Added

Appendix

Infrastructure

Additional information