Overview

This document contains the results of Central Ordering testing scenarios to create order with PO lines plus Change instance connection and Receive all pieces for Ramsons [ECS] environments.

PERF-1027 - Getting issue details... STATUS

Summary

All tests were successfully completed, and all API calls were executed without errors.
Response time for Change Instance Connection for Test №2 increased by 45% compared to Test №1 and for Test №3 Response time increased by 125% compared to Test 1. It appears that the Find or Create New Holdings action performed multiple operations, which explains the extended response time for this action.
In Test 3, the Create Order operation involved creating orders with 50 Order Lines, compared to 1 Order Lines in Test 1 and 10 Order Lines in Test 2. This explains the significant increase in response times for the Open Order and Unopen Order operations:
- Open Order: Response times increased nearly 10x in Test 3 compared to Test 1 due to the higher load (50 items per order).
- Unopen Order: Similarly, response times grew approximately 4-5x in Test 3.
For other operations (Create Order, Create Order Line, Receive Pieces, and Change Instance Connection), response times increased moderately but remained within acceptable ranges as the load increased.
Conclusion: The increase in item count per order directly impacted the performance of Open Order and Unopen Order, highlighting their sensitivity to load.
In Test №2, the Create New Holdings operation for Change Instance Connection triggered the reindex function. As a result, we observed that mod-search initiated reindexing, as evidenced by SQL queries N1 and N4 appearing in the TOP 5 SQL Statements table. This process placed a significant load on the database and continued for over 3 hours after the tests were completed.

Test Runs

Test №	Date	Test Conditions	Results
1	12/12/24, 9:48 AM UTC	PO with PO Lines (1) + locations (5) + Change instance connection (Move holdings)	Completed
2	12/12/24, 11:32 AM UTC	PO with PO Lines (10) + locations (3) + Change instance connection (Create new holdings)	Completed
3	12/12/24, 1:21 PM UTC	PO with PO Lines (50) + locations (3) + Change instance connection (Move holdings, Find or Create new holdings)	Completed

Test Results

Test №1

PO with PO Lines (1) + locations (5) + Change instance connection (Move holdings)

	Average	pct90	pct95	pct99	Average	pct90	pct95	pct99	Average	pct90	pct95	pct99
Transaction	Data size 500k				Data size 1kk				Data size 5kk
TC_open all orders 10	2212	3763	3763	3763	2219	3476	3476	3476	2259	3957	3957	3957
TC_open all orders 50	1978	2230	2492	2547	1910	2396	2714	2757	1953	2360	2974	2974
TC_open all orders 100	2026	2833	3024	3024	2010	2739	2765	2765	2015	2801	3063	3063
TC_open all orders 1000	2025	2376	2480	2724	2017	2454	2465	2485	1971	2239	2346	2365
TC_open order 10	813	2513	2513	2513	872	2526	2526	2526	894	2650	2650	2650
TC_open order 50	446	687	731	735	453	687	796	800	469	647	775	775
TC_open order 100	737	1343	1343	1343	739	1346	1346	1346	814	1722	1722	1722
TC_open order 1000	670	884	1149	1149	657	858	1009	1009	680	838	877	880
TC_open order line 10	1363	3159	3159	3159	1468	3464	3464	3464	1560	4083	4083	4083
TC_open order line 50	913	1343	1712	1730	925	1591	1910	1910	936	1458	1626	1632
TC_open order line 100	1181	1784	1981	1981	1170	1978	1996	1996	1235	2242	2566	2566
TC_open order line 1000	1197	1534	1819	1937	1192	1485	1635	1699	1213	1529	1976	2092
TC_open pieces 10	1268	2643	2643	2643	1249	2621	2621	2621	1269	2645	2645	2645
TC_open pieces 50	880	1065	1871	1913	881	1254	1475	1499	915	1368	1729	1739
TC_open pieces 100	1111	1844	1869	1869	1126	1531	1579	1668	1144	1811	1845	1845
TC_open pieces 1000	1062	1286	1426	1462	1110	1305	1631	1803	1092	1489	1634	1639
TC_view order history 10	541	1652	1652	1652	558	1613	1613	1613	544	1388	1388	1388
TC_view order history 50	254	383	474	477	249	314	384	387	265	380	537	537
TC_view order history 100	477	805	829	858	486	886	886	886	505	849	856	856
TC_view order history 1000	452	647	787	787	445	528	591	591	464	681	775	968
TC_view order line history 10	754	1610	1610	1610	738	1564	1564	1564	823	1974	1974	1974
TC_view order line history 50	452	619	816	816	449	587	629	634	489	788	788	788
TC_view order line history 100	695	1068	1274	1307	677	1037	1132	1132	718	968	968	968
TC_view order line history 1000	733	900	973	988	760	1207	1207	1207	746	926	1151	1151
TC_view pieces history 10	753	1433	1433	1433	745	1422	1422	1422	782	1801	1801	1801
TC_view pieces history 50	452	701	774	783	449	632	797	869	454	626	692	695
TC_view pieces history 100	670	1008	1113	1133	656	1086	1140	1140	701	1081	1160	1160
TC_view pieces history 1000	710	945	945	945	701	1095	1095	1095	694	862	906	910

Requests	Total Requests Count	Average	pct90	pct95	pct99
Requests	Total Requests Count	Response Time (milliseconds)
POST /orders/composite-orders Create Order	576	98	166	284	833
POST orders/order-lines Create Order Line	576	137	250	486	1.094
PUT orders/composite-orders/[order_id] Open Order	574	1.659	3.612	8.279	8.288
PATCH orders/order-lines/[curent_po_line_id] Change instance connection (Move Holdings)	574	726	1.039	1.851	15.494
POST /orders/check-in Receive Pieces	574	729	1.059	2.207	17.613
PUT orders/composite-orders/[order_id_created] Unopen Order	574	625	757	1.014	1.607

Full result table

transaction	NumberOfSamples	Average	Median	pct90	pct95	pct99	Min	Max
FOLIO: Login	1	407	407	407	407	407	407	407
GET bl-users/_self	1	1428	1428	1428	1428	1428	1428	1428
JSR223 Sampler Clear file	1	1081	1081	1081	1081	1081	1081	1081
JSR223 Sampler User info extractor	1	92	92	92	92	92	92	92
POO_GET /acquisitions-units/memberships	576	40	39	73	116	848	19	855
POO_GET /acquisitions-units/units	2304	24	23	29	65	136	18	136
POO_GET /configurations/entries	6912	18	17	20	25	92	14	92
POO_GET /finance/expense-classes	576	30	28	66	142	142	19	142
POO_GET /finance/funds	1152	45	42	60	108	1272	34	1279
POO_GET /material-types	576	18	17	22	80	103	11	103
POO_GET /orders/acquisition-methods	576	30	30	65	71	547	19	552
POO_GET /orders/composite-orders/composite_orderId	576	64	62	100	153	204	51	204
POO_GET /orders/configuration/prefixes	2304	27	25	41	74	627	17	632
POO_GET /orders/configuration/reasons-for-closure	1728	24	24	27	68	123	18	124
POO_GET /orders/configuration/suffixes	2304	24	23	27	67	527	18	532
POO_GET /orders/order-lines	1152	48	46	55	97	539	38	543
POO_GET /orders/order-templates	576	35	33	69	107	696	19	696
POO_GET /orders/po-number	576	48	36	72	733	1248	18	1248
POO_GET /organizations	576	63	58	85	248	571	48	575
POO_GET /organizations/organizations/[vendor_id]	576	27	26	34	86	138	20	138
POO_GET /tags	2304	16	16	21	28	225	11	226
POO_GET /users	1152	16	15	19	66	262	11	264
POO_GET _/proxy/tenants/[tenant]/modules	574	76	74	115	173	267	64	267
POO_GET _/version	574	14	13	51	55	632	5	637
POO_GET acquisitions-units/units	2876	24	23	27	65	816	18	823
POO_GET configurations/entries	22994	17	17	20	29	77	11	96
POO_GET consortia	574	20	19	59	72	523	12	528
POO_GET consortia-configuration	574	20	19	58	69	98	11	98
POO_GET consortia/[consortia_ID]/_self	574	25	24	64	84	254	15	254
POO_GET consortia/[consortia_ID]/tenants	574	24	23	60	68	568	13	573
POO_GET contributor-name-types	3448	15	15	19	56	93	10	93
POO_GET contributor-types	1150	29	28	64	77	149	21	149
POO_GET finance/budgets	1148	29	28	66	74	547	20	552
POO_GET finance/expense-classes	1722	27	26	47	67	820	19	827
POO_GET finance/funds	6896	41	40	45	81	1006	32	1015
POO_GET finance/transactions	1148	30	28	67	73	566	19	566
POO_GET holdings-storage/holdings	576	17	17	19	60	94	11	94
POO_GET identifier-types	2298	17	17	22	58	584	11	589
POO_GET instance-formats	1150	20	20	58	63	128	13	128
POO_GET instance-relationship-types	3444	15	15	18	56	96	10	96
POO_GET instance-types	2300	17	16	21	58	100	11	100
POO_GET inventory/instances	3444	37	36	58	97	873	18	876
POO_GET inventory/instances/[instances_id]	576	82	76	187	380	650	47	650
POO_GET inventory/items	1722	28	27	66	68	533	19	538
POO_GET invoice/invoice-lines	1722	40	34	75	120	1169	23	1179
POO_GET locations	7468	14	14	17	56	91	10	92
POO_GET material-types	3451	15	15	17	57	96	11	96
POO_GET modes-of-issuance	1150	18	17	56	59	100	10	100
POO_GET nature-of-content-terms	1150	18	18	57	62	93	11	93
POO_GET note-links/domain/orders/type/poLine/id/[curent_po_line_id]	1148	21	21	35	66	85	13	85
POO_GET note-links/domain/orders/type/poLine/id/[poLine_id]	574	29	23	58	396	687	14	693
POO_GET note-types	1722	22	21	42	65	180	13	180
POO_GET orders-storage/order-invoice-relns	2298	14	14	16	56	97	10	97
POO_GET orders/acquisition-methods	576	27	25	65	80	93	19	93
POO_GET orders/acquisition-methods/[acquisitionMethod_ID]	1148	26	25	60	67	841	18	849
POO_GET orders/acquisition-methods/[acquisition_methods_id]	574	29	28	66	133	141	17	141
POO_GET orders/composite-orders	3448	54	53	71	103	580	38	585
POO_GET orders/composite-orders/[order_id]	4022	217	213	337	424	1762	52	1762
POO_GET orders/configuration/prefixes	1726	24	23	27	66	548	17	553
POO_GET orders/configuration/reasons-for-closure	4598	23	23	25	62	246	18	246
POO_GET orders/configuration/suffixes	1726	23	23	28	65	91	17	91
POO_GET orders/export-history	2296	26	25	60	69	840	18	848
POO_GET orders/order-lines	4598	52	51	67	101	851	40	858
POO_GET orders/order-templates	576	27	27	65	71	108	19	108
POO_GET orders/pieces	1148	82	79	155	241	1011	49	1012
POO_GET orders/titles	1722	56	54	91	170	865	38	872
POO_GET organizations/organizations	2298	51	50	81	94	530	42	534
POO_GET organizations/organizations/[vendor_id]	6894	25	24	29	65	494	19	498
POO_GET saml/check	574	26	20	63	389	401	12	401
POO_GET search/instances	2298	108	106	309	333	859	17	859
POO_GET tags	3452	16	16	19	38	100	11	100
POO_GET users	6318	16	15	19	37	589	12	594
POO_PATCH orders/order-lines/[curent_po_line_id]	574	726	696	1039	1851	15494	403	15635
POO_POST /orders/composite-orders	576	98	95	166	284	833	57	835
POO_POST orders/order-lines	576	137	132	250	486	1094	75	1094
POO_PUT orders/composite-orders/[order_id]	574	1659	1541	3612	8279	8288	1098	8288
POO_PUT orders/composite-orders/[order_id_created]	574	625	620	757	1014	1607	488	1608
POO_PUT orders/order-lines/fund-distributions/validate	576	25	25	57	70	672	10	672
POST /authn/refresh	9	49	49	127	127	127	36	127
RW_GET /acquisitions-units/units	1722	25	25	30	67	224	18	226
RW_GET /configurations/entries	1722	18	18	22	43	74	14	74
RW_GET /contributor-name-types	1148	14	14	16	22	66	11	66
RW_GET /finance/expense-classes	574	25	24	32	65	72	20	72
RW_GET /finance/funds	1148	40	39	45	55	559	34	564
RW_GET /holdings-storage/holdings	574	20	18	56	62	550	11	550
RW_GET /identifier-types	1148	16	16	18	56	80	12	80
RW_GET /locations	1148	14	14	21	29	86	10	86
RW_GET /material-types	2296	14	14	18	28	71	10	71
RW_GET /orders/acquisition-methods	574	27	27	65	68	109	19	109
RW_GET /orders/composite-orders	2870	48	47	57	92	603	39	608
RW_GET /orders/composite-orders/order_ID	1722	281	277	363	538	1150	232	1154
RW_GET /orders/configuration/prefixes	574	24	24	30	67	90	18	90
RW_GET /orders/configuration/suffixes	574	24	24	36	65	106	17	106
RW_GET /orders/order-lines	1722	52	51	64	102	925	42	933
RW_GET /orders/order-lines/order_line_ID	1722	83	80	152	243	862	54	865
RW_GET /orders/pieces Status=="Expected"	1148	68	67	76	106	914	46	922
RW_GET /orders/pieces Status=="Received"	1148	67	66	73	104	196	47	196
RW_GET /orders/pieces Status=Expected	1722	70	68	75	148	874	47	874
RW_GET /orders/pieces Status=Received	1148	68	67	72	109	197	48	197
RW_GET /orders/titles	1148	54	54	89	102	626	40	630
RW_GET /orders/titles/id	1722	28	27	65	91	151	16	151
RW_GET /organizations/organizations	1148	55	55	91	130	627	42	632
RW_GET /tags	1722	17	16	22	36	81	12	81
RW_POST /orders/check-in	574	729	706	1059	2207	17613	390	17764
TC_POO: Add Order Lines cs00000int	574	3071	3024	3607	9015	10584	2531	10584
TC_POO: Create Order cs00000int	576	1318	1277	2025	2895	3792	1070	3792
TC_POO: Open Order cs00000int	574	2871	2727	5027	10522	10544	2209	10544
TC_POO: Unopen Order cs00000int	574	3757	3735	4334	5071	5490	3316	5499
TC_POO: change-instance-connection-action cs00000int	574	4098	4084	5103	7570	18484	3333	18605
TC_RW: Receiving-an-Order-Line cs00000int	574	3675	3609	4349	6542	20304	3086	20452
TC_RW: Receiving-an-Order-Line cs00000int Receiving	574	2705	2647	3345	5329	19357	2180	19504
_/proxy/tenants/[tenant]/modules	574	73	72	108	163	219	62	219
_/version	574	12	12	50	55	97	5	97
acquisitions-units/units	574	26	25	29	68	809	19	816
all	242480	97	97	197	878	5568	5	18605
bl-users/_self	574	85	84	154	193	883	43	886
configurations/entries	8610	16	16	19	25	614	11	620
consortia	574	19	19	54	65	95	12	95
consortia-configuration	574	19	19	55	63	780	11	787
consortia/[consortia_ID]/_self	574	22	22	59	62	82	16	102
finance/funds	574	42	41	54	89	162	34	162
inventory/items	8610	23	22	26	45	772	18	779
orders-storage/order-invoice-relns	1148	15	15	19	57	97	10	97
orders/composite-orders	2296	47	46	51	89	588	38	593
orders/composite-orders/[order_id_created]	1148	274	272	349	421	1183	234	1187
orders/configuration/prefixes	574	27	26	65	67	498	18	502
orders/configuration/reasons-for-closure	1148	26	26	63	67	554	18	559
orders/configuration/suffixes	574	27	26	64	69	891	17	899
orders/export-history	574	27	27	61	68	526	20	531
orders/order-lines	1148	52	52	61	100	144	42	144
orders/pieces	8610	65	64	73	103	924	44	931
organizations/organizations	1148	52	51	88	96	587	42	592
organizations/organizations/[vendor_id]	1148	27	27	31	67	539	20	544
saml/check	574	22	20	59	111	172	12	172
tags	574	16	16	19	25	97	12	97
users	2296	16	16	18	69	118	12	118

Test №2

PO with PO Lines (10) + locations (3) + Change instance connection (Create new holdings)

Requests	Total Requests Count	Average	pct90	pct95	pct99
Requests	Total Requests Count	Response Time (milliseconds)
POST /orders/composite-orders Create Order	126	180	319	892	910
POST orders/order-lines Create Order Line	1260	189	314	503	957
PUT orders/composite-orders/[order_id] Open Order	126	3.980	6.095	6.100	6.100
PATCH orders/order-lines/[curent_po_line_id] Change instance connection (Create New Holdings)	252	1.053	1.502	2.697	2.697
POST /orders/check-in Receive Pieces	1252	692	918	1.027	7.200
PUT orders/composite-orders/[order_id_created] Unopen Order	124	1.227	1.836	2.194	2.835

Full result table

Time	transaction	NumberOfSamples	Average	Median	pct90	pct95	pct99	Min	Max
12/12/2024 13:31	FOLIO: Login	1	387	387	387	387	387	387	387
12/12/2024 13:31	GET bl-users/_self	1	1288	1288	1288	1288	1288	1288	1288
12/12/2024 13:31	JSR223 Sampler Clear file	1	989	989	989	989	989	989	989
12/12/2024 13:31	JSR223 Sampler User info extractor	1	92	92	92	92	92	92	92
12/12/2024 13:31	POO_GET /acquisitions-units/memberships	126	66	65	114	136	145	20	145
12/12/2024 13:31	POO_GET /acquisitions-units/units	504	29	26	44	131	500	20	504
12/12/2024 13:31	POO_GET /configurations/entries	1512	19	18	25	40	86	14	86
12/12/2024 13:31	POO_GET /finance/expense-classes	126	38	34	130	138	138	20	138
12/12/2024 13:31	POO_GET /finance/funds	252	50	43	160	212	212	35	212
12/12/2024 13:31	POO_GET /material-types	126	20	18	65	84	98	12	98
12/12/2024 13:31	POO_GET /orders/acquisition-methods	126	44	41	111	479	544	20	544
12/12/2024 13:31	POO_GET /orders/composite-orders/composite_orderId	126	77	72	258	330	330	55	330
12/12/2024 13:31	POO_GET /orders/configuration/prefixes	504	29	26	67	149	171	18	171
12/12/2024 13:31	POO_GET /orders/configuration/reasons-for-closure	378	26	24	30	125	137	19	137
12/12/2024 13:31	POO_GET /orders/configuration/suffixes	504	27	24	63	120	143	19	143
12/12/2024 13:31	POO_GET /orders/order-lines	252	57	50	160	243	243	40	243
12/12/2024 13:31	POO_GET /orders/order-templates	126	38	35	104	114	114	20	114
12/12/2024 13:31	POO_GET /orders/po-number	126	63	62	112	112	121	20	121
12/12/2024 13:31	POO_GET /organizations	126	68	61	238	266	266	49	266
12/12/2024 13:31	POO_GET /organizations/organizations/[vendor_id]	126	28	25	102	132	132	20	132
12/12/2024 13:31	POO_GET /tags	504	16	15	20	67	68	11	68
12/12/2024 13:31	POO_GET /users	252	16	15	28	71	71	12	71
12/12/2024 13:31	POO_GET _/proxy/tenants/[tenant]/modules	252	80	78	117	149	149	63	149
12/12/2024 13:31	POO_GET _/version	252	18	18	53	60	99	6	99
12/12/2024 13:31	POO_GET acquisitions-units/units	5292	24	24	27	66	496	18	500
12/12/2024 13:31	POO_GET configurations/entries	27720	18	17	21	29	537	12	798
12/12/2024 13:31	POO_GET consortia	252	25	25	60	63	82	12	82
12/12/2024 13:31	POO_GET consortia-configuration	252	29	26	60	64	873	12	881
12/12/2024 13:31	POO_GET consortia/[consortia_ID]/_self	252	33	30	66	71	801	16	808
12/12/2024 13:31	POO_GET consortia/[consortia_ID]/tenants	252	29	28	61	64	118	13	118
12/12/2024 13:31	POO_GET contributor-name-types	4536	15	15	17	53	615	10	621
12/12/2024 13:31	POO_GET contributor-types	1512	29	28	34	70	527	22	531
12/12/2024 13:31	POO_GET finance/budgets	504	36	35	70	110	513	20	517
12/12/2024 13:31	POO_GET finance/expense-classes	1764	27	27	65	68	532	20	537
12/12/2024 13:31	POO_GET finance/funds	7938	42	41	48	85	868	32	876
12/12/2024 13:31	POO_GET finance/transactions	504	33	32	68	71	568	20	573
12/12/2024 13:31	POO_GET holdings-storage/holdings	1260	18	17	52	59	784	11	791
12/12/2024 13:31	POO_GET identifier-types	3024	16	16	19	58	90	12	90
12/12/2024 13:31	POO_GET instance-formats	1512	19	19	24	60	107	13	107
12/12/2024 13:31	POO_GET instance-relationship-types	3528	15	15	18	56	236	11	238
12/12/2024 13:31	POO_GET instance-types	3024	17	16	19	58	544	12	549
12/12/2024 13:31	POO_GET inventory/instances	3528	49	49	90	110	593	19	598
12/12/2024 13:31	POO_GET inventory/instances/[instances_id]	1260	68	66	107	195	574	46	574
12/12/2024 13:31	POO_GET inventory/items	756	33	33	74	115	799	19	806
12/12/2024 13:31	POO_GET invoice/invoice-lines	1764	31	30	72	98	237	21	550
12/12/2024 13:31	POO_GET locations	7308	15	14	18	48	122	10	123
12/12/2024 13:31	POO_GET material-types	5544	15	15	17	53	539	11	544
12/12/2024 13:31	POO_GET modes-of-issuance	1512	17	17	24	59	137	11	137
12/12/2024 13:31	POO_GET nature-of-content-terms	1512	18	18	25	59	803	11	838
12/12/2024 13:31	POO_GET note-links/domain/orders/type/poLine/id/[curent_po_line_id]	504	19	18	23	59	501	13	505
12/12/2024 13:31	POO_GET note-links/domain/orders/type/poLine/id/[poLine_id]	1260	19	19	25	63	95	13	95
12/12/2024 13:31	POO_GET note-types	1764	19	19	26	61	99	13	99
12/12/2024 13:31	POO_GET orders-storage/order-invoice-relns	1764	16	16	18	58	501	10	505
12/12/2024 13:31	POO_GET orders/acquisition-methods	1260	30	28	66	73	853	19	855
12/12/2024 13:31	POO_GET orders/acquisition-methods/[acquisitionMethod_ID]	504	25	25	60	67	107	18	107
12/12/2024 13:31	POO_GET orders/acquisition-methods/[acquisition_methods_id]	1260	28	27	64	82	621	18	622
12/12/2024 13:31	POO_GET orders/composite-orders	4158	68	66	92	120	907	41	910
12/12/2024 13:31	POO_GET orders/composite-orders/[order_id]	4536	276	272	397	503	1989	55	1991
12/12/2024 13:31	POO_GET orders/configuration/prefixes	2772	25	25	30	67	560	17	565
12/12/2024 13:31	POO_GET orders/configuration/reasons-for-closure	4662	25	25	29	68	516	19	520
12/12/2024 13:31	POO_GET orders/configuration/suffixes	2772	25	24	30	67	800	18	807
12/12/2024 13:31	POO_GET orders/export-history	1890	28	27	65	71	818	19	825
12/12/2024 13:31	POO_GET orders/order-lines	4788	57	56	93	107	590	40	595
12/12/2024 13:31	POO_GET orders/order-templates	1260	29	28	66	69	508	19	512
12/12/2024 13:31	POO_GET orders/pieces	504	84	81	150	307	712	49	717
12/12/2024 13:31	POO_GET orders/titles	1764	55	54	92	149	564	41	569
12/12/2024 13:31	POO_GET organizations/organizations	2898	52	51	88	103	577	41	582
12/12/2024 13:31	POO_GET organizations/organizations/[vendor_id]	7812	24	24	27	66	655	19	660
12/12/2024 13:31	POO_GET saml/check	252	33	29	65	80	1162	13	1173
12/12/2024 13:31	POO_GET search/instances	2016	279	281	405	437	493	16	493
12/12/2024 13:31	POO_GET tags	5544	15	15	18	54	105	11	118
12/12/2024 13:31	POO_GET users	5292	16	16	19	67	546	12	551
12/12/2024 13:31	POO_PATCH orders/order-lines/[curent_po_line_id]	252	1053	1018	1502	2697	2697	631	2697
12/12/2024 13:31	POO_POST /orders/composite-orders	126	180	173	319	892	910	60	910
12/12/2024 13:31	POO_POST orders/order-lines	1260	189	186	314	503	957	124	958
12/12/2024 13:31	POO_PUT orders/composite-orders/[order_id]	126	3980	3907	6095	6100	6100	2551	6100
12/12/2024 13:31	POO_PUT orders/composite-orders/[order_id_created]	124	1227	1238	1836	2194	2835	830	2835
12/12/2024 13:31	POST /authn/refresh	9	58	62	157	157	157	46	157
12/12/2024 13:31	RW_GET /acquisitions-units/units	1502	26	25	32	67	831	19	839
12/12/2024 13:31	RW_GET /configurations/entries	1502	19	19	23	61	66	14	66
12/12/2024 13:31	RW_GET /contributor-name-types	2502	15	15	17	54	66	11	66
12/12/2024 13:31	RW_GET /finance/expense-classes	126	25	25	30	66	70	20	70
12/12/2024 13:31	RW_GET /finance/funds	252	41	41	44	84	95	36	95
12/12/2024 13:31	RW_GET /holdings-storage/holdings	1250	18	16	20	58	772	11	774
12/12/2024 13:31	RW_GET /identifier-types	2502	16	16	19	52	113	12	113
12/12/2024 13:31	RW_GET /locations	2500	15	15	19	55	86	10	86
12/12/2024 13:31	RW_GET /material-types	1628	16	15	20	58	548	11	553
12/12/2024 13:31	RW_GET /orders/acquisition-methods	126	29	29	67	130	131	20	131
12/12/2024 13:31	RW_GET /orders/composite-orders	1754	50	49	89	133	571	40	575
12/12/2024 13:31	RW_GET /orders/composite-orders/order_ID	2628	286	281	398	500	1321	242	1329
12/12/2024 13:31	RW_GET /orders/configuration/prefixes	126	24	24	28	65	66	19	66
12/12/2024 13:31	RW_GET /orders/configuration/suffixes	126	25	26	55	66	66	19	66
12/12/2024 13:31	RW_GET /orders/order-lines	1502	58	57	97	109	819	47	825
12/12/2024 13:31	RW_GET /orders/order-lines/order_line_ID	3754	73	72	112	159	990	57	991
12/12/2024 13:31	RW_GET /orders/pieces Status=="Expected"	2502	66	66	72	104	687	47	693
12/12/2024 13:31	RW_GET /orders/pieces Status=="Received"	2502	67	66	72	98	1239	48	1250
12/12/2024 13:31	RW_GET /orders/pieces Status=Expected	3754	68	68	76	110	629	49	634
12/12/2024 13:31	RW_GET /orders/pieces Status=Received	2502	67	67	73	106	243	48	243
12/12/2024 13:31	RW_GET /orders/titles	1376	53	52	90	98	878	41	886
12/12/2024 13:31	RW_GET /orders/titles/id	3754	25	24	29	65	857	17	860
12/12/2024 13:31	RW_GET /organizations/organizations	2502	50	50	88	93	544	41	548
12/12/2024 13:31	RW_GET /tags	1502	15	15	19	57	82	11	82
12/12/2024 13:31	RW_POST /orders/check-in	1252	692	692	918	1027	7200	440	7222
12/12/2024 13:31	TC_POO: Add Order Lines cs00000int	1260	3676	3653	4766	5809	8156	2957	8156
12/12/2024 13:31	TC_POO: Create Order cs00000int	126	1561	1490	3750	4345	4345	1156	4345
12/12/2024 13:31	TC_POO: Open Order cs00000int	126	5337	5279	7343	7360	7360	3810	7360
12/12/2024 13:31	TC_POO: Unopen Order cs00000int	124	4657	4664	5639	5874	6513	3890	6513
12/12/2024 13:31	TC_POO: change-instance-connection-action cs00000int	252	4767	4726	6607	6947	7551	3893	7560
12/12/2024 13:31	TC_RW: Receiving-an-Order-Line cs00000int	124	26416	26430	28543	29174	34625	24234	34625
12/12/2024 13:31	TC_RW: Receiving-an-Order-Line cs00000int Receiving	1250	2605	2616	3088	3454	9523	2223	9545
12/12/2024 13:31	_/proxy/tenants/[tenant]/modules	124	81	81	119	150	150	63	150
12/12/2024 13:31	_/version	124	21	20	52	53	77	6	77
12/12/2024 13:31	acquisitions-units/units	124	24	24	26	62	68	20	68
12/12/2024 13:31	all	214107	121	109	269	847	27632	6	32271
12/12/2024 13:31	bl-users/_self	124	221	194	1270	1677	1677	46	1677
12/12/2024 13:31	configurations/entries	1860	17	17	20	24	74	12	74
12/12/2024 13:31	consortia	124	26	27	60	61	75	12	75
12/12/2024 13:31	consortia-configuration	124	24	24	60	65	94	12	94
12/12/2024 13:31	consortia/[consortia_ID]/_self	124	32	31	74	78	98	15	98
12/12/2024 13:31	finance/funds	124	44	44	82	86	158	36	158
12/12/2024 13:31	inventory/items	1860	25	24	27	66	113	19	113
12/12/2024 13:31	orders-storage/order-invoice-relns	248	16	16	25	57	59	11	59
12/12/2024 13:31	orders/composite-orders	496	49	49	85	91	178	41	178
12/12/2024 13:31	orders/composite-orders/[order_id_created]	248	286	286	376	492	558	243	558
12/12/2024 13:31	orders/configuration/prefixes	124	30	31	66	80	101	19	101
12/12/2024 13:31	orders/configuration/reasons-for-closure	248	27	28	66	67	110	20	110
12/12/2024 13:31	orders/configuration/suffixes	124	28	29	66	74	102	19	102
12/12/2024 13:31	orders/export-history	124	33	33	70	93	169	22	169
12/12/2024 13:31	orders/order-lines	248	59	59	97	104	174	50	174
12/12/2024 13:31	orders/pieces	1860	67	66	74	105	263	47	264
12/12/2024 13:31	organizations/organizations	248	49	49	55	90	178	41	178
12/12/2024 13:31	organizations/organizations/[vendor_id]	248	27	27	66	67	69	19	69
12/12/2024 13:31	saml/check	124	28	28	75	89	90	13	90
12/12/2024 13:31	tags	124	16	16	19	52	93	11	93
12/12/2024 13:31	users	496	17	17	18	69	98	12	98

Test №3

PO with PO Lines (50) + locations (3) + Change instance connection (Move holdings, Find or Create new holdings)

Requests	Total Requests Count	Average	pct90	pct95	pct99
Requests	Total Requests Count	Response Time (milliseconds)
POST /orders/composite-orders Create Order	26	270	314	331	331
POST orders/order-lines Create Order Line	1300	179	175	307	469
PUT orders/composite-orders/[order_id] Open Order	26	19.305	25.633	25.755	25.761
PATCH orders/order-lines/[curent_po_line_id] Change instance connection (Create, Move, Find or Create Holdings)	220	1.632	3.250	3.542	4.186
POST /orders/check-in Receive Pieces	1200	940	1.192	1.311	1.832
PUT orders/composite-orders/[order_id_created] Unopen Order	24	4.471	5.866	5.910	5.910

Full result table

Time	transaction	NumberOfSamples	Average	Median	pct90	pct95	pct99	Min	Max
12/12/2024 15:21	FOLIO: Login	1	337	337	337	337	337	337	337
12/12/2024 15:21	GET bl-users/_self	1	1168	1168	1168	1168	1168	1168	1168
12/12/2024 15:21	JSR223 Sampler Clear file	1	1066	1066	1066	1066	1066	1066	1066
12/12/2024 15:21	JSR223 Sampler User info extractor	1	100	100	100	100	100	100	100
12/12/2024 15:21	POO_GET /acquisitions-units/memberships	26	111	110	132	148	148	67	148
12/12/2024 15:21	POO_GET /acquisitions-units/units	104	35	30	115	121	121	21	121
12/12/2024 15:21	POO_GET /configurations/entries	312	20	18	23	74	75	15	75
12/12/2024 15:21	POO_GET /finance/expense-classes	26	108	105	152	152	152	65	152
12/12/2024 15:21	POO_GET /finance/funds	52	81	67	209	209	209	39	209
12/12/2024 15:21	POO_GET /material-types	26	34	26	79	79	79	13	79
12/12/2024 15:21	POO_GET /orders/acquisition-methods	26	92	88	119	119	119	22	119
12/12/2024 15:21	POO_GET /orders/composite-orders/composite_orderId	26	105	89	331	331	331	58	331
12/12/2024 15:21	POO_GET /orders/configuration/prefixes	104	51	45	127	158	158	19	158
12/12/2024 15:21	POO_GET /orders/configuration/reasons-for-closure	78	38	33	112	114	114	20	114
12/12/2024 15:21	POO_GET /orders/configuration/suffixes	104	44	40	95	145	145	19	145
12/12/2024 15:21	POO_GET /orders/order-lines	52	81	63	254	254	254	40	254
12/12/2024 15:21	POO_GET /orders/order-templates	26	106	106	126	144	145	66	145
12/12/2024 15:21	POO_GET /orders/po-number	26	104	104	117	294	387	38	387
12/12/2024 15:21	POO_GET /organizations	26	95	79	266	266	266	51	266
12/12/2024 15:21	POO_GET /organizations/organizations/[vendor_id]	26	57	50	130	138	141	21	141
12/12/2024 15:21	POO_GET /tags	104	23	19	66	72	72	12	72
12/12/2024 15:21	POO_GET /users	52	24	21	71	71	72	12	72
12/12/2024 15:21	POO_GET _/proxy/tenants/[tenant]/modules	222	78	77	115	143	158	63	158
12/12/2024 15:21	POO_GET _/version	222	17	17	53	58	77	6	77
12/12/2024 15:21	POO_GET acquisitions-units/units	5422	25	24	28	68	597	19	603
12/12/2024 15:21	POO_GET configurations/entries	27494	18	18	21	29	217	12	741
12/12/2024 15:21	POO_GET consortia	222	25	24	65	69	80	13	80
12/12/2024 15:21	POO_GET consortia-configuration	222	26	25	63	80	84	12	84
12/12/2024 15:21	POO_GET consortia/[consortia_ID]/_self	222	30	29	67	74	104	17	104
12/12/2024 15:21	POO_GET consortia/[consortia_ID]/tenants	222	25	25	61	63	122	13	123
12/12/2024 15:21	POO_GET contributor-name-types	4564	16	15	22	58	579	11	584
12/12/2024 15:21	POO_GET contributor-types	1522	29	29	40	70	149	22	150
12/12/2024 15:21	POO_GET finance/budgets	442	32	31	69	74	551	20	555
12/12/2024 15:21	POO_GET finance/expense-classes	1742	27	27	40	71	145	19	145
12/12/2024 15:21	POO_GET finance/funds	7854	43	42	50	87	847	33	848
12/12/2024 15:21	POO_GET finance/transactions	442	30	29	68	71	113	21	113
12/12/2024 15:21	POO_GET holdings-storage/holdings	1300	18	17	20	59	605	11	610
12/12/2024 15:21	POO_GET identifier-types	3042	17	17	25	59	219	12	221
12/12/2024 15:21	POO_GET instance-formats	1522	21	20	54	61	803	13	810
12/12/2024 15:21	POO_GET instance-relationship-types	3484	16	15	24	57	125	11	126
12/12/2024 15:21	POO_GET instance-types	3044	17	17	27	59	128	12	128
12/12/2024 15:21	POO_GET inventory/instances	3484	53	53	96	140	296	19	297
12/12/2024 15:21	POO_GET inventory/instances/[instances_id]	1300	67	66	119	169	346	47	347
12/12/2024 15:21	POO_GET inventory/items	660	50	50	123	158	220	20	220
12/12/2024 15:21	POO_GET invoice/invoice-lines	1742	32	31	71	116	859	21	866
12/12/2024 15:21	POO_GET locations	7198	16	15	23	56	794	10	797
12/12/2024 15:21	POO_GET material-types	5644	15	15	20	57	130	11	130
12/12/2024 15:21	POO_GET modes-of-issuance	1522	17	17	29	60	566	11	571
12/12/2024 15:21	POO_GET nature-of-content-terms	1522	18	18	53	61	537	11	542
12/12/2024 15:21	POO_GET note-links/domain/orders/type/poLine/id/[curent_po_line_id]	442	18	18	22	58	73	13	73
12/12/2024 15:21	POO_GET note-links/domain/orders/type/poLine/id/[poLine_id]	1300	19	19	54	62	111	13	111
12/12/2024 15:21	POO_GET note-types	1742	19	18	27	60	131	13	132
12/12/2024 15:21	POO_GET orders-storage/order-invoice-relns	1574	16	15	19	57	85	10	85
12/12/2024 15:21	POO_GET orders/acquisition-methods	1300	29	28	64	108	590	19	595
12/12/2024 15:21	POO_GET orders/acquisition-methods/[acquisitionMethod_ID]	442	27	26	33	93	129	19	129
12/12/2024 15:21	POO_GET orders/acquisition-methods/[acquisition_methods_id]	1300	27	27	61	93	148	18	148
12/12/2024 15:21	POO_GET orders/composite-orders	3978	70	69	94	133	621	41	626
12/12/2024 15:21	POO_GET orders/composite-orders/[order_id]	4396	308	306	433	643	2471	56	2488
12/12/2024 15:21	POO_GET orders/configuration/prefixes	2822	24	24	28	67	567	18	572
12/12/2024 15:21	POO_GET orders/configuration/reasons-for-closure	4422	25	24	29	67	538	18	543
12/12/2024 15:21	POO_GET orders/configuration/suffixes	2822	24	24	28	66	866	18	874
12/12/2024 15:21	POO_GET orders/export-history	1768	27	26	61	69	145	19	145
12/12/2024 15:21	POO_GET orders/order-lines	4616	62	62	98	122	1190	42	1193
12/12/2024 15:21	POO_GET orders/order-templates	1300	29	27	37	69	887	19	895
12/12/2024 15:21	POO_GET orders/pieces	440	96	94	212	303	370	53	370
12/12/2024 15:21	POO_GET orders/titles	1742	58	56	92	132	830	41	833
12/12/2024 15:21	POO_GET organizations/organizations	2848	53	52	91	138	795	41	802
12/12/2024 15:21	POO_GET organizations/organizations/[vendor_id]	7658	25	24	28	66	984	18	988
12/12/2024 15:21	POO_GET saml/check	222	27	26	74	77	94	13	94
12/12/2024 15:21	POO_GET search/instances	1964	304	291	435	470	941	17	946
12/12/2024 15:21	POO_GET tags	5644	15	15	18	57	755	10	762
12/12/2024 15:21	POO_GET users	4890	16	16	19	31	129	12	130
12/12/2024 15:21	POO_PATCH orders/order-lines/[curent_po_line_id]	220	1632	1570	3250	3542	4186	591	4187
12/12/2024 15:21	POO_POST /orders/composite-orders	26	270	269	314	331	331	151	331
12/12/2024 15:21	POO_POST orders/order-lines	1300	179	175	307	469	1718	128	1722
12/12/2024 15:21	POO_PUT orders/composite-orders/[order_id]	26	19305	19547	25633	25755	25761	16161	25761
12/12/2024 15:21	POO_PUT orders/composite-orders/[order_id_created]	24	4471	4528	5866	5910	5910	3214	5910
12/12/2024 15:21	POST /authn/refresh	9	74	71	138	138	138	43	138
12/12/2024 15:21	RW_GET /acquisitions-units/units	1248	26	26	36	70	513	20	517
12/12/2024 15:21	RW_GET /configurations/entries	1248	21	20	25	62	854	15	857
12/12/2024 15:21	RW_GET /contributor-name-types	2400	15	14	18	57	574	11	579
12/12/2024 15:21	RW_GET /finance/expense-classes	24	24	24	28	30	30	21	30
12/12/2024 15:21	RW_GET /finance/funds	48	42	42	45	74	85	37	85
12/12/2024 15:21	RW_GET /holdings-storage/holdings	1200	17	16	24	58	520	11	525
12/12/2024 15:21	RW_GET /identifier-types	2400	16	16	19	57	84	12	84
12/12/2024 15:21	RW_GET /locations	2400	15	15	21	57	524	11	528
12/12/2024 15:21	RW_GET /material-types	1272	17	16	25	58	530	11	530
12/12/2024 15:21	RW_GET /orders/acquisition-methods	24	67	72	537	584	600	21	600
12/12/2024 15:21	RW_GET /orders/composite-orders	1296	56	54	90	132	1091	40	1094
12/12/2024 15:21	RW_GET /orders/composite-orders/order_ID	2424	329	323	468	668	1483	284	1483
12/12/2024 15:21	RW_GET /orders/configuration/prefixes	24	23	22	25	25	25	20	25
12/12/2024 15:21	RW_GET /orders/configuration/suffixes	24	23	23	27	27	27	21	27
12/12/2024 15:21	RW_GET /orders/order-lines	1248	62	60	100	138	1266	48	1269
12/12/2024 15:21	RW_GET /orders/order-lines/order_line_ID	3600	70	67	80	161	827	56	833
12/12/2024 15:21	RW_GET /orders/pieces Status=="Expected"	2400	66	66	73	89	237	48	238
12/12/2024 15:21	RW_GET /orders/pieces Status=="Received"	2400	66	66	73	79	577	50	582
12/12/2024 15:21	RW_GET /orders/pieces Status=Expected	3600	69	68	75	88	1156	49	1161
12/12/2024 15:21	RW_GET /orders/pieces Status=Received	2400	68	67	74	104	701	50	705
12/12/2024 15:21	RW_GET /orders/titles	1224	58	58	92	102	612	41	612
12/12/2024 15:21	RW_GET /orders/titles/id	3600	24	23	28	69	186	17	187
12/12/2024 15:21	RW_GET /organizations/organizations	2400	51	50	88	95	612	41	616
12/12/2024 15:21	RW_GET /tags	1248	16	16	19	57	784	11	791
12/12/2024 15:21	RW_POST /orders/check-in	1200	940	926	1192	1311	1832	602	1837
12/12/2024 15:21	TC_POO: Add Order Lines cs00000int	1300	3811	3799	4638	5526	7778	3329	7778
12/12/2024 15:21	TC_POO: Create Order cs00000int	26	2342	2184	4498	4498	4498	1696	4498
12/12/2024 15:21	TC_POO: Open Order cs00000int	26	21016	21313	27232	27414	27442	17793	27442
12/12/2024 15:21	TC_POO: Unopen Order cs00000int	24	9072	9154	10327	10341	10341	8305	10341
12/12/2024 15:21	TC_POO: change-instance-connection-action cs00000int	220	5668	5587	8318	9379	10249	4243	10251
12/12/2024 15:21	TC_RW: Receiving-an-Order-Line cs00000int	24	145692	145321	157002	157523	157563	140093	157563
12/12/2024 15:21	TC_RW: Receiving-an-Order-Line cs00000int Receiving	1200	2950	2932	3491	4041	5584	2503	5592
12/12/2024 15:21	_/proxy/tenants/[tenant]/modules	24	105	107	148	154	154	65	154
12/12/2024 15:21	_/version	24	42	43	53	70	73	7	73
12/12/2024 15:21	acquisitions-units/units	24	24	24	30	64	64	21	64
12/12/2024 15:21	all	194759	151	110	310	1112	141319	6	157563
12/12/2024 15:21	bl-users/_self	24	236	240	422	736	736	80	736
12/12/2024 15:21	configurations/entries	360	17	17	21	24	91	13	91
12/12/2024 15:21	consortia	24	56	56	61	78	78	14	78
12/12/2024 15:21	consortia-configuration	24	61	57	94	94	94	14	94
12/12/2024 15:21	consortia/[consortia_ID]/_self	24	59	59	64	64	64	17	64
12/12/2024 15:21	finance/funds	24	84	84	88	91	91	82	91
12/12/2024 15:21	inventory/items	360	33	32	67	110	150	20	150
12/12/2024 15:21	orders-storage/order-invoice-relns	48	46	47	61	62	91	12	91
12/12/2024 15:21	orders/composite-orders	96	58	57	52	478	825	43	825
12/12/2024 15:21	orders/composite-orders/[order_id_created]	48	327	324	510	510	604	288	604
12/12/2024 15:21	orders/configuration/prefixes	24	108	109	131	174	174	65	174
12/12/2024 15:21	orders/configuration/reasons-for-closure	48	87	86	112	113	117	22	117
12/12/2024 15:21	orders/configuration/suffixes	24	103	102	111	117	119	65	119
12/12/2024 15:21	orders/export-history	24	104	104	127	131	131	24	131
12/12/2024 15:21	orders/order-lines	48	69	70	105	112	117	61	117
12/12/2024 15:21	orders/pieces	360	71	68	79	86	1205	56	1205
12/12/2024 15:21	organizations/organizations	48	47	47	52	66	91	44	91
12/12/2024 15:21	organizations/organizations/[vendor_id]	48	81	80	113	113	131	20	131
12/12/2024 15:21	saml/check	24	65	65	101	111	111	27	111
12/12/2024 15:21	tags	24	14	14	17	17	17	13	17
12/12/2024 15:21	users	96	38	36	79	81	104	13	104

Comparison

Test №1-№2-№3

The following table compares the results between tests №1, №2 and №3.

Open Order: Response times increased nearly 10x in Test 3 compared to Test 1 due to the higher load (50 items per order).
Unopen Order: Similarly, response times grew approximately 4-5x in Test 3.

Resource utilization for Test #1-2-3

Resource utilization table

CPU		RAM
mod-inventory-storage-b	3.50%	mod-finance-b	70%
mod-search-b	2.80%	mod-inventory-b	69%
mod-inventory-b	1.70%	mod-invoice-b	57%
mod-orders-storage-b	1.00%	mod-orders-b	57%
mod-orders-b	0.70%	mod-orders-storage-b	57%
mod-finance-storage-b	0.20%	mod-search-b	44%
mod-finance-b	0.10%	mod-finance-storage-b	32%
mod-invoice-b	0.04%	mod-invoice-storage-b	23%
mod-invoice-storage-b	0.03%	mod-inventory-storage-b	22%

Service CPU Utilization

Here we can see that mod-search initiated reindexing for Test #2.

Service Memory Utilization

Here we can see that all modules show a stable trend.

Kafka metrics

OpenSearch Data Nodes metrics

DB CPU Utilization

DB CPU in the average were 20% for Scenario 1, 30% for Scenario 2 and 40% for Scenario 3

.

DB Connections

Max DB connections was 1560.

DB load

Top SQL-queries


SELECT i.json
  || jsonb_build_object('tenantId', i.tenant_id,
                        'shared', i.shared,
                        'isBoundWith', i.is_bound_with,
                        'holdings', COALESCE(jsonb_agg(DISTINCT h.json || jsonb_build_object('tenantId', h.tenant_id)) FILTER (WHERE h.json IS NOT NULL), '[]'::jsonb),
                        'items', COALESCE(jsonb_agg(it.json || jsonb_build_object('tenantId', it.tenant_id)) FILTER (WHERE it.json IS NOT NULL), '[]'::jsonb)) as json
FROM cs00000int_mod_search.instance i
  LEFT JOIN cs00000int_mod_search.holding h on h.instance_id = i.id
  LEFT JOIN cs00000int_mod_search.item it on it.holding_id = h.id
  WHERE i.id IN ($1::uuid)
  GROUP BY i.id
SELECT * FROM cs00000int_mod_orders_storage.internal_lock WHERE lock_name = $1 FOR UPDATE
SELECT jsonb FROM cs00000int_mod_orders_storage.po_line WHERE lower(f_unaccent(po_line.jsonb->>'locations')) LIKE lower(f_unaccent('%b4585aae-b502-43e6-95c6-4de1c038f6af%')) LIMIT 2147483647 OFFSET 0
SELECT i.json
  || jsonb_build_object('tenantId', i.tenant_id,
                        'shared', i.shared,
                        'isBoundWith', i.is_bound_with,
                        'holdings', COALESCE(jsonb_agg(DISTINCT h.json || jsonb_build_object('tenantId', h.tenant_id)) FILTER (WHERE h.json IS NOT NULL), '[]'::jsonb),
                        'items', COALESCE(jsonb_agg(it.json || jsonb_build_object('tenantId', it.tenant_id)) FILTER (WHERE it.json IS NOT NULL), '[]'::jsonb)) as json
FROM cs00000int_mod_search.instance i
  LEFT JOIN cs00000int_mod_search.holding h on h.instance_id = i.id
  LEFT JOIN cs00000int_mod_search.item it on it.holding_id = h.id
  WHERE i.id IN ($1::uuid,$2::uuid,$3::uuid,$4::uuid,$5::uuid,$6::uuid)
  GROUP BY i.id
SELECT cs00000int_mod_orders_storage.count_estimate('SELECT jsonb,id FROM cs00000int_mod_orders_storage.acquisitions_unit WHERE (CASE WHEN length(lower(f_unaccent(''false''))) <= 600 THEN left(lower(f_unaccent(acquisitions_unit.jsonb->>''isDeleted'')),600) LIKE lower(f_unaccent(''false'')) ELSE left(lower(f_unaccent(acquisitions_unit.jsonb->>''isDeleted'')),600) LIKE left(lower(f_unaccent(''false'')),600) AND lower(f_unaccent(acquisitions_unit.jsonb->>''isDeleted'')) LIKE lower(f_unaccent(''false'')) END) AND (CASE WHEN length(lower(f_unaccent(''false''))) <= 600 THEN left(lower(f_unaccent(acquisitions_unit.jsonb->>''protectRead'')),600) LIKE lower(f_unaccent(''false'')) ELSE left(lower(f_unaccent(acquisitions_unit.jsonb->>''protectRead'')),600) LIKE left(lower(f_unaccent(''false'')),600) AND lower(f_unaccent(acquisitions_unit.jsonb->>''protectRead'')) LIKE lower(f_unaccent(''false'')) END)')

Appendix

Infrastructure

PTF - environment Ramsons (rcon)

11 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 [Number of ECS instances, instance type, location region]
1 instance of db.r6.xlarge database instance: Writer instance
OpenSearch
- domain: ptf-test
- Number of nodes: 7
- Version: OpenSearch_2_13_R20240520-P5
MSK - fse-tenant
- 4 kafka.m7g.xlarge brokers in 2 zones
- Apache Kafka version 3.7.x
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3

RCON modules memory and CPU parameters

rcon-pvt (Wed Dec 11 13:14:17 UTC 2024)

Module	Task Definition Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft Limit	Xmx	Metaspace Size	Max Metaspace Size
mod-remote-storage	7	mod-remote-storage:3.3.2	2	4920	4472	3960	512	512
mod-finance-storage	7	mod-finance-storage:8.7.3	2	1024	896	700	88	128
mod-ncip	7	mod-ncip:1.15.6	2	1024	896	768	88	128
mod-agreements	7	mod-agreements:7.1.2	2	1592	1488	0	0	0
mod-ebsconet	7	mod-ebsconet:2.3.0	2	1248	1024	700	128	256
mod-organizations	7	mod-organizations:2.0.0	2	1024	896	700	88	128
mod-consortia	9	mod-consortia:1.2.1	2	5136	4776	2048	512	1024
edge-sip2	7	edge-sip2:3.3.1	2	1024	896	768	88	128
mod-serials-management	7	mod-serials-management:1.1.1	2	2480	2312	1792	384	512
mod-settings	7	mod-settings:1.1.0	2	1024	896	768	88	128
mod-data-import	7	mod-data-import:3.2.1	1	2048	1844	1292	384	512
mod-search	15	mod-search:4.0.2	2	2592	2480	1440	512	1024
edge-dematic	7	edge-dematic:2.3.1	1	1024	896	768	88	128
mod-inn-reach	4	mod-inn-reach:3.2.1-SNAPSHOT.102	2	3600	3240	2880	512	1024
mod-record-specifications	7	mod-record-specifications:1.0.2	2	1024	896	768	88	128
mod-tags	7	mod-tags:2.3.0	2	1024	896	768	88	128
mod-authtoken	9	mod-authtoken:2.16.1	2	1440	1152	922	88	128
edge-courses	7	edge-courses:1.5.0	2	1024	896	768	88	128
mod-notify	7	mod-notify:3.3.0	2	1024	896	768	88	128
mod-inventory-update	7	mod-inventory-update:4.0.0	2	1024	896	768	88	128
mod-configuration	7	mod-configuration:5.11.0	2	1024	896	768	88	128
mod-orders-storage	7	mod-orders-storage:13.8.3	2	1024	896	700	88	128
edge-caiasoft	7	edge-caiasoft:2.3.2	2	1024	896	768	88	128
mod-login-saml	7	mod-login-saml:2.9.3	2	1024	896	768	88	128
mod-erm-usage-harvester	7	mod-erm-usage-harvester:5.0.1	2	1024	896	768	88	128
mod-gobi	7	mod-gobi:2.9.0	2	1024	896	700	88	128
mod-licenses	7	mod-licenses:6.1.2	2	2480	2312	1792	384	512
mod-password-validator	7	mod-password-validator:3.3.0	2	1440	1298	768	384	512
edge-dcb	8	edge-dcb:1.2.1	2	1024	896	768	88	128
mod-bulk-operations	7	mod-bulk-operations:2.1.4	2	3072	2600	1536	384	512
mod-fqm-manager	9	mod-fqm-manager:3.0.3	2	3000	2600	768	88	128
mod-graphql	8	mod-graphql:1.13.0	2	1024	896	768	88	128
mod-finance	7	mod-finance:5.0.0	2	1024	896	700	88	128
mod-erm-usage	7	mod-erm-usage:5.0.0	2	2800	2550	1800	384	512
mod-batch-print	7	mod-batch-print:1.2.0	2	1024	896	768	88	128
mod-tlr	4	mod-tlr:1.0.0-SNAPSHOT.8	2	1024	896	768	88	128
mod-lists	11	mod-lists:3.0.3	2	6000	2600	768	88	128
mod-copycat	7	mod-copycat:1.7.0	2	1024	512	768	88	128
mod-entities-links	10	mod-entities-links:3.1.1	2	2592	2480	1440	0	1024
mod-permissions	11	mod-permissions:6.6.0	2	1684	1544	1024	384	512
pub-edge	7	pub-edge:2023.06.14	0	1024	896	768	0	0
mod-orders	7	mod-orders:12.9.2	2	2048	1740	1024	384	512
edge-patron	7	edge-patron:5.2.0	2	1024	896	768	88	128
mod-marc-migrations	15	mod-marc-migrations:1.0.1	2	1024	896	768	88	128
edge-ncip	8	edge-ncip:1.10.1	2	1024	896	768	88	128
edge-inn-reach	5	edge-inn-reach:3.3.0-SNAPSHOT.69	2	1024	896	768	88	128
mod-users-bl	7	mod-users-bl:7.9.3	2	1440	1152	922	88	128
mod-oa	4	mod-oa:2.1.0-SNAPSHOT.66	2	1024	896	768	88	128
mod-inventory-storage	8	mod-inventory-storage:28.0.2	2	4096	3690	3076	512	1024
mod-invoice	7	mod-invoice:5.9.1	2	1440	1152	922	88	128
mod-user-import	7	mod-user-import:3.9.0	2	1024	896	768	88	128
mod-sender	7	mod-sender:1.13.0	2	1024	896	768	88	128
edge-oai-pmh	7	edge-oai-pmh:2.10.0	2	1512	1360	1440	384	512
mod-data-export-worker	8	mod-data-export-worker:3.3.3	2	3072	2048	2048	384	512
mod-rtac	7	mod-rtac:3.7.0	2	1024	896	768	88	128
mod-circulation-storage	7	mod-circulation-storage:17.3.1	2	2880	2592	1814	384	512
mod-source-record-storage	12	mod-source-record-storage:5.9.3	2	5600	5000	3500	384	512
mod-calendar	7	mod-calendar:3.2.0	2	1024	896	768	88	128
mod-event-config	7	mod-event-config:2.8.0	2	1024	896	768	88	128
mod-courses	8	mod-courses:1.4.11	2	1024	896	768	88	128
mod-circulation-item	7	mod-circulation-item:1.1.0	2	1024	896	0	0	0
mod-inventory	7	mod-inventory:21.0.2	2	2880	2592	1814	384	512
mod-email	7	mod-email:1.18.0	2	2800	2550	1800	384	512
mod-requests-mediated	4	mod-requests-mediated:1.0.0-SNAPSHOT.4	2	1024	896	768	88	128
mod-circulation	7	mod-circulation:24.3.2	2	2880	2592	1814	384	512
mod-pubsub	7	mod-pubsub:2.15.2	2	1536	1440	922	384	512
mod-di-converter-storage	7	mod-di-converter-storage:2.3.1	2	1024	896	768	88	128
edge-rtac	7	edge-rtac:2.8.0	2	1024	896	768	88	128
edge-orders	7	edge-orders:3.1.0	2	1024	896	768	88	128
mod-users	7	mod-users:19.4.3	2	1024	896	768	88	128
mod-template-engine	7	mod-template-engine:1.21.0	2	1024	896	768	88	128
mod-patron-blocks	7	mod-patron-blocks:1.11.1	2	1024	896	768	88	128
mod-audit	7	mod-audit:2.10.1	2	1024	896	768	88	128
edge-fqm	8	edge-fqm:3.0.1	2	1024	896	768	88	128
mod-source-record-manager	7	mod-source-record-manager:3.9.3	2	5600	5000	3500	384	512
nginx-edge	7	nginx-edge:2023.06.14	0	1024	896	0	0	0
mod-quick-marc	7	mod-quick-marc:6.0.0	1	2288	2176	1664	384	512
nginx-okapi	7	nginx-okapi:2023.06.14	2	1024	896	0	0	0
okapi-b	7	okapi:6.1.0	2	1684	1440	922	384	512
mod-feesfines	7	mod-feesfines:19.2.1	2	1024	896	768	88	128
mod-invoice-storage	7	mod-invoice-storage:5.9.1	2	1872	1536	1024	384	512
mod-reading-room	7	mod-reading-room:1.0.0	2	1024	896	768	88	128
mod-dcb	7	mod-dcb:1.2.3	2	1024	896	768	88	128
mod-service-interaction	7	mod-service-interaction:4.1.1	2	2048	1844	1290	384	512
mod-patron	7	mod-patron:6.2.1	2	1024	896	768	88	128
mod-data-export	12	mod-data-export:5.1.2	1	2048	1844	0	0	0
mod-oai-pmh	7	mod-oai-pmh:3.14.3	2	4096	3690	3076	384	512
edge-connexion	7	edge-connexion:1.3.1	2	1024	896	768	88	128
mod-notes	7	mod-notes:6.0.0	2	1024	896	952	384	512
mod-kb-ebsco-java	8	mod-kb-ebsco-java:5.0.0	2	1024	896	768	88	128
mod-organizations-storage	7	mod-organizations-storage:4.8.1	2	1024	896	700	88	128
mod-data-export-spring	7	mod-data-export-spring:3.4.2	1	2048	1844	1536	384	512
mod-login	7	mod-login:7.12.1	2	1440	1298	768	384	512
pub-okapi	7	pub-okapi:2023.06.14	2	1024	896	768	0	0
edge-erm	5	edge-erm:1.3.0	2	1024	896	768	88	128
mod-eusage-reports	7	mod-eusage-reports:3.0.0	2	1024	896	768	88	128

Methodology/Approach

All tests scenarios were started from Load Generator i-066a4ed5e6ec777bc on Ramsons ECS (rcon) environment.

Parameters for Tests:

Number of users: 1
Test duration: 20min
Each test scenario was conducted with the following dataset sizes for mod_audit.acquisition_order_log, mod_audit.acquisition_order_line_log and mod_audit.acquisition_piece_log tables:
- 500k records
- 1 million records
- 5 million records
No pause between user action

Test scenario №1

Open Order tub
Open Order (with 10 changes in history)
View Order history
Open Order Line (with 10 changes in history)
View Order Line history
Open Pieces (with 10 changes in history)
View Pieces history

Test scenario №2

Open Order tub
Open Order (with 50 changes in history)
View Order history
Open Order Line (with 50 changes in history)
View Order Line history
Open Pieces (with 50 changes in history)
View Pieces history

Test scenario №3

Open Order tub
Open Order (with 100 changes in history)
View Order history
Open Order Line (with 100 changes in history)
View Order Line history
Open Pieces (with 100 changes in history)
View Pieces history

Test scenario №4

Open Order tub
Open Order (with 1000 changes in history)
View Order history
Open Order Line (with 1000 changes in history)
View Order Line history
Open Pieces (with 1000 changes in history)
View Pieces history

Attached files

Ramsons ECS (rcon) module configuration parameters:

JMeter script:

#	TOP 5 SQL statements
1	SELECT i.json \|\| jsonb_build_object('tenantId', i.tenant_id, 'shared', i.shared, 'isBoundWith', i.is_bound_with, 'holdings', COALESCE(jsonb_agg(DISTINCT h.json \|\| jsonb_build_object('tenantId', h.tenant_id)) FILTER (WHERE h.json IS NOT NULL), '[]'::jsonb), 'items', COALESCE(jsonb_agg(it.json \|\| jsonb_build_object('tenantId', it.tenant_id)) FILTER (WHERE it.json IS NOT NULL), '[]'::jsonb)) as json FROM cs00000int_mod_search.instance i LEFT JOIN cs00000int_mod_search.holding h on h.instance_id = i.id LEFT JOIN cs00000int_mod_search.item it on it.holding_id = h.id WHERE i.id IN ($1::uuid) GROUP BY i.id
2	`SELECT * FROM cs00000int_mod_orders_storage.internal_lock WHERE lock_name = $1 FOR UPDATE`
3	`SELECT jsonb FROM cs00000int_mod_orders_storage.po_line WHERE lower(f_unaccent(po_line.jsonb->>'locations')) LIKE lower(f_unaccent('%b4585aae-b502-43e6-95c6-4de1c038f6af%')) LIMIT 2147483647 OFFSET 0`
4	SELECT i.json \|\| jsonb_build_object('tenantId', i.tenant_id, 'shared', i.shared, 'isBoundWith', i.is_bound_with, 'holdings', COALESCE(jsonb_agg(DISTINCT h.json \|\| jsonb_build_object('tenantId', h.tenant_id)) FILTER (WHERE h.json IS NOT NULL), '[]'::jsonb), 'items', COALESCE(jsonb_agg(it.json \|\| jsonb_build_object('tenantId', it.tenant_id)) FILTER (WHERE it.json IS NOT NULL), '[]'::jsonb)) as json FROM cs00000int_mod_search.instance i LEFT JOIN cs00000int_mod_search.holding h on h.instance_id = i.id LEFT JOIN cs00000int_mod_search.item it on it.holding_id = h.id WHERE i.id IN ($1::uuid,$2::uuid,$3::uuid,$4::uuid,$5::uuid,$6::uuid) GROUP BY i.id
5	SELECT cs00000int_mod_orders_storage.count_estimate('SELECT jsonb,id FROM cs00000int_mod_orders_storage.acquisitions_unit WHERE (CASE WHEN length(lower(f_unaccent(''false''))) <= 600 THEN left(lower(f_unaccent(acquisitions_unit.jsonb->>''isDeleted'')),600) LIKE lower(f_unaccent(''false'')) ELSE left(lower(f_unaccent(acquisitions_unit.jsonb->>''isDeleted'')),600) LIKE left(lower(f_unaccent(''false'')),600) AND lower(f_unaccent(acquisitions_unit.jsonb->>''isDeleted'')) LIKE lower(f_unaccent(''false'')) END) AND (CASE WHEN length(lower(f_unaccent(''false''))) <= 600 THEN left(lower(f_unaccent(acquisitions_unit.jsonb->>''protectRead'')),600) LIKE lower(f_unaccent(''false'')) ELSE left(lower(f_unaccent(acquisitions_unit.jsonb->>''protectRead'')),600) LIKE left(lower(f_unaccent(''false'')),600) AND lower(f_unaccent(acquisitions_unit.jsonb->>''protectRead'')) LIKE lower(f_unaccent(''false'')) END)')

RCON [Ramsons] ECS - Acquisition Audit Log Performance testing

Overview

Summary

Test Results

Test №1

Test №2

Test №3

Comparison

Test №1-№2-№3

Resource utilization for Test #1-2-3

Service CPU Utilization

Service Memory Utilization

Kafka metrics

OpenSearch Data Nodes metrics

DB CPU Utilization

DB Connections

DB load

Top SQL-queries

Appendix

Infrastructure

Attached files