Overview

This document contains the results of testing scenario to create order with PO lines plus create invoice with invoice Lines for both Poppy and Quesnelia environments. Tickets: PERF-788 and PERF-891

PERF-788 - Getting issue details... STATUS PERF-891 - Getting issue details... STATUS

Summary

When comparing Test №1 (Poppy) and Test №4 (Quesnelia), we observed an overall improvement in performance across all requests. Additionally, during the same 1.5-hour test duration, Test №3 (Quesnelia) processed 39 more orders, totaling 390 order lines, and 39 more invoices, totaling 379 invoice lines, compared to Test №1 (Poppy).
Comparing Test №2 (Poppy) and Test №5 (Quesnelia), we observed a similar improvement in performance across all requests. Moreover, we noted improvements ranging from 20 to 57 seconds for certain requests. Additionally, Test №2 (Poppy) lasted 3 hours and 10 minutes, while Test №5 (Quesnelia) lasted 1 hour and 8 minutes under the same test conditions.
In the comparison between Test №3 (Poppy) and Test №6 (Quesnelia), we found that all requests showed an improvement in performance, some requests improving by more than 10 seconds. Furthermore, during the same 1-hour test duration, Test №6 (Quesnelia) processed 26 more invoices and 12,580 more blank invoice lines compared to Test №3 (Poppy).

Test Runs

Test №	Date	Test Conditions	Results
1	Mar 30, 2024, 8:21 AM UTC	Test environment Poppy(ocp3), PO with PO Lines(10)+Invoice with PO lines(10 from Order)	Completed
2	Mar 30, 2024, 8:14 PM UTC	Test environment Poppy(ocp3), PO with PO Lines(500)+Invoice with PO lines(500 from Order)	Completed
3	Apr 2, 2024, 8:34 AM UTC	Test environment Poppy(ocp3), Invoice with blank invoice lines(500)	Completed
4	Apr 5, 2024, 11:04 AM UTC	Test environment Quesnelia(qcp1), PO with PO Lines(10)+Invoice with PO lines(10 from Order)	Completed
5	Apr 5, 2024, 2:03 PM UTC	Test environment Quesnelia(qcp1), PO with PO Lines(500)+Invoice with PO lines(500 from Order)	Completed
6	Apr 5, 2024, 4:00 PM UTC	Test environment Quesnelia(qcp1), Invoice with blank invoice line(500)	Completed

Test Results

Test №1

Test environment Poppy(ocp3), PO with PO Lines(10)+Invoice with PO lines(10 from Order)

Requests	Total	50th pct	75th pct	95th pct	99th pct	Average
Requests	Total	Response Time (seconds)
IO_POST invoice/invoice_lines Create Invoice Line (POL)	1128	0.883	0.964	1.648	1.984	0.976
IO_POST invoice/invoices Create Invoice	113	0.103	0.121	0.162	0.179	0.1
POO_POST /orders/composite-orders Create Order	113	0.159	0.201	0.286	0.769	0.179
POO_POST orders/order-lines Create Order Line	1130	0.072	0.104	0.183	0.273	0.095
AIE_PUT invoice/invoices/[invoice_id] Pay Invoice	111	2.477	2.733	2.89	3.162	2.375
AIE_PUT invoice/invoices/id Approve Invoice	111	1.311	1.473	2.064	2.846	1.391
POO_PUT orders/composite-orders/[order_id] Open Order	113	3.07	3.927	4.443	4.684	3.002
PUT orders/composite-orders/[order_id] Approve Order	113	0.178	0.258	0.86	1.236	0.254

Full result table

Requests	Total	50th pct	75th pct	95th pct	99th pct	Average
AIE_GET batch-groups/[batchGroupId]	222	0.017	0.019	0.055	0.096	0.023
AIE_GET batch-voucher/batch-voucher-exports	222	0.053	0.057	0.091	0.119	0.048
AIE_GET batch-voucher/export-configurations	222	0.018	0.023	0.058	0.149	0.03
AIE_GET configurations/entries	444	0.015	0.016	0.021	0.048	0.016
AIE_GET finance/fiscal-years/[fiscalYearId]	222	0.02	0.052	0.057	0.081	0.031
AIE_GET finance/funds	222	0.053	0.056	0.088	0.103	0.057
AIE_GET invoice/invoice-lines	222	0.053	0.056	0.089	0.112	0.057
AIE_GET invoice/invoices	222	0.059	0.089	0.132	0.614	0.079
AIE_GET invoice/invoices/[invoice_id]	222	0.028	0.034	0.071	0.158	0.037
AIE_GET invoice/invoices/[invoice_id]/documents	222	0.018	0.021	0.055	0.174	0.029
AIE_GET material-types	222	0.014	0.016	0.047	0.051	0.017
AIE_GET organizations-storage/categories	222	0.012	0.045	0.051	0.066	0.026
AIE_GET organizations/organizations	222	0.686	0.745	0.836	0.866	0.699
AIE_GET organizations/organizations/[invoice_organization_id]	444	0.018	0.02	0.045	0.098	0.021
AIE_GET users	222	0.011	0.013	0.053	0.058	0.015
AIE_GET voucher/voucher-lines	222	0.051	0.055	0.092	0.106	0.044
AIE_GET voucher/vouchers	222	0.051	0.059	0.096	0.566	0.056
AIE_GET batch-groups/{id}	111	0.018	0.051	0.084	0.099	0.032
AIE_GET batch-voucher/export-configurations	111	0.021	0.053	0.071	0.095	0.035
AIE_GET configurations/entries	222	0.015	0.016	0.02	0.048	0.016
AIE_GET finance/funds	111	0.055	0.058	0.077	0.114	0.058
AIE_GET invoice/invoice-lines	111	0.055	0.08	0.124	0.166	0.068
AIE_GET invoice/invoices	111	0.077	0.089	0.153	0.183	0.081
AIE_GET invoice/invoices-Choose	111	0.133	0.168	0.211	0.702	0.14
AIE_GET invoice/invoices-Choose by id	111	0.032	0.064	0.099	0.106	0.047
AIE_GET invoice/invoices/{id}/documents	111	0.02	0.053	0.086	0.103	0.036
AIE_GET material-types	111	0.014	0.017	0.05	0.052	0.02
AIE_GET organizations/organizations/{id}	222	0.018	0.02	0.056	0.084	0.022
AIE_GET users	111	0.012	0.013	0.054	0.061	0.016
AIE_PUT invoice/invoices/[invoice_id]	111	2.477	2.733	2.89	3.162	2.375
AIE_PUT invoice/invoices/id	111	1.311	1.473	2.064	2.846	1.391
AIE_TC: Invoices Approve fs09000000	111	1.938	2.109	2.841	3.55	2.002
Debug Sampler	1128	0	0	0.001	0.001	0
FOLIO: Login	1	0.317	0.317	0.317	0.317	0.317
GET bl-users/_self	1	1.412	1.412	1.412	1.412	1.412
IO_GET acquisitions-units/memberships	113	0.021	0.052	0.086	0.098	0.034
IO_GET acquisitions-units/units	337	0.02	0.024	0.088	0.107	0.031
IO_GET batch-groups	337	0.021	0.054	0.092	0.654	0.046
IO_GET batch-groups/{id}	111	0.052	0.059	0.093	0.098	0.049
IO_GET batch-voucher/export-configurations	111	0.052	0.061	0.095	0.167	0.053
IO_GET configurations/entries	785	0.015	0.018	0.034	0.051	0.018
IO_GET finance/expense-classes	224	0.022	0.025	0.059	0.089	0.032
IO_GET finance/funds	335	0.055	0.063	0.092	0.101	0.061
IO_GET invoice/invoice-lines	111	0.056	0.093	0.164	0.798	0.097
IO_GET invoice/invoices	113	0.05	0.078	0.098	0.122	0.06
IO_GET invoice/invoices/{id}	111	0.093	0.128	0.516	0.75	0.132
IO_GET invoice/invoices/{id}/documents	111	0.053	0.058	0.09	0.117	0.048
IO_GET material-types	111	0.015	0.048	0.053	0.076	0.028
IO_GET orders/order-lines	1128	0.13	0.139	0.172	0.23	0.135
IO_GET organizations/organizations	113	0.058	0.062	0.078	0.113	0.061
IO_GET organizations/organizations/{id}	335	0.019	0.023	0.091	0.115	0.029
IO_GET tags	337	0.015	0.017	0.047	0.053	0.017
IO_GET users	111	0.013	0.02	0.057	0.064	0.023
IO_POST invoice/invoice_lines	1128	0.883	0.964	1.648	1.984	0.976
IO_POST invoice/invoices	113	0.103	0.121	0.162	0.179	0.1
IO_TC: Create Invoice Lines fs09000000	1128	0.883	0.964	1.648	1.984	0.976
IO_TC: Create Invoices Workflow fs09000000	111	17.148	17.759	18.241	24.233	17.266
IOP_TC: Paying Invoices fs09000000	111	5.028	5.28	5.617	5.822	5.019
JSR223 Sampler 1	113	0	0	0.001	0.003	0
JSR223 Sampler 3	113	0	0.001	0.001	0.002	0.001
JSR223 Sampler 4	1129	0	0.001	0.001	0.001	0
POO-GET orders/configuration/prefixes	113	0.018	0.02	0.025	0.028	0.019
POO_GET /acquisitions-units/memberships	113	0.018	0.052	0.08	0.092	0.031
POO_GET /acquisitions-units/units	452	0.019	0.022	0.058	0.096	0.026
POO_GET /configurations/entries	1356	0.016	0.018	0.023	0.037	0.017
POO_GET /finance/expense-classes	113	0.022	0.028	0.059	0.096	0.031
POO_GET /finance/funds	226	0.054	0.058	0.086	0.116	0.058
POO_GET /material-types	113	0.014	0.015	0.023	0.055	0.016
POO_GET /orders/acquisition-methods	113	0.024	0.055	0.088	0.092	0.039
POO_GET /orders/composite-orders/[order_id]	113	0.032	0.09	0.11	0.131	0.053
POO_GET /orders/configuration/prefixes	452	0.021	0.05	0.099	0.11	0.035
POO_GET /orders/configuration/reasons-for-closure	339	0.02	0.052	0.089	0.099	0.034
POO_GET /orders/configuration/suffixes	452	0.018	0.049	0.091	0.112	0.032
POO_GET /orders/order-lines	226	0.172	0.202	0.258	0.301	0.14
POO_GET /orders/order-templates	113	0.021	0.053	0.086	0.1	0.035
POO_GET /orders/po-number	113	0.05	0.057	0.093	0.126	0.05
POO_GET /organizations(vendor)	113	0.676	0.715	0.795	0.895	0.69
POO_GET /organizations/organizations/[vendor_id]	113	0.018	0.02	0.029	0.092	0.021
POO_GET /tags	452	0.015	0.017	0.05	0.057	0.019
POO_GET /users	226	0.011	0.013	0.025	0.056	0.014
POO_GET _/proxy/tenants/[tenant]/modules	1130	0.051	0.054	0.085	0.092	0.055
POO_GET _/version	1130	0.005	0.005	0.04	0.049	0.008
POO_GET acquisitions-units/memberships	113	0.05	0.055	0.093	0.445	0.051
POO_GET acquisitions-units/units	4746	0.019	0.021	0.029	0.053	0.021
POO_GET configurations/entries	21809	0.015	0.017	0.024	0.043	0.016
POO_GET contributor-name-types	3390	0.011	0.012	0.021	0.047	0.013
POO_GET contributor-types	1130	0.018	0.021	0.053	0.066	0.023
POO_GET data-export-spring/configs	1130	0.027	0.03	0.067	0.103	0.036
POO_GET erm/entitlements	1130	0.016	0.019	0.053	0.065	0.021
POO_GET finance/expense-classes	1130	0.022	0.026	0.059	0.092	0.028
POO_GET finance/funds	5876	0.055	0.058	0.074	0.096	0.057
POO_GET holdings-storage/holdings	1130	0.011	0.013	0.046	0.051	0.017
POO_GET identifier-types	2260	0.012	0.013	0.026	0.049	0.014
POO_GET instance-formats	1130	0.012	0.014	0.047	0.053	0.017
POO_GET instance-relationship-types	2260	0.011	0.012	0.026	0.047	0.013
POO_GET instance-types	2260	0.011	0.013	0.026	0.05	0.014
POO_GET inventory/instances	2260	0.073	0.08	0.124	0.189	0.08
POO_GET inventory/instances/[instances_id]	1130	0.075	0.085	0.201	0.367	0.091
POO_GET invoice/invoice-lines	1130	0.053	0.06	0.104	0.154	0.063
POO_GET locations	4520	0.039	0.041	0.051	0.074	0.041
POO_GET material-types	4520	0.014	0.015	0.021	0.031	0.015
POO_GET modes-of-issuance	1130	0.011	0.013	0.046	0.052	0.015
POO_GET nature-of-content-terms	1130	0.011	0.013	0.046	0.054	0.016
POO_GET note-links/domain/orders/type/poLine/id/[poLine_id]	1130	0.014	0.017	0.049	0.062	0.019
POO_GET note-types	1130	0.013	0.016	0.048	0.06	0.019
POO_GET orders-storage/order-invoice-relns	1469	0.011	0.013	0.044	0.049	0.014
POO_GET orders/acquisition-methods	1130	0.018	0.021	0.054	0.079	0.024
POO_GET orders/acquisition-methods/[acquisition_methods_id]	1130	0.017	0.021	0.055	0.087	0.024
POO_GET orders/composite-orders	3955	0.776	1.009	1.162	1.38	0.615
POO_GET orders/composite-orders/[order_id]	5084	0.

Folio Development Teams

[Poppy vs Quesnelia] - Performance tests for scenario create Order + PO lines -> create Invoice + INV Lines

Overview

Summary

Test Results

Test №1