/
[Poppy vs Quesnelia] - Performance tests for scenario create Order + PO lines -> create Invoice + INV Lines

[Poppy vs Quesnelia] - Performance tests for scenario create Order + PO lines -> create Invoice + INV Lines

Apr 10, 2024

Overview

  • This document contains the results of testing scenario to create order with PO lines plus create invoice with invoice Lines for both Poppy and Quesnelia environments. Tickets: PERF-788 and PERF-891

https://folio-org.atlassian.net/browse/PERF-788 https://folio-org.atlassian.net/browse/PERF-891

Summary

  • When comparing Test №1 (Poppy) and Test №4 (Quesnelia), we observed an overall improvement in performance across all requests. Additionally, during the same 1.5-hour test duration, Test №3 (Quesnelia) processed 39 more orders, totaling 390 order lines, and 39 more invoices, totaling 379 invoice lines, compared to Test №1 (Poppy).

  • Comparing Test №2 (Poppy) and Test №5 (Quesnelia), we observed a similar improvement in performance across all requests. Moreover, we noted improvements ranging from 20 to 57 seconds for certain requests. Additionally, Test №2 (Poppy) lasted 3 hours and 10 minutes, while Test №5 (Quesnelia) lasted 1 hour and 8 minutes under the same test conditions.

  • In the comparison between Test №3 (Poppy) and Test №6 (Quesnelia), we found that all requests showed an improvement in performance, some requests improving by more than 10 seconds. Furthermore, during the same 1-hour test duration, Test №6 (Quesnelia) processed 26 more invoices and 12,580 more blank invoice lines compared to Test №3 (Poppy).

 

Test Runs 

Test №

Date

Test Conditions

Results

1

Mar 30, 2024, 8:21 AM UTC

Test environment Poppy(ocp3), PO with PO Lines(10)+Invoice with PO lines(10 from Order)

Completed

2

Mar 30, 2024, 8:14 PM UTC

Test environment Poppy(ocp3), PO with PO Lines(500)+Invoice with PO lines(500 from Order)

Completed

3

Apr 2, 2024, 8:34 AM UTC

Test environment Poppy(ocp3), Invoice with blank invoice lines(500)

Completed

4

Apr 5, 2024, 11:04 AM UTC

Test environment Quesnelia(qcp1), PO with PO Lines(10)+Invoice with PO lines(10 from Order)

Completed

5

Apr 5, 2024, 2:03 PM UTC

Test environment Quesnelia(qcp1), PO with PO Lines(500)+Invoice with PO lines(500 from Order)

Completed

6

Apr 5, 2024, 4:00 PM UTC

Test environment Quesnelia(qcp1), Invoice with blank invoice line(500)

Completed

Test Results

Test №1

Test environment Poppy(ocp3), PO with PO Lines(10)+Invoice with PO lines(10 from Order)

Requests


Total

Response Time (seconds)

50th pct

75th pct

95th pct

99th pct

Average

IO_POST invoice/invoice_lines

Create Invoice Line (POL)

1128

0.883

0.964

1.648

1.984

0.976

IO_POST invoice/invoices

Create Invoice

113

0.103

0.121

0.162

0.179

0.1

POO_POST /orders/composite-orders

Create Order

113

0.159

0.201

0.286

0.769

0.179

POO_POST orders/order-lines

Create Order Line

1130

0.072

0.104

0.183

0.273

0.095

AIE_PUT invoice/invoices/[invoice_id]

Pay Invoice

111

2.477

2.733

2.89

3.162

2.375

AIE_PUT invoice/invoices/id
Approve Invoice

111

1.311

1.473

2.064

2.846

1.391

POO_PUT orders/composite-orders/[order_id]

Open Order

113

3.07

3.927

4.443

4.684

3.002

PUT orders/composite-orders/[order_id]

Approve Order

113

0.178

0.258

0.86

1.236

0.254

Requests

Total

50th pct

75th pct

95th pct

99th pct

Average

Requests

Total

50th pct

75th pct

95th pct

99th pct

Average

AIE_GET batch-groups/[batchGroupId]

222

0.017

0.019

0.055

0.096

0.023

AIE_GET batch-voucher/batch-voucher-exports

222

0.053

0.057

0.091

0.119

0.048

AIE_GET batch-voucher/export-configurations

222

0.018

0.023

0.058

0.149

0.03

AIE_GET configurations/entries

444

0.015

0.016

0.021

0.048

0.016

AIE_GET finance/fiscal-years/[fiscalYearId]

222

0.02

0.052

0.057

0.081

0.031

AIE_GET finance/funds

222

0.053

0.056

0.088

0.103

0.057

AIE_GET invoice/invoice-lines

222

0.053

0.056

0.089

0.112

0.057

AIE_GET invoice/invoices

222

0.059

0.089

0.132

0.614

0.079

AIE_GET invoice/invoices/[invoice_id]

222

0.028

0.034

0.071

0.158

0.037

AIE_GET invoice/invoices/[invoice_id]/documents

222

0.018

0.021

0.055

0.174

0.029

AIE_GET material-types

222

0.014

0.016

0.047

0.051

0.017

AIE_GET organizations-storage/categories

222

0.012

0.045

0.051

0.066

0.026

AIE_GET organizations/organizations

222

0.686

0.745

0.836

0.866

0.699

AIE_GET organizations/organizations/[invoice_organization_id]

444

0.018

0.02

0.045

0.098

0.021

AIE_GET users

222

0.011

0.013

0.053

0.058

0.015

AIE_GET voucher/voucher-lines

222

0.051

0.055

0.092

0.106

0.044

AIE_GET voucher/vouchers

222

0.051

0.059

0.096

0.566

0.056

AIE_GET batch-groups/{id}

111

0.018

0.051

0.084

0.099

0.032

AIE_GET batch-voucher/export-configurations

111

0.021

0.053

0.071

0.095

0.035

AIE_GET configurations/entries

222

0.015

0.016

0.02

0.048

0.016

AIE_GET finance/funds

111

0.055

0.058

0.077

0.114

0.058

AIE_GET invoice/invoice-lines

111

0.055

0.08

0.124

0.166

0.068

AIE_GET invoice/invoices

111

0.077

0.089

0.153

0.183

0.081

AIE_GET invoice/invoices-Choose

111

0.133

0.168

0.211

0.702

0.14

AIE_GET invoice/invoices-Choose by id

111

0.032

0.064

0.099

0.106

0.047

AIE_GET invoice/invoices/{id}/documents

111

0.02

0.053

0.086

0.103

0.036

AIE_GET material-types

111

0.014

0.017

0.05

0.052

0.02

AIE_GET organizations/organizations/{id}

222

0.018

0.02

0.056

0.084

0.022

AIE_GET users