PTF - Performance testing of Data Export (Quesnelia) [ECS]

PTF - Performance testing of Data Export (Quesnelia) [ECS]

Overview

  • This document contains the results of Data Export tests on 62 tenants (excluding the central tenant) on the QCPT environment, the previous report is available. 

https://folio-org.atlassian.net/browse/PERF-888 

Summary

  • During the Data-Export tests we observe Error "java.lang.OutOfMemoryError: Metaspace", so parameters for data-export module were changed:

    • "memory": 1024 → 2304

    • "memoryReservation": 896 → 2048

    • -XX:MaxMetaspaceSize=128m → 256m

    • -Xmx768m → 1536m

  • After upgrade Data-Export module all Data Export tests finished successfully on qcpt environment using the Default instances, authority, holdings export job profiles and Custom PTF Profiles.

  • No memory leaks, memory consumption was stable during all of the tests.

  • Database CPU usage varied up to a maximum of 26%

  • During the tests we had a some background process on Database side

Test Runs and Results

This table contains Data Export durations for Test Set №1

 

500
(instance records)

1000
(instance records)

2000
(instance records)

 

500
(instance records)

1000
(instance records)

2000
(instance records)

Tenant

Duration
hh:mm:ss

Duration
hh:mm:ss

Duration
hh:mm:ss

Average

0:00:01

0:00:02

0:00:04

Member tenants 75pct

0:00:01

0:00:03

0:00:05

Member tenants MAX

0:00:04

0:00:04

0:00:08

cs00000001_0042
(maximum instance records)

0:07:55

0:07:32

0:07:41

 

Tenant

500

1000

2000

Tenant

500

1000

2000

 

Duration

Duration

Duration

cs00000001_0001

0:00:02

0:00:03

0:00:05

cs00000001_0002

0:00:01

0:00:02

0:00:04

cs00000001_0003

0:00:01

0:00:03

0:00:06

cs00000001_0004

0:00:01

0:00:02

0:00:04

cs00000001_0005

0:00:01

0:00:02

0:00:04

cs00000001_0006

0:00:01

0:00:02

0:00:04

cs00000001_0007

0:00:01

0:00:03

0:00:05

cs00000001_0008

0:00:01

0:00:02

0:00:04

cs00000001_0009

0:00:01

0:00:02

0:00:05

cs00000001_0010

0:00:01

0:00:03

0:00:05

cs00000001_0011

0:00:01

0:00:02

0:00:04

cs00000001_0012

0:00:02

0:00:03

0:00:05

cs00000001_0013

0:00:01

0:00:02

0:00:04

cs00000001_0014

0:00:01

0:00:02

0:00:04

cs00000001_0015

0:00:01

0:00:02

0:00:04

cs00000001_0016

0:00:01

0:00:03

0:00:05

cs00000001_0017

0:00:01

0:00:02

0:00:04

cs00000001_0018

0:00:01

0:00:03

0:00:05

cs00000001_0019

0:00:01

0:00:02

0:00:04

cs00000001_0020

0:00:01

0:00:03

0:00:04

cs00000001_0021

0:00:01

0:00:02

0:00:04

cs00000001_0022

0:00:01

0:00:02

0:00:05

cs00000001_0023

0:00:02

0:00:03

0:00:04

cs00000001_0024

0:00:01

0:00:02

0:00:05

cs00000001_0025

0:00:01

0:00:02

0:00:04

cs00000001_0026

0:00:01

0:00:02

0:00:05

cs00000001_0027

0:00:01

0:00:02

0:00:04

cs00000001_0028

0:00:01

0:00:02

0:00:04

cs00000001_0029

0:00:01

0:00:02

0:00:04

cs00000001_0030

0:00:01

0:00:02

0:00:04

cs00000001_0031

0:00:04

0:00:02

0:00:04

cs00000001_0032

0:00:01

0:00:02

0:00:04

cs00000001_0033

0:00:01

0:00:02

0:00:05

cs00000001_0034

0:00:02

0:00:03

0:00:04

cs00000001_0035

0:00:01

0:00:02

0:00:04

cs00000001_0036

0:00:02

0:00:02

0:00:04

cs00000001_0037

0:00:01

0:00:02

0:00:04

cs00000001_0038

0:00:01

0:00:02

0:00:04

cs00000001_0039

0:00:01

0:00:02

0:00:04

cs00000001_0040

0:00:01

0:00:03

0:00:05

cs00000001_0041

0:00:01

0:00:03

0:00:05

cs00000001_0042

0:07:55

0:07:32

0:07:41

cs00000001_0043

0:00:01

0:00:02

0:00:02

cs00000001_0044

0:00:01

0:00:03

0:00:05

cs00000001_0045

0:00:02

0:00:04

0:00:05

cs00000001_0046

0:00:01

0:00:02

0:00:03

cs00000001_0047

0:00:01

0:00:02

0:00:04

cs00000001_0048

0:00:01

0:00:02

0:00:04

cs00000001_0049

0:00:01

0:00:02

0:00:06

cs00000001_0050

0:00:01

0:00:03

0:00:05

cs00000001_0051

0:00:01

0:00:03

0:00:05

cs00000001_0052

0:00:01

0:00:02

0:00:04

cs00000001_0053

0:00:01

0:00:03

0:00:05

cs00000001_0054

0:00:01

0:00:02

0:00:08

cs00000001_0055

0:00:01

0:00:02

0:00:04

cs00000001_0056

0:00:02

0:00:04

0:00:04

cs00000001_0057

0:00:01

0:00:03

0:00:04

cs00000001_0058

0:00:01

0:00:03

0:00:06

cs00000001_0059

0:00:01

0:00:02

0:00:04

cs00000001_0060

0:00:01

0:00:02

0:00:05

cs00000001_0061

0:00:01

0:00:03

0:00:07

cs00000001_0062

0:00:01

0:00:02

0:00:03

 

This table contains Data Export durations for Test Set №2