1 Overview
2 Summary
3 Test Runs and Results
4 Resource utilization for Test Set №1
- 4.1 Service CPU Utilization
- 4.2 Service Memory Utilization
- 4.3 Kafka metrics
- 4.4 DB CPU Utilization
- 4.5 DB Connections
- 4.6 DB load
- 4.7 Top SQL-queries
5 Resource utilization for Test Set №2
- 5.1 Service CPU Utilization
- 5.2 Service Memory Utilization
- 5.3 Kafka metrics
- 5.4 DB CPU Utilization
- 5.5 DB Connections
- 5.6 DB load
- 5.7 Top SQL-queries
6 Resource utilization for Test Set №3
- 6.1 Service CPU Utilization
- 6.2 Service Memory Utilization
- 6.3 Kafka metrics
- 6.4 DB CPU Utilization
- 6.5 DB Connections
- 6.6 DB load
- 6.7 Top SQL-queries
7 Resource utilization for Test Set №4
- 7.1 Service CPU Utilization
- 7.2 Service Memory Utilization
- 7.3 Kafka metrics
- 7.4 DB CPU Utilization
- 7.5 DB Connections
- 7.6 DB load
- 7.7 Top SQL-queries
8 Resource utilization for Test Set №5
- 8.1 Service CPU Utilization
- 8.2 Service Memory Utilization
- 8.3 Kafka metrics
- 8.4 DB CPU Utilization
- 8.5 DB Connections
- 8.6 DB load
- 8.7 Top SQL-queries
9 Resource utilization for Test Set №6
- 9.1 Service CPU Utilization
- 9.2 Service Memory Utilization
- 9.3 Kafka metrics
- 9.4 DB CPU Utilization
- 9.5 DB Connections
- 9.6 DB load
- 9.7 Top SQL-queries
10 Appendix
- 10.1 Infrastructure
11 Methodology/Approach
- 11.1 SQL Query

Overview

This document contains the results of Data Export tests on 62 tenants (excluding the central tenant) on the QCPT environment, the previous report is available.

https://folio-org.atlassian.net/browse/PERF-888

Summary

During the Data-Export tests we observe Error "java.lang.OutOfMemoryError: Metaspace", so parameters for data-export module were changed:
- "memory": 1024 → 2304
- "memoryReservation": 896 → 2048
- -XX:MaxMetaspaceSize=128m → 256m
- -Xmx768m → 1536m
After upgrade Data-Export module all Data Export tests finished successfully on qcpt environment using the Default instances, authority, holdings export job profiles and Custom PTF Profiles.
No memory leaks, memory consumption was stable during all of the tests.
Database CPU usage varied up to a maximum of 26%
During the tests we had a some background process on Database side

Test Runs and Results

This table contains Data Export durations for Test Set №1.

	500 (instance records)	1000 (instance records)	2000 (instance records)

	500 (instance records)	1000 (instance records)	2000 (instance records)
Tenant	Duration hh:mm:ss	Duration hh:mm:ss	Duration hh:mm:ss
Average	0:00:01	0:00:02	0:00:04
Member tenants 75pct	0:00:01	0:00:03	0:00:05
Member tenants MAX	0:00:04	0:00:04	0:00:08
cs00000001_0042 (maximum instance records)	0:07:55	0:07:32	0:07:41

Tenant 500 1000 2000 Duration Duration Duration cs00000001_0001 0:00:02 0:00:03 0:00:05 cs00000001_0002 0:00:01 0:00:02 0:00:04 cs00000001_0003 0:00:01 0:00:03 0:00:06 cs00000001_0004 0:00:01 0:00:02 0:00:04 cs00000001_0005 0:00:01 0:00:02 0:00:04 cs00000001_0006 0:00:01 0:00:02 0:00:04 cs00000001_0007 0:00:01 0:00:03 0:00:05 cs00000001_0008 0:00:01 0:00:02 0:00:04 cs00000001_0009 0:00:01 0:00:02 0:00:05 cs00000001_0010 0:00:01 0:00:03 0:00:05 cs00000001_0011 0:00:01 0:00:02 0:00:04 cs00000001_0012 0:00:02 0:00:03 0:00:05 cs00000001_0013 0:00:01 0:00:02 0:00:04 cs00000001_0014 0:00:01 0:00:02 0:00:04 cs00000001_0015 0:00:01 0:00:02 0:00:04 cs00000001_0016 0:00:01 0:00:03 0:00:05 cs00000001_0017 0:00:01 0:00:02 0:00:04 cs00000001_0018 0:00:01 0:00:03 0:00:05 cs00000001_0019 0:00:01 0:00:02 0:00:04 cs00000001_0020 0:00:01 0:00:03 0:00:04 cs00000001_0021 0:00:01 0:00:02 0:00:04 cs00000001_0022 0:00:01 0:00:02 0:00:05 cs00000001_0023 0:00:02 0:00:03 0:00:04 cs00000001_0024 0:00:01 0:00:02 0:00:05 cs00000001_0025 0:00:01 0:00:02 0:00:04 cs00000001_0026 0:00:01 0:00:02 0:00:05 cs00000001_0027 0:00:01 0:00:02 0:00:04 cs00000001_0028 0:00:01 0:00:02 0:00:04 cs00000001_0029 0:00:01 0:00:02 0:00:04 cs00000001_0030 0:00:01 0:00:02 0:00:04 cs00000001_0031 0:00:04 0:00:02 0:00:04 cs00000001_0032 0:00:01 0:00:02 0:00:04 cs00000001_0033 0:00:01 0:00:02 0:00:05 cs00000001_0034 0:00:02 0:00:03 0:00:04 cs00000001_0035 0:00:01 0:00:02 0:00:04 cs00000001_0036 0:00:02 0:00:02 0:00:04 cs00000001_0037 0:00:01 0:00:02 0:00:04 cs00000001_0038 0:00:01 0:00:02 0:00:04 cs00000001_0039 0:00:01 0:00:02 0:00:04 cs00000001_0040 0:00:01 0:00:03 0:00:05 cs00000001_0041 0:00:01 0:00:03 0:00:05 cs00000001_0042 0:07:55 0:07:32 0:07:41 cs00000001_0043 0:00:01 0:00:02 0:00:02 cs00000001_0044 0:00:01 0:00:03 0:00:05 cs00000001_0045 0:00:02 0:00:04 0:00:05 cs00000001_0046 0:00:01 0:00:02 0:00:03 cs00000001_0047 0:00:01 0:00:02 0:00:04 cs00000001_0048 0:00:01 0:00:02 0:00:04 cs00000001_0049 0:00:01 0:00:02 0:00:06 cs00000001_0050 0:00:01 0:00:03 0:00:05 cs00000001_0051 0:00:01 0:00:03 0:00:05 cs00000001_0052 0:00:01 0:00:02 0:00:04 cs00000001_0053 0:00:01 0:00:03 0:00:05 cs00000001_0054 0:00:01 0:00:02 0:00:08 cs00000001_0055 0:00:01 0:00:02 0:00:04 cs00000001_0056 0:00:02 0:00:04 0:00:04 cs00000001_0057 0:00:01 0:00:03 0:00:04 cs00000001_0058 0:00:01 0:00:03 0:00:06 cs00000001_0059 0:00:01 0:00:02 0:00:04 cs00000001_0060 0:00:01 0:00:02 0:00:05 cs00000001_0061 0:00:01 0:00:03 0:00:07 cs00000001_0062 0:00:01 0:00:02 0:00:03

This table contains Data Export durations for Test Set №2.

PTF - Performance testing of Data Export (Quesnelia) [ECS]

Overview

Summary

Test Runs and Results