PTF - Data Export Test Report (Sunflower CSP1) [ECS]
1 Overview
2 Summary
6 Resource utilization for Test #2
6.5 DB Connections
6.6 Kafka metrics
6.8 DB load
6.9 Top SQL-queries
6.10 Top applications
7 Resource utilization for Test #3
7.5 DB Connections
7.6 Kafka metrics
7.8 DB load
7.9 Top SQL-queries
7.10 Top applications
8 Appendix
8.1 Infrastructure
Service Memory Utilization
Service Memory Utilization
Overview
This document contains the results of three times testing Data Export (MARC BIB) on the Sunflower[ECS] CSP1 release. All test results have been summarized correctly.
https://folio-org.atlassian.net/browse/PERF-1180
Summary
Data Export tests finished successfully(except some duplications) on using the profiles Default instances export job profile and SRS - holdings and items job profile.
Comparing with Sunflower release
Data Export test executed on College (member) tenant only.
Overall the results are better, by 6-16 percent, depending on the test. Only one test showed worse results: DE MARC Bib (Default instances export job profile) 100k slower by 1 minute compared to previous results
During the testing, the results were not very good, and it was decided to make a vacuum and conduct the testing again. As a result, performance improvements were observed: 1.5 minutes for the default profile and 3 minutes for the SRS profile when exporting 500,000 records.
Test Results #1
This table contains durations for Data Export with two job profiles.
Profile | CSV File | Tenant College(cs00000int_0001) | |
|---|---|---|---|
Result | Status | ||
DE MARC Bib (Default instances export job profile) | 1k.csv | 0:00:07 | COMPLETED |
100k.csv | 0:03:55 | COMPLETED | |
500k.csv | 0:04:03 | COMPLETED | |
DE MARC Bib (SRS - holdings and items job profile) | 1k.csv | 0:00:07 | COMPLETED |
100k.csv | 0:06:26 | COMPLETED | |
500k.csv | 0:06:41 | COMPLETED | |
Test Results #2 with a bigger number of tests
This table contains durations for Data Export with two job profiles with a bigger number of tests.
Profile | CSV File | Tenant College(cs00000int_0001) | |||||
|---|---|---|---|---|---|---|---|
Result |
|
|
|
| Status | ||
DE MARC Bib (Default instances export job profile) | 1k.csv | - | - | - | - | - | COMPLETED |
100k.csv | 00:05:16 | 00:02:27 | 00:02:27 | 00:02:34 | 00:02:36 | COMPLETED | |
500k.csv | 00:08:33 | 00:07:59 | 00:06:53 | 00:07:06 | 00:07:21 | COMPLETED | |
DE MARC Bib (SRS - holdings and items job profile) | 1k.csv | - | - | - | - | - | COMPLETED |
100k.csv | 00:09:46 | 00:06:52 | 00:06:57 | 00:07:19 | 00:06:57 | COMPLETED | |
500k.csv | 00:13:11 | 00:13:16 | 00:13:14 | - | - | COMPLETED | |
Test Results #3 after vacuum
This table contains durations for Data Export with two job profiles with a bigger number of tests after vacuum.
Profile | CSV File | Tenant College(cs00000int_0001) | |||||
|---|---|---|---|---|---|---|---|
Result |
|
|
|
| Status | ||
DE MARC Bib (Default instances export job profile) | 1k.csv | 0:00:02 | 0:00:02 | 0:00:02 | 0:00:02 | 0:00:02 | COMPLETED |
100k.csv | 0:02:00 | 0:01:58 | 0:02:01 | 0:02:01 | 0:01:59 | COMPLETED | |
500k.csv | 0:05:00 | 0:05:02 | 0:04:54 | 0:05:11 | 0:04:44 | COMPLETED | |
DE MARC Bib (SRS - holdings and items job profile) | 1k.csv | 0:00:09 | 0:00:03 | 0:00:03 | 0:00:03 | 0:00:03 | COMPLETED |
100k.csv | 0:07:33 | 0:04:19 | 0:04:42 | 0:05:11 | 0:04:44 | COMPLETED | |
500k.csv | 0:08:50 | 0:07:21 | 0:07:25 | 0:07:40 | 0:08:35 | COMPLETED | |
Comparison
This table contains durations comparison between Sunflower Test #1 and Sunflower CSP1 releases.
Profile | CSV File | DE Duration | DE Duration | DE Duration, DELTA Sunflower CSP1/Sunflower |
Result | Result | hh:mm:ss / percent | ||
DE MARC Bib (Default instances export job profile) | 1k.csv | 0:00:07 | 0:00:07 | +00:00:00 |
100k.csv | 0:03:55 | 0:02:55 | +00:01:00 | |
500k.csv | 0:04:03 | 0:04:28 | -00:00:25 | |
DE MARC Bib (SRS - holdings and items job profile) | 1k.csv | 0:00:07 | 0:00:08 | -00:00:01 |
100k.csv | 0:06:26 | 0:06:52 | -00:00:26 | |
500k.csv | 0:06:41 | 0:07:48 | -00:01:07 |
Resource utilization for Test #1
Resource utilization table
CPU | RAM | ||
|---|---|---|---|
mod-data-export-b | 41.79% | mgr-applications-b | 82.53% |
mod-inventory-b | 19.40% | mod-scheduler-b | 67.72% |
mod-inn-reach-b | 12.84% | mod-dcb-b | 64.48% |
mod-users-keycloak-b | 6.49% | mod-finance-b | 63.94% |
mod-login-keycloak-b 8.48 | 10.01% | mgr-tenant-entitlements-b | 63.84% |
mod-roles-keycloak-b | 7.27% | mod-roles-keycloak-b | 62.77% |
mod-consortia-keycloak-b | 6.54% | mod-pubsub-b | 61.57% |
mod-inventory-storage-b | 4.58% | mod-users-keycloak-b | 60.44% |
mod-pubsub-b | 3.06% | mod-serials-management-b | 59.51% |
Instance CPU Utilization
Service CPU Utilization
Here we can see that mod-data-export used 42% CPU in spike.
Service Memory Utilization
Here we can see all services have stable trends but mod-data-export which used more memory when data volume increased.
DB CPU Utilization
CPU utilization during data export peaked up to ~33% with higher loads (100k/500k), while smaller loads (1k/100k) caused moderate spikes (~10–16%).
DB Connections
DB connections was 1300.
Kafka metrics
OpenSearch Data Nodes metrics