IN PROGRESS
| Table of Contents |
|---|
Overview
This document contains the results of testing Data Import for MARC Bibliographic records in the Nolana release to detect performance trends for multiple concurrent jobs.Jira Legacy server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key PERF-387
...
- For all tenants, we can observe different data import duration: for example, 50k MARC BIB Create tenant fs09000000 - 21min, tenant fs07000001 - 34 min, and tenant fs07000002 - 42 min.
Jira Legacy server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key PERF-414 - Data import is not able to work on multiple tenants: When data import starts on the second tenant, both jobs are stuck. Data Import becomes unavailable for several hours.
Could be related toJira Legacy server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key PERF-415 Jira Legacy server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key PERF-388
...
Duration tenant fs09000000 | Duration tenant fs07000002 | Duration tenant fs07000001 | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
50K MARC Create (2 concurrent jobs) | PTF - Create 2 | - |
|
| ||||||||||||||||
50K MARC Update (2 concurrent jobs) | PTF - Updates Success - 1 | - | DNR | DNR | ||||||||||||||||
| 50K MARC Create (3 concurrent jobs) | PTF - Create 2 | DNR | DNR | DNR | ||||||||||||||||
50K MARC Update (3 concurrent jobs) | PTF - Updates Success - 1 | DNR | DNR | DNR |
...
Duration tenant fs09000000 | Baseline tenant fs09000000 | Duration tenant fs07000002 | Baseline tenant fs07000002 | Duration tenant fs07000001 | Baseline tenant fs07000001 | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
50K MARC Create (2 concurrent jobs) | PTF - Create 2 | - | - |
|
| ||||||||||||||||||
50K MARC Update (2 concurrent jobs) | PTF - Updates Success - 1 | - | - | ||||||||||||||||||||
| 50K MARC Create (3 concurrent jobs) | PTF - Create 2 |
| 21 min 11 s | ||||||||||||||||||||
50K MARC Update (3 concurrent jobs) | PTF - Updates Success - 1 | DNR | 20 min 57 s |
...
Is related to
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
...
Infrastructure
PTF -environment ncp3
- 9 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
- 2 instances of db.r6.xlarge database instances, one reader, and one writer
- MSK ptf-kakfa-3
- 4 m5.2xlarge brokers in 2 zones
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3
...