Multiple tenant Data Import test report (Nolana)
- Olga Kondratenko
- Martin Tran
IN PROGRESS
Overview
This document contains the results of testing Data Import for MARC Bibliographic records in the Nolana release to detect performance trends for multiple concurrent jobs. PERF-387 - Getting issue details... STATUS
Summary
- For all tenants, we can observe different data import duration: for example, 50k MARC BIB Create tenant fs09000000 - 21min, tenant fs07000001 - 34 min, and tenant fs07000002 - 42 min. PERF-414 - Getting issue details... STATUS
- Data import is not able to work on multiple tenants: When data import starts on the second tenant, both jobs are stuck. Data Import becomes unavailable for several hours. PERF-415 - Getting issue details... STATUS Could be related to PERF-388 - Getting issue details... STATUS
Results
Baseline tests
Duration tenant fs09000000 | Duration tenant fs07000002 | Duration tenant fs07000001 | ||
|---|---|---|---|---|
| 1K MARC Create | PTF - Create 2 | 40 s | 1 min 19 s | 55 s |
1K MARC Update | PTF - Updates Success - 1 | 35 s | 1 min 24 s | 1 min |
| 2K MARC Create | PTF - Create 2 | 56 s | 2 min 15 s | 1 min 37 s |
| 2K MARC Update | PTF - Updates Success - 1 | 58 s | 2 min 6 s | 1 min 44 s |
5K MARC Create | PTF - Create 2 | 2m 8 s | 5 min 19 s | 4 min 14 s |
| 5K MARC Update | PTF - Updates Success - 1 | 2 min 10 s | 5 min | 3 min 47 s |
10K MARC Create | PTF - Create 2 | 4 min 20 s | 10 min 3 s | 7 min 20 s |
| 10K MARC Update | PTF - Updates Success - 1 | 4 min 8 s | 8 min 43 s | 8 min 8 s |
| 25K MARC Create | PTF - Create 2 | 10 min 41 s | 23 min 3 s | 17m 43 s |
| 25K MARC Update | PTF - Updates Success - 1 | 10 min 40 s | 20 min 47 s | 17 min 56 s |
| 50K MARC Create | PTF - Create 2 | 21 min 11 s | 42 min 28 s | 34min 40 s |
50K MARC Update | PTF - Updates Success - 1 | 20 min 57 s | 40 min 20 s | 35 min 24 s |
| 100K MARC Create | PTF - Create 2 | 42 min 35 s | 1 hour 29 min | 1 hour 20 min |
100K MARC Update | PTF - Updates Success - 1 | 41 min 56 s | 1 hour 27 min | 1 hour 20 min |
| 500K MARC Create | PTF - Create 2 | - | - | - |
- 500K MARC Create import failed due to 500K records file corruption.
Multiple tenant tests
Duration tenant fs09000000 | Duration tenant fs07000002 | Duration tenant fs07000001 | ||
|---|---|---|---|---|
50K MARC Create (2 concurrent jobs) | PTF - Create 2 | - | PERF-415 - Getting issue details... STATUS | PERF-415 - Getting issue details... STATUS |
50K MARC Update (2 concurrent jobs) | PTF - Updates Success - 1 | - | DNR | DNR |
| 50K MARC Create (3 concurrent jobs) | PTF - Create 2 | DNR | DNR | DNR |
50K MARC Update (3 concurrent jobs) | PTF - Updates Success - 1 | DNR | DNR | DNR |
Comparison Multiple tenant tests to baseline
Duration tenant fs09000000 | Baseline tenant fs09000000 | Duration tenant fs07000002 | Baseline tenant fs07000002 | Duration tenant fs07000001 | Baseline tenant fs07000001 | ||
|---|---|---|---|---|---|---|---|
50K MARC Create (2 concurrent jobs) | PTF - Create 2 | - | - | PERF-415 - Getting issue details... STATUS | PERF-415 - Getting issue details... STATUS | ||
50K MARC Update (2 concurrent jobs) | PTF - Updates Success - 1 | - | - | ||||
| 50K MARC Create (3 concurrent jobs) | PTF - Create 2 | PERF-415 - Getting issue details... STATUS | 21 min 11 s | ||||
50K MARC Update (3 concurrent jobs) | PTF - Updates Success - 1 | DNR |