Multiple tenant Data Import test report (Nolana)

IN PROGRESS


Overview

This document contains the results of testing Data Import for MARC Bibliographic records in the Nolana release to detect performance trends for multiple concurrent jobs. PERF-387 - Getting issue details... STATUS


Summary

  • For all tenants, we can observe different data import duration: for example, 50k MARC BIB Create tenant fs09000000 - 21min, tenant fs07000001 - 34 min, and tenant fs07000002 - 42 min. PERF-414 - Getting issue details... STATUS
  • Data import is not able to work on multiple tenants: When data import starts on the second tenant, both jobs are stuck. Data Import becomes unavailable for several hours. PERF-415 - Getting issue details... STATUS Could be related to PERF-388 - Getting issue details... STATUS

Results

Baseline tests


Profile

Duration

tenant fs09000000

Duration

tenant fs07000002

Duration

tenant fs07000001

1K MARC CreatePTF - Create 240 s1 min 19 s55 s

1K MARC Update

PTF - Updates Success - 135 s1 min 24 s1 min
2K MARC CreatePTF - Create 256 s2 min 15 s1 min 37 s
2K MARC UpdatePTF - Updates Success - 158 s2 min 6 s1 min 44 s

5K MARC Create

PTF - Create 22m 8 s5 min 19 s4 min 14 s
5K MARC UpdatePTF - Updates Success - 12 min 10 s5 min3 min 47 s

10K MARC Create 

PTF - Create 24 min 20 s10 min 3 s7 min 20 s
10K MARC Update PTF - Updates Success - 14 min 8 s8 min 43 s8 min 8 s
25K MARC CreatePTF - Create 210 min 41 s23 min 3 s17m 43 s
25K MARC UpdatePTF - Updates Success - 110 min 40 s20 min 47 s17 min 56 s
50K MARC CreatePTF - Create 221 min 11 s42 min 28 s34min 40 s

50K MARC Update

PTF - Updates Success - 120 min 57 s40 min 20 s35 min 24 s
100K MARC CreatePTF - Create 242 min 35 s1 hour 29 min1 hour 20 min

100K MARC Update

PTF - Updates Success - 141 min 56 s1 hour 27 min1 hour 20 min
500K MARC CreatePTF - Create 2---
  • 500K MARC Create import failed due to 500K records file corruption. 

Multiple tenant tests


Profile

Duration

tenant fs09000000

Duration

tenant fs07000002

Duration

tenant fs07000001

50K MARC Create (2 concurrent jobs)

PTF - Create 2-

PERF-415 - Getting issue details... STATUS

PERF-415 - Getting issue details... STATUS

50K MARC Update (2 concurrent jobs)

PTF - Updates Success - 1-DNRDNR
50K MARC Create (3 concurrent jobs)PTF - Create 2DNRDNRDNR

50K MARC Update (3 concurrent jobs)

PTF - Updates Success - 1DNRDNRDNR

Comparison Multiple tenant tests to baseline


Profile

Duration

tenant fs09000000

Baseline

tenant fs09000000

Duration

tenant fs07000002

Baseline

tenant fs07000002

Duration

tenant fs07000001

Baseline

tenant fs07000001

50K MARC Create (2 concurrent jobs)

PTF - Create 2--

PERF-415 - Getting issue details... STATUS


PERF-415 - Getting issue details... STATUS


50K MARC Update (2 concurrent jobs)

PTF - Updates Success - 1--



50K MARC Create (3 concurrent jobs)PTF - Create 2

PERF-415 - Getting issue details... STATUS

21 min 11 s



50K MARC Update (3 concurrent jobs)

PTF - Updates Success - 1DNR