Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
stylenone

...

  • mod-search deadlocks ticket

    Jira Legacy
    serverSystem Jira
    serverId01505d01-b853-3c2e-90f1-ee9b165564fc
    keyMSEARCH-932

Results

Duration

...

Duration

Quesnelia (qcp1)

Results

Test #

Data-import test

Profile

Duration

Ramsons

rcp1

Duration

Ramsons

(rcon)

Duration

Quesnelia (qcp1)

Duration

Quesnelia (qcon)

Results

1

10k MARC BIB Create

PTF - Create 2

5 min 33 s

5 min 10 s

6 minutes

4 min 14 sec

Completed

2

25k MARC BIB Create

PTF - Create 2

14 min 16s

10 min 30 s

13 min 41 sec

9 min 41 sec

Completed 

3

50k MARC BIB Create

PTF - Create 2

28 min 23 s

15 min 43 s

21 min 59 sec

18 min 18 sec

Completed 

4

100k MARC BIB Create

PTF - Create 2

29 min 3 s

31 min 51 s

40 min 16 sec

38 min 36 sec

Completed

5

500k MARC BIB Create

PTF - Create 2

not tested

2 hr 37 min

3 hours 27 min

3 hours 30 min

Completed

6

10k MARC BIB Update

PTF - Updates Success - 6

15 min

7 min 10 s

10 min 27 sec

5 min 59 sec

Completed

7

25k MARC BIB Update

PTF - Updates Success - 6

34 min 41s

19 min 3 s

23 min 16 sec

19 min 52 sec

Completed

8

50k MARC BIB Update

PTF - Updates Success - 6

1 hr 10 min

38 min 53 sec

40 min 52 sec

37 min 53 sec

Completed

9

100k MARC BIB Update

PTF - Updates Success - 6

2 hr 27 min

1 hr 23 min

1 hrs 2 min

1 hrs 14 min

Completed

10

500k MARC BIB Update

PTF - Updates Success - 6

not tested

 not tested

5 hrs 31 min

6 hrs 39 min

Completed

Memory Utilization

Memory utilisation showed stable trend during DI creates and updates tests. No sudden crashes or unexpected growth of memory usage were observed.

...

Memory usage for set of MARC BIB updates

...

CPU Utilization

image-20250122-095136.png

image-20250122-095314.png

image-20250122-095751.png

Dataset Size:

Record type

Number of records

Instances

30 243 010

Holdings

30 301 825

Items

31 390 568

Methodology/Approach

  1. Pre-generated files were used for DI Create job profile

    • 10K, 25K, 50K, 100K and 500K files.

  2. Run DI Create on a single tenant(cs00000int_0001) one by one with the delay with files using PTF - Create 2 profile.

  3. Prepare files for DI Update with the Data export app, using previously imported items

  4. Run DI Update on a single tenant(cs00000int_0001) one by one with the delay with prepared files using PTF - Update Success 2 profile

  • 1K, 10K, 25K, 50K, 100K and 500K files.

  1. Data-import durations were obtained from DB using SQL query

Code Block
select file_name,started_date,completed_date, completed_date - started_date as duration ,status
from cs00000int_0001_mod_source_record_manager.job_execution order by started_date desc limit 1000;