Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
stylenone

...

  • All tests passed successfully.

  • With disabled Visible significant improvements on mod-search all DI durations (for creates and updates) are the same in overal as in Q release.

  • With enabled mod-search there’s a big performance degradation for creates and updates (50-100%). It’s happening because of long running query from mod search side that causing significant load on DB and slowing overall process down. (this query is part of runtime reindexing process for contributor)

  • On mod-search schema side deadlocks observed side (in Ramsons long running query caused performance degradation 50-100%). Now duration of data imports is faster for creates and more or les the same for updates.

  • On mod-search schema side deadlocks observed during data import creates and updates, however deadlocks does not affect completion of DI.

...

  • mod-search deadlocks ticket

    Jira Legacy
    serverSystem Jira
    serverId01505d01-b853-3c2e-90f1-ee9b165564fc
    keyMSEARCH-932

  • mod-search slow query affecting DI performance

    Jira Legacy
    serverSystem Jira
    serverId01505d01-b853-3c2e-90f1-ee9b165564fc
    keyMSEARCH-972

  • Possibly related ticket for mod-search

    Jira Legacy
    serverSystem Jira
    serverId01505d01-b853-3c2e-90f1-ee9b165564fc
    keyMSEARCH-924

  • possible DB load improvements

    Jira Legacy
    serverSystem Jira
    serverId01505d01-b853-3c2e-90f1-ee9b165564fc
    keyMODDATAIMP-1177

Results

Test #

Data-import test

Profile

Duration

Sunflower

(secp1)

Duration

Ramsons (rcp1)

mod-search enabled

Duration

Quesnelia (qcp1)

Status

1

5k MARC BIB Create

PTF - Create 2

2 min 4 s

3 min 7 s

-

Completed

 

10k MARC BIB Create

PTF - Create 2

4 min 43 s

6 min 15 s

6 minutes

Completed

2

25k MARC BIB Create

PTF - Create 2

10 min

17 min

13 min 41 sec

Completed 

3

50k MARC BIB Create

PTF - Create 2

21 min

41 min 25 s

21 min 59 sec

Completed 

4

100k MARC BIB Create

PTF - Create 2

42 min 46 s

1 hr 19 min

40 min 16 sec

Completed

 

5k MARC BIB Update

PTF - Updates Success - 6

6 min 18 s

6 min 33 s

-

Completed

6

10k MARC BIB Update

PTF - Updates Success - 6

6 min 4 s

11 min 14 s

10 min 27 sec

Completed

7

25k MARC BIB Update

PTF - Updates Success - 6

31 min

28 min 43 s

23 min 16 sec

Completed

8

50k MARC BIB Update

PTF - Updates Success - 6

1 hr 8 min

58 min 30 s

40 min 52 sec

Completed

9

100k MARC BIB Update

PTF - Updates Success - 6

2 hr 5 min

2 hr 14 min

1 hrs 2 min

Completed

Memory Utilization

Memory utilization showed stable trend during DI creates and updates tests. No sudden crashes or unexpected growth of memory usage were observed.

...