Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel6
outlinefalse
styledefault
typelist
printabletrue

...

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyPERF-964

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyMSEARCH-932

[ A brief introduction about the content of the page:

...

Test #

Data-import test

Profile

Duration

Ramsons

(rcon)

Duration

Quesnelia (qcon)

Duration

Quesnelia (qcp1)

Results

10k MARC BIB Create

PTF - Create 2

5 min 10 s

4 min 14 sec

6 minutes

Completed

25k MARC BIB Create

PTF - Create 2

10 min 30 s

9 min 41 sec

13 min 41 sec

Completed 

50k MARC BIB Create

PTF - Create 2

15 min 43 s

18 min 18 sec

21 min 59 sec

Completed 

100k MARC BIB Create

PTF - Create 2

31 min 51 s

38 min 36 sec

40 min 16 sec

Completed

500k MARC BIB Create

PTF - Create 2

2 hr 37 min

3 hours 30 min

3 hours 27 min

Completed

11

10k MARC BIB Update

PTF - Updates Success - 6

7 min 10 s

5 min 59 sec

10 min 27 sec

Completed

12

25k MARC BIB Update

PTF - Updates Success - 6

19 min 3 s

19 min 52 sec

23 min 16 sec

Completed

13

50k MARC BIB Update

PTF - Updates Success - 6

38 min 53 sec

37 min 53 sec

40 min 52 sec

Completed

14

100k MARC BIB Update

PTF - Updates Success - 6

1 hr 23 min

1 hrs 14 min

1 hrs 2 min

Completed

15

500k MARC BIB Update

PTF - Updates Success - 6

6 hrs 39 min

5 hrs 31 min

Completed

Memory Utilization

Memory usage for both sets of tests (Creates and Updates) showing stable trend. Memory of all modules returned to normal state after tests finished. No memory leak suspects observed.

...

CPU Utilization 

image-20250120-095503.png

image-20250120-095642.png

RDS CPU Utilization 

[Description of notable observations of reader and writer instances CPU utilization with screenshots and tables, RDS Database connections, and other Database metrics]

Database CPU was stable for Database CPU was stable for 10 K 205K 50 K 100 K and 500,000 records

...

Open search CPU utilisation didn’t exceeds 30% on both data and master nodes, showing stable trend.

CPU usage data nodes

...

CPU usage master node

...

MSK service

MSK service showed stable trend. Max CPU usage during tests was ±60% on one of brokers.

Disk usage on all brokers didn’t exceed 10%. (300GB of memory is allocated per broker).

...

image-20250120-111517.png

Additional information from module and database logs

image-20250120-103039.pngImage Removed

Discussion (Optional)

[ This section gives more space to elaborate on any observations and results.  See Perform Lookups By Concatenating UUIDs (Goldenrod)#Discussions for example. Anything that was discussed at length at the DSUs are worthy to be included here]

Errors

This section should detail any errors encountered during the testing process, their impact on testing outcomes, and the steps taken to address these issuesDeadlocks observed on DB side during creates and updates data import. These deadlock is not affecting functionality of DI itself and runtime indexing functionality too as mod-search handling deadlocks on back-end side. (Deadlocks happening during runtime reindexing when mod-search working with DB). Ticket created

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyMSEARCH-932

...

Errors

No critical errors observed during data import (Creates and Updates).

The only issue observed during 500K create import. 8 records failed to create due to data in file corruption.

Appendix

Infrastructure

PTF -environment rcon

...