Versions Compared

Version Old Version 36 New Version 37
Changes made by

Iakov Zaborov

Iakov Zaborov

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

 

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyPERF-232
 

currents software configuration


required

Modules:


Moduleprevious versioncurrent version on lcp1
Data Import Modulemod-data-import-2.3.0-SNAPSHOT.224mod-data-import-2.4.1
Source Record Manager Modulemod-source-record-manager-3.3.0-SNAPSHOT.556mod-source-record-manager-3.3.8
Source Record Storage Modulemod-source-record-storage-5.3.0-SNAPSHOT.394mod-source-record-storage-5.3.2
Inventory Modulemod-inventory-18.1.0-SNAPSHOT.493mod-inventory-18.1.4
Inventory Storage Modulemod-inventory-storage-23.0.0-SNAPSHOT.657mod-inventory-storage-23.0.2
Invoice business logic modulemod-invoice-5.3.0-SNAPSHOT.284mod-invoice-5.3.0

...

ModuleCPU Initial

CPU Optimized

memory Initial MEMORY optimizedjava options (optimized, only in case other changes)task instances #
Data Import Module

128

1282048/10242048/1024
1
Source Record Manager Module5125122048/18441440/1296-XX:MetaspaceSize=512m -XX:MaxMetaspaceSize=512m -Xmx1292m -XX:+UseG1GC2
Source Record Storage Module

128

5121440/12961440/1296 -XX:MetaspaceSize=384m -XX:MaxMetaspaceSize=384m -Xmx908m -XX:+UseG1GC2
Inventory Module5125122048/18442880/2592-XX:MetaspaceSize=182m -XX:MaxMetaspaceSize=182m -Xmx1814m -XX:+UseG1GC2
Inventory Storage Module512512864/778846/778
2
Invoice business logic module1281281024/8001024/800
2
mod-data-import-converter-storage128512512/460512/460
2
okapi






kafka topics related to di - number of partitions raised to 2

...

additional tests (*) - added CPU UNITS for module data-import-CS from 128 to 512

 (**) - cleaned tables DI (deleted records from 03 marth 2022)

fileprofileduration

duration from Folijet - Lotus Snapshot Performance testing

(for comparison)

Data Import Test report (Lotus)

5KPTF - Create 2 204 min 04 sec~8 min3 min 54 s
5KUpdates Success - 105 min 26 sec~13 min4 min 12 s
10KPTF - Create 2

07 min 00 sec (8 mins)

00:09:55.36

~ 19 min6 min 45 s
10KUpdates Success - 111 min 46 sec~ 25 min8 min 4 s
25KPTF - Create 2

25 min 48 sec (19:49.063*)

(17:33.521**)

~ 45 min16 min 8s
25KUpdates Success - 129 min 08 sec~ 1h 31min19 min 50s
50KPTF - Create 2FAILED

50KPTF - Create 240 min 00 (41 min)~ 1h 34min32 min 28 s

5K create charts

mod-data-import-converter-storage we see too much CPU usage

5K update charts


50K DI charts

...

After cpu units after it was increased to 512 for mod-data-import-converter-storage maximum usage CPU 


25 k with one partition and previous configuration of DI modules

...

moduledatevesionlast versiontask definition
lcp1-mod-data-import2022-04-01T19:29:54.136000+00:002.4.12.4.14
lcp1-mod-source-record-manager2022-03-14T19:32:23.969000+00:003.3.03.3.84
lcp1-mod-source-record-storage2022-03-14T19:24:36.768000+00:005.3.05.3.24
lcp1-mod-inventory2022-03-14T19:24:58.524000+00:0018.1.018.1.44
lcp1-mod-inventory-storage022-03-14T19:22:38.645000+00:0023.0.023.0.24
lcp1-mod-invoice2022-03-14T19:34:23.683000+00:005.3.05.3.03
lcp1-mod-data-import-converter-storage2022-03-14T19:32:04.647000+00:001.13.01.13.23
lcp1-okapi-b2022-03-14T19:13:09.338000+00:004.13.04.13.26