Jira Legacy | ||||||
---|---|---|---|---|---|---|
|
currents software configuration
required
Modules:
Module | previous version | current version on lcp1 |
---|---|---|
Data Import Module | mod-data-import-2.3.0-SNAPSHOT.224 | mod-data-import-2.4.1 |
Source Record Manager Module | mod-source-record-manager-3.3.0-SNAPSHOT.556 | mod-source-record-manager-3.3.8 |
Source Record Storage Module | mod-source-record-storage-5.3.0-SNAPSHOT.394 | mod-source-record-storage-5.3.2 |
Inventory Module | mod-inventory-18.1.0-SNAPSHOT.493 | mod-inventory-18.1.4 |
Inventory Storage Module | mod-inventory-storage-23.0.0-SNAPSHOT.657 | mod-inventory-storage-23.0.2 |
Invoice business logic module | mod-invoice-5.3.0-SNAPSHOT.284 | mod-invoice-5.3.0 |
...
Module | CPU Initial | CPU Optimized | memory Initial | MEMORY optimized | java options (optimized, only in case other changes) | task instances # |
---|---|---|---|---|---|---|
Data Import Module | 128 | 128 | 2048/1024 | 2048/1024 | 1 | |
Source Record Manager Module | 512 | 512 | 2048/1844 | 1440/1296 | -XX:MetaspaceSize=512m -XX:MaxMetaspaceSize=512m -Xmx1292m -XX:+UseG1GC | 2 |
Source Record Storage Module | 128 | 512 | 1440/1296 | 1440/1296 | -XX:MetaspaceSize=384m -XX:MaxMetaspaceSize=384m -Xmx908m -XX:+UseG1GC | 2 |
Inventory Module | 512 | 512 | 2048/1844 | 2880/2592 | -XX:MetaspaceSize=182m -XX:MaxMetaspaceSize=182m -Xmx1814m -XX:+UseG1GC | 2 |
Inventory Storage Module | 512 | 512 | 864/778 | 846/778 | 2 | |
Invoice business logic module | 128 | 128 | 1024/800 | 1024/800 | 2 | |
mod-data-import-converter-storage | 128 | 512 | 512/460 | 512/460 | 2 | |
okapi |
kafka topics related to di - number of partitions raised to 2
...
additional tests (*) - added CPU UNITS for module data-import-CS from 128 to 512
(**) - cleaned tables DI (deleted records from 03 marth 2022)
file | profile | duration | duration from Folijet - Lotus Snapshot Performance testing (for comparison) | Data Import Test report (Lotus) |
---|---|---|---|---|
5K | PTF - Create 2 2 | 04 min 04 sec | ~8 min | 3 min 54 s |
5K | Updates Success - 1 | 05 min 26 sec | ~13 min | 4 min 12 s |
10K | PTF - Create 2 | 07 min 00 sec (8 mins) 00:09:55.36 | ~ 19 min | 6 min 45 s |
10K | Updates Success - 1 | 11 min 46 sec | ~ 25 min | 8 min 4 s |
25K | PTF - Create 2 | 25 min 48 sec (19:49.063*) (17:33.521**) | ~ 45 min | 16 min 8s |
25K | Updates Success - 1 | 29 min 08 sec | ~ 1h 31min | 19 min 50s |
50K | PTF - Create 2 | FAILED | ||
50K | PTF - Create 2 | 40 min 00 (41 min) | ~ 1h 34min | 32 min 28 s |
5K create charts
mod-data-import-converter-storage we see too much CPU usage
5K update charts
50K DI charts
...
After cpu units after it was increased to 512 for mod-data-import-converter-storage maximum usage CPU
25 k with one partition and previous configuration of DI modules
...
module | date | vesion | last version | task definition |
---|---|---|---|---|
lcp1-mod-data-import | 2022-04-01T19:29:54.136000+00:00 | 2.4.1 | 2.4.1 | 4 |
lcp1-mod-source-record-manager | 2022-03-14T19:32:23.969000+00:00 | 3.3.0 | 3.3.8 | 4 |
lcp1-mod-source-record-storage:4 | 2022-03-14T19:24:36.768000+00:00 | 5.3.0 | 5.3.2 | 4 |
lcp1-mod-inventory | 2022-03-14T19:24:58.524000+00:00 | 18.1.0 | 18.1.4 | 4 |
lcp1-mod-inventory-storage | 022-03-14T19:22:38.645000+00:00 | 23.0.0 | 23.0.2 | 4 |
lcp1-mod-invoice | 2022-03-14T19:34:23.683000+00:00 | 5.3.0 | 5.3.0 | 3 |