Jira Legacy

currents software configuration

required

Modules:

Module	previous version	current version on lcp1
Data Import Module	mod-data-import-2.3.0-SNAPSHOT.224	mod-data-import-2.4.1
Source Record Manager Module	mod-source-record-manager-3.3.0-SNAPSHOT.556	mod-source-record-manager-3.3.8
Source Record Storage Module	mod-source-record-storage-5.3.0-SNAPSHOT.394	mod-source-record-storage-5.3.2
Inventory Module	mod-inventory-18.1.0-SNAPSHOT.493	mod-inventory-18.1.4
Inventory Storage Module	mod-inventory-storage-23.0.0-SNAPSHOT.657	mod-inventory-storage-23.0.2
Invoice business logic module	mod-invoice-5.3.0-SNAPSHOT.284	mod-invoice-5.3.0

...

Module	CPU Initial	CPU Optimized	memory Initial	MEMORY optimized	java options (optimized, only in case other changes)	task instances #
Data Import Module	128	128	2048/1024	2048/1024		1
Source Record Manager Module	512	512	2048/1844	1440/1296	-XX:MetaspaceSize=512m -XX:MaxMetaspaceSize=512m -Xmx1292m -XX:+UseG1GC	2
Source Record Storage Module	128	512	1440/1296	1440/1296	-XX:MetaspaceSize=384m -XX:MaxMetaspaceSize=384m -Xmx908m -XX:+UseG1GC	2
Inventory Module	512	512	2048/1844	2880/2592	-XX:MetaspaceSize=182m -XX:MaxMetaspaceSize=182m -Xmx1814m -XX:+UseG1GC	2
Inventory Storage Module	512	512	864/778	846/778		2
Invoice business logic module	128	128	1024/800	1024/800		2
mod-data-import-converter-storage	128	512	512/460	512/460		2
okapi

...

additional tests (*) - added CPU UNITS for module data-import-CS from 128 to 512

(**) - cleaned tables DI (deleted records from 03 marth 2022)

file	profile	duration	duration from Folijet - Lotus Snapshot Performance testing (for comparison)	Data Import Test report (Lotus)	duration with revert configuration just before 2022-04-26
5K	PTF - Create 2 2	04 min 04 sec	~8 min	3 min 54 s	05 min 44 sec
5K	Updates Success - 1	05 min 26 sec	~13 min	4 min 12 s
10K	PTF - Create 2	07 min 00 sec (8 mins) 00:09:55.36	~ 19 min	6 min 45 s
10K	Updates Success - 1	11 min 46 sec	~ 25 min	8 min 4 s
25K	PTF - Create 2	25 min 48 sec *(19:49.063) (17:33.521)	~ 45 min	16 min 8s	38 min 34 sec
25K	Updates Success - 1	29 min 08 sec	~ 1h 31min	19 min 50s
50K	PTF - Create 2	FAILED
50K	PTF - Create 2	40 min 00 (41 min)	~ 1h 34min	32 min 28 s

mod-data-import-converter-storage we see too much CPU usage

50K DI charts

...

After cpu units after it was increased to 512 for mod-data-import-converter-storage maximum usage CPU

25 k with one partition and previous configuration of DI modules

...

aws ecs describe-task-definition --task-definition lcp1-mod-source-record-manager:11 | grep -E 'image|registeredAt'

if return to date 2022-03-14

module	date	version	last version	task definition	revert version needed
lcp1-mod-data-import	2022-04-01T19:29:54.136000+00:00	2.4.1	2.4.1	4	no
lcp1-mod-source-record-manager	2022-03-14T19:32:23.969000+00:00	3.3.0	3.3.8	4	yes
lcp1-mod-source-record-storage	2022-03-14T19:24:36.768000+00:00	5.3.0	5.3.2	4	yes
lcp1-mod-inventory	2022-03-14T19:24:58.524000+00:00	18.1.0	18.1.4	4	yes
lcp1-mod-inventory-storage	022-03-14T19:22:38.645000+00:00	23.0.0	23.0.2	4	yes
lcp1-mod-invoice	2022-03-14T19:34:23.683000+00:00	5.3.0	5.3.0	3	yes
lcp1-mod-data-import-converter-storage	2022-03-14T19:32:04.647000+00:00	1.13.0	1.13.2	3	yes
lcp1-okapi-b	2022-03-14T19:13:09.338000+00:00	4.13.0	4.13.2	6	yes

if return to date just before 2022-04-26

module	date	version	last version	task definition	revert version needed
lcp1-mod-data-import	2022-04-01T19:29:54.136000+00:00	2.4.1	2.4.1	4	no
lcp1-mod-source-record-manager	2022-04-08T15:56:54.536000+00:00	3.3.8	3.3.8	9	no
lcp1-mod-source-record-storage	2022-04-06T14:21:41.597000+00:00	5.3.2	5.3.2	6	no
lcp1-mod-inventory	2022-04-25T22:11:30.088000+00:00	18.1.4	18.1.4	8	no
lcp1-mod-inventory-storage	2022-04-01T19:29:16.220000+00:00	23.0.2	23.0.2	5	no
lcp1-mod-invoice	2022-03-14T19:34:23.683000+00:00	5.3.0	5.3.0	3	no
lcp1-mod-data-import-converter-storage	2022-04-01T19:30:26.221000+00:00	1.13.2	1.13.2	4	no
lcp1-okapi-b	2022-03-30T13:40:17.077000+00:00	4.13.0	4.13.2	7	yes

...