Overview

The purpose of the document is getting results of testing Data Import Create MARC holdings records and to detect performance trends in Quesnelia in scope of ticket PERF-833 - Getting issue details... STATUS

Compared with results in previous test report: Data Import Create MARC holdings records [non-ECS] [Poppy]

Summary

Data import create holdings jobs perform faster in Quesnelia release about 40% in Average comparing with Poppy.
Number of associated holdings to one instance in files used in tests do not affect duration of data import in non-ECS environments.
Top CPU utilization: mod-inventory-b - 73%, nginx-okapi - 65%, mod-quick-marc-b - 57%, mod-source-record-storage-b - 35%
Top Memory consumption:
- Set #1: mod-inventory-storage-b - 87%, mod-inventory-b - 72%, mod-data-import-b - 59%, Spikes for mod-inventory-storage-b were observed and after tests finished it returned into "before tests" state.
- Set #2: mod-inventory-storage-b - 24%, mod-inventory-b - 56%, mod-data-import-b - 58%, mod-users-b - 53%. During
RDS CPU utilization was on level 95% for all DI tests except of test with 1k file.
RDS DB connections were 860

Recommendations & Jiras

Investigate memory growing trend for mod-inventory-storage in tests set #1 (using 1 instance HRID to create all Holdings).

Test Runs

Profile used for testing - Default - Create Holdings and SRS MARC Holdings

Set of tests №	Scenario	Test Conditions
1	DI Holdings Create (previous* approach)	1K, 5K, 10K, 80K sequentially
2	DI Holdings Create (new** approach)	1K, 5K, 10K, 80K sequentially

*previous approach - Data import Holdings with mrc file where 1 instance HRID is associated to all holdings (1k, 5k, 10k, 80k)

**new approach - Data import Holdings with mrc file where 1 instance HRID is associated to 1000 holdings

Test Results

Set 1 - Files used to test DI create Holdings had 1 instance HRID for all created Holdings

Set 2 - Files used to test DI create Holdings had 1 unique instance HRID for every 1000 created Holdings (new approach)

Test	Number of records in File	Duration: Quesnelia [non-ECS] Set #1	Duration: Quesnelia [non-ECS] Set #2	Status and Errors Quesnelia [non-ECS] Set #1, Set #2
1	1k	19 sec	25 sec	Success
2	5k	1 min 17 sec	1 min 24 sec	Success
3	10k	2 min 32 sec	2 min 40 sec	Success
4	80k	19 min 54 sec	21 min 44 sec	Success

Comparison

Test	Number of records in File	Duration: Poppy [non-ECS]	Duration: Quesnelia [non-ECS] Set #1	Delta, sec	%, Delta/Poppy Duration
1	1k	32 sec	19 sec	13 sec	40.63%
2	5k	2 min 14 sec	1 min 17 sec	57 sec	42.54%
3	10k	4 min 35 sec	2 min 32 sec	2 min 3 sec	44.73%
4	80k	36 min 25 sec	19 min 54 sec	16 min 31 sec	45.35%

Compared with results in previous test report: Data Import Create MARC holdings records [non-ECS] [Poppy]

Service CPU Utilization

CPU utilization, 1k, 5k, 10k, 80k

Set #1

Module	CPU (1k)	CPU (5k)	CPU (10k)	CPU (80k)
mod-inventory-b	18.91	71.08	72.14	72.96
nginx-okapi	12.24	55.4	58.95	64.91
mod-quick-marc-b	10.59	59.87	56.42	56.6
mod-source-record-storage-b	8.59	26.46	28.82	34.64
mod-permissions-b	6.87	2.69	2.71	2.91
okapi-b	6.55	39.77	39.77	42.23
mod-users-b	6.39	6.33	7.81	6.58
mod-pubsub-b	6.06	6.55	6.58	6.6
mod-authtoken-b	5.38	6.59	4.5	5.74
mod-inventory-storage-b	5.23	25.21	26.5	31.8
mod-di-converter-storage-b	5.03	17.64	18.01	22.73
mod-source-record-manager-b	4.14	19.18	21.4	25.49
mod-data-import-b	3.78	4.91	3.36	1.46
mod-password-validator-b	2.24	2.37	2.61	2.36
mod-configuration-b	2.14	2.14	2.65	2.27
mod-feesfines-b	1.98	2.14	2.13	2.14
mod-circulation-storage-b	0.56	0.58	0.78	0.6
mod-circulation-b	0.33	0.34	0.36	0.35
pub-okapi	0.16	0.1	0.16	0.13

Set #2

Module	CPU (1k)	CPU (5k)	CPU (10k)	CPU (80k)
mod-quick-marc-b	37.33	157.35	56.36	51.23
mod-inventory-b	28.33	82.48	85.27	66.23
okapi-b	7.84	36.81	40.03	39.22
mod-pubsub-b	6.08	6.54	6.61	6.55
mod-source-record-manager-b	5.92	23.4	21.93	23.38
mod-users-b	5.85	6.19	6.42	6.29
nginx-okapi	5.31	47.85	58.87	61.95
mod-source-record-storage-b	4.9	29.43	32.35	29.6
mod-di-converter-storage-b	4.53	26.61	34.96	22.05
mod-inventory-storage-b	3.38	29.42	30.18	32.14
mod-configuration-b	2.2	2.19	2.4	2.28
mod-password-validator-b	2.15	2.2	2.6	2.46
mod-feesfines-b	1.98	4.03	2.24	2.14
mod-permissions-b	1.97	2.75	4.27	2.68
mod-data-import-b	1.24	2.77	1.92	1.45
mod-authtoken-b	1.12	4.93	4.18	6.69
mod-circulation-storage-b	0.58	0.6	0.73	0.62
mod-circulation-b	0.47	0.35	0.42	0.33
pub-okapi	0.12	0.12	0.12	0.11

Memory Utilization

Memory consumption

Set #1

Module	Memory
mod-inventory-storage-b	87.22
mod-inventory-b	71.95
mod-data-import-b	59.06
mod-permissions-b	56.06
mod-source-record-manager-b	54.96
mod-users-b	52.87
okapi-b	50.51
mod-quick-marc-b	47.25
mod-di-converter-storage-b	46.32
mod-configuration-b	41.39
mod-feesfines-b	39.85
mod-pubsub-b	34.04
mod-source-record-storage-b	32.92
mod-authtoken-b	26.48
mod-circulation-storage-b	21.33
mod-circulation-b	16.13
nginx-okapi	4.85
pub-okapi	4.69

Set #2

Module	Memory
mod-data-import-b	57.93
mod-inventory-b	56.19
mod-permissions-b	55.98
mod-users-b	52.79
okapi-b	50.56
mod-source-record-manager-b	49.19
mod-quick-marc-b	47.33
mod-di-converter-storage-b	45.76
mod-configuration-b	41.56
mod-feesfines-b	39.88
mod-source-record-storage-b	38.79
mod-pubsub-b	33.96
mod-authtoken-b	26.21
mod-inventory-storage-b	23.8
mod-circulation-storage-b	21.24
mod-circulation-b	16.05
nginx-okapi	4.8
pub-okapi	4.69