You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 2
Next »
Overview IN PROGRESSThe purpose of the document is getting results of testing Data Import Create MARC holdings records and to detect performance trends in Quesnelia in scope of ticket
PERF-855
-
Getting issue details...
STATUS
Compared with results in previous test report: Data Import Create MARC holdings records [Poppy]
Summary
Recommendations & Jiras
Test Results
Profile used for testing - Default - Create Holdings and SRS MARC Holdings
Set 1 - Files used to test DI create Holdings had 1 instance HRID for all created Holdings
Test | File | Duration: Orchid (previous results) | Duration: Poppy (previous results) | Duration: Quesnelia |
|---|
| 1 | 1k | 45s | 32s |
|
| 2 | 5k | 7m 47s | 2m 14s |
|
| 3 | 10k | 19m 46s | 4m 35s |
|
| 4 | 80k | 20m (error*) | 36m 25s |
|
Set 2 - Files used to test DI create Holdings had 1 unique instance HRID for every 1000 created Holdings (new approach)
Test | File | Duration: Orchid (previous results) | Duration: Poppy (previous results) | Duration: Quesnelia |
|---|
| 1 | 1k | 45s | 32s |
|
| 2 | 5k | 7m 47s | 2m 14s |
|
| 3 | 10k | 19m 46s | 4m 35s |
|
| 4 | 80k | 20m (error*) | 36m 25s |
|
Comparison
Table contains comparison between Quesnelia and Poppy
Test | File | Duration: Poppy | Duration: Quesnelia | Difference absolute | Difference percentage |
|---|
| 1 | 1k | 32s |
|
|
|
| 2 | 5k | 2m 14s |
|
|
|
| 3 | 10k | 4m 35s |
|
|
|
| 4 | 80k | 36m 25s |
|
|
|
Service CPU Utilization
CPU utilization, 1k, 5k, 10k, 80k
Set #1
| Module | CPU (1k) | CPU (5k) | CPU (10k) | CPU (80k) |
|---|
| mod-inventory-b | 20.23 | 24.03 | 20.5 | 16.34 |
| mod-di-converter-storage-b | 12.3 | 13.51 | 6.21 | 3.94 |
| nginx-okapi | 10.67 | 13.07 | 10.37 | 5.13 |
| mod-inventory-storage-b | 9.93 | 14.49 | 12.87 | 10.95 |
| mod-quick-marc-b | 8.24 | 7.34 | 7.95 | 6.82 |
| mod-source-record-storage-b | 7.99 | 8.42 | 6.47 | 3.79 |
| mod-users-b | 7.16 | 5.95 | 5.93 | 6.58 |
| okapi-b | 6.76 | 7.8 | 6.15 | 3.75 |
| mod-pubsub-b | 5.69 | 5.73 | 5.78 | 5.69 |
| mod-data-import-b | 5.15 | 1.27 | 1.6 | 1.23 |
| mod-source-record-manager-b | 3.7 | 4.55 | 4.01 | 3.06 |
| mod-authtoken-b | 3.69 | 1.26 | 1.46 | 0.99 |
| mod-password-validator-b | 2.36 | 2.34 | 2.34 | 3.33 |
| mod-feesfines-b | 2.34 | 2.12 | 2.2 | 2.16 |
| mod-configuration-b | 2.22 | 2.08 | 1.98 | 2.71 |
| mod-permissions-b | 1.66 | 0.8 | 1.11 | 0.94 |
| mod-circulation-storage-b | 0.61 | 0.61 | 0.61 | 0.68 |
| mod-circulation-b | 0.36 | 0.39 | 0.33 | 0.4 |
| pub-okapi | 0.19 | 0.13 | 0.13 | 0.13 |
Set #2
| Module | CPU (1k) | CPU (5k) | CPU (10k) | CPU (80k) |
|---|
| mod-inventory-b | 11.93 | 28.85 | 32.97 | 33.23 |
| mod-quick-marc-b | 7.19 | 8.1 | 8.19 | 7.64 |
| mod-pubsub-b | 6.2 | 6.56 | 6.72 | 6.55 |
| mod-users-b | 5.79 | 6.47 | 6.09 | 6.82 |
| mod-configuration-b | 3.12 | 3.21 | 3.47 | 3.4 |
| mod-feesfines-b | 2.39 | 2.47 | 2.55 | 2.34 |
| mod-password-validator-b | 2.26 | 2.4 | 3.27 | 2.41 |
| mod-di-converter-storage-b | 1.95 | 10.22 | 9.39 | 8.98 |
| mod-source-record-storage-b | 1.79 | 11.45 | 11.64 | 10.84 |
| mod-source-record-manager-b | 1.65 | 6.44 | 6.42 | 5.87 |
| mod-data-import-b | 1.36 | 1.48 | 1.83 | 1.48 |
| okapi-b | 1.28 | 13.81 | 14 | 14.93 |
| mod-authtoken-b | 1.02 | 1.24 | 1.6 | 1.6 |
| mod-circulation-storage-b | 0.7 | 0.71 | 0.71 | 0.73 |
| nginx-okapi | 0.59 | 20.99 | 20.39 | 22.89 |
| mod-permissions-b | 0.48 | 4.95 | 1.65 | 1.63 |
| mod-circulation-b | 0.35 | 0.36 | 0.35 | 0.36 |
| mod-inventory-storage-b | 0.33 | 14.24 | 14.54 | 13.96 |
| pub-okapi | 0.17 | 0.24 | 0.24 | 0.23 |
Set #1: mod-inventory-b - 16%, nginx-okapi - 5%, mod-source-record-storage-b - 4%, mod-quick-marc-b - 7%
Set #2: mod-inventory-b - 33%, nginx-okapi - 23%, mod-source-record-storage-b - 11%, mod-quick-marc-b - 7%
Set #1
Set #2
Memory Utilization
Memory consumption
Set #1
| Module | Memory |
|---|
| mod-inventory-storage-b | 85.62 |
| mod-data-import-b | 51.63 |
| mod-source-record-storage-b | 44.97 |
| mod-source-record-manager-b | 42.86 |
| mod-users-b | 40.38 |
| mod-inventory-b | 39.47 |
| mod-permissions-b | 35.82 |
| okapi-b | 33.4 |
| mod-di-converter-storage-b | 33.26 |
| mod-feesfines-b | 32.37 |
| mod-quick-marc-b | 31.46 |
| mod-configuration-b | 29.41 |
| mod-pubsub-b | 25.66 |
| mod-authtoken-b | 20.55 |
| mod-circulation-storage-b | 18.93 |
| mod-circulation-b | 17.87 |
| nginx-okapi | 4.8 |
| pub-okapi | 4.8 |
Set #2
| Module | Memory |
|---|
| mod-inventory-storage-b | 56.04 |
| mod-data-import-b | 55.45 |
| mod-inventory-b | 45.63 |
| mod-source-record-manager-b | 41.19 |
| mod-users-b | 38.95 |
| mod-source-record-storage-b | 37.37 |
| mod-quick-marc-b | 33.59 |
| mod-permissions-b | 33.45 |
| okapi-b | 32.82 |
| mod-feesfines-b | 32.65 |
| mod-di-converter-storage-b | 31.91 |
| mod-configuration-b | 28.49 |
| mod-circulation-storage-b | 26.86 |
| mod-pubsub-b | 25.83 |
| mod-circulation-b | 20.14 |
| mod-authtoken-b | 19.97 |
| nginx-okapi | 4.69 |
| pub-okapi | 4.58 |
Set #1
Set #2
DB CPU Utilization
DB CPU was about 80% for all tests except of 1k - 23%.
DB Connections
DB connections number- 505
DB Load
SQL queries
Infrastructure
PTF - environment qcon
| Name | Memory GIB | vCPUs |
|---|
db.r6g.4xlarge | 128 GiB | 16 vCPUs |
- MSK ptf-mobius-testing2
- 2 m5.2xlarge brokers in 2 zones
- Apache Kafka version 2.8.0
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=2
Modules
| Module | Task Def. Revision | Module Version | Task Count | Mem Hard Limit | Mem Soft limit | CPU units | Xmx | MetaspaceSize | MaxMetaspaceSize |
|---|
| qcon-pvt |
|
|
|
|
|
|
|
|
|
| 16/06/2024 |
|
|
|
|
|
|
|
|
|
| mod-inventory-b |
|
|
|
|
|
|
|
|
|
| mod-quick-marc-b |
|
|
|
|
|
|
|
|
|
| nginx-okapi |
|
|
|
|
|
|
|
|
|
| mod-di-converter-storage-b |
|
|
|
|
|
|
|
|
|
| okapi-b |
|
|
|
|
|
|
|
|
|
| mod-source-record-storage-b |
|
|
|
|
|
|
|
|
|
| mod-source-record-manager-b |
|
|
|
|
|
|
|
|
|
| mod-inventory-storage-b |
|
|
|
|
|
|
|
|
|
| mod-pubsub-b |
|
|
|
|
|
|
|
|
|
| mod-users-b |
|
|
|
|
|
|
|
|
|
| mod-data-import-b |
|
|
|
|
|
|
|
|
|
| mod-organizations-storage-b |
|
|
|
|
|
|
|
|
|
| mod-notes-b |
|
|
|
|
|
|
|
|
|
| mod-gobi-b |
|
|
|
|
|
|
|
|
|
| mod-permissions-b |
|
|
|
|
|
|
|
|
|
| mod-search-b |
|
|
|
|
|
|
|
|
|
| mod-circulation-storage-b |
|
|
|
|
|
|
|
|
|
| mod-circulation-b |
|
|
|
|
|
|
|
|
|
| pub-okapi |
|
|
|
|
|
|
|
|
|