| Table of Contents |
|---|
...
- Multiple tenants will communicate (produce and consume messages) with only one topic with keyword "ALL" instead of separate topics with tenantId
In scope of PERF-684 and PERF-713 - PTF team decided to run several experiments on Data Import using shared kafka topic approach
...
| Test # | fileSize | comment | DI Duration/tenant | ||
|---|---|---|---|---|---|
| fs09.... | fs07...01 | fs07...02 | |||
| 1 | 25K | no shared topics | 13 min 49 s | 28 min 3 s | 21 min 48 s |
| 2 | 25K | no shared topics | 14 min 47 s | 26 min 47 s | 21 min 43 s |
| 3 | 25K | with shared topics | 23 min 59 s | 22 min 7 s | 17 min 17 s |
| 4 | 25K | with shared topics | 18 min 10 s | 20 min 31 s | 18 min 38 s |
| 5 | 50K | with shared topics | 30 min 3 s | 35 min 6 s | 40 min 9 s (error) |
| 6 | 100K | with shared topics | stuck on 99%* | 1 hr 24 min | 1 hr 43min (error) * |
| 7 | CICO 20 users + DI 25K on 3 tenants | no shared topics | completed with errors 27 min.* | 50 min | 41 min |
| 8 | CICO 20 users + DI 25K on 3 tenants | with shared topics | 39 min | 41 min | 37 min |
DI ERRORS. in all cases of error during Data Import - the error is io.netty.channel.StacklessClosedChannelException
Test 7,8 CICO
| no shared topic(#7) | with shared topic(#8) | |||
| before DI | during DI | before | during DI | |
| Check In | 0,432s | 1,21s | 0,494s | 1,641s |
| Check Out | 0,824s | 2,355s | 1,029s | 2,702s |
...
PTF -environment pcp1
Release - Poppy.
- 10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 database instance, writer db.r6g.xlarge
- MSK tenant
- 4 m5.2xlarge brokers in 2 zones
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3
- Open Search fse-ptf cluster
- instance type r6g.large.search
- Data nodes -4
- Master nodes -3
- EBS size 500 GiB
Modules version:
| Module pcp1-pvt Thu Oct 26 10:24:30 UTC 2023 | Task Def. Revision | Module Version | Task Count | Mem Hard Limit | Mem Soft limit | CPU units | Xmx | MetaspaceSize | MaxMetaspaceSize | R/W split enabled |
|---|---|---|---|---|---|---|---|---|---|---|
| mod-inventory-storage-b | 11 | mod-inventory-storage:27.0.0 | 2 | 4096 | 3690 | 2048 | 3076 | 384 | 512 | false |
| mod-data-import-b | 15 | mod-data-import:3.0.1 | 1 | 2048 | 1844 | 256 | 1292 | 384 | 512 | false |
| mod-source-record-storage-b | 11 | mod-source-record-storage:5.7.0 | 2 | 5600 | 5000 | 2048 | 3500 | 384 | 512 | false |
| mod-inventory-b | 10 | mod-inventory:20.1.0 | 2 | 2880 | 2592 | 1024 | 1814 | 384 | 512 | false |
| mod-source-record-manager-b | 12 | mod-source-record-manager:3.7.0 | 2 | 5600 | 5000 | 2048 | 3500 | 384 | 512 | false |
| mod-di-converter-storage-b | 14 | mod-di-converter-storage:2.1.0 | 2 | 1024 | 896 | 128 | 768 | 88 | 128 | false |
| mod-circulation-storage-b | 10 | mod-circulation-storage:17.1.0 | 2 | 2880 | 2592 | 1536 | 1814 | 384 | 512 | false |
| mod-pubsub-b | 9 | mod-pubsub:2.11.0 | 2 | 1536 | 1440 | 1024 | 922 | 384 | 512 | false |
| mod-circulation-b | 10 | mod-circulation:24.0.0 | 2 | 2880 | 2592 | 1536 | 1814 | 384 | 512 | false |
...