Workflows Using Kafka Topics with decreased number of partitions
- Hanna Tuhuzbayeva
- Martin Tran
- Olga Kondratenko
Overview
Test goal is to assess performance of CICO, data import, bulk edits, and reindexing of instsances scenarios with decreased number of partitions in Kafka topics from 10 or 50 partitions down to 2.
Topics setup can be found here.
Ticket: PERF-400 - Getting issue details... STATUS
Summary
- Load tests results comparison showed that there is no significant degradation in CICO response times with decreased number of partitions.
- Resource consumption of server, database and Kafka instances also didn't change with decreased number of partitions.
- Data Import time is also +/- 10% duration on average of baseline results.
- Bulk Edits response times are also within seconds of the baseline results.
- Reindexing is faster and consumed less CPU with 2 partitions each in all topics compared to 10 or 50 partitions in several search topics.
Test Runs
Test # | Test Conditions | Duration | Load generator size (recommended) | Load generator Memory(GiB) (recommended) | Notes |
|---|---|---|---|---|---|
1. | Checkin/Ckeckout with 8, 20, 25 users | 30 min | t3.medium | 3 |
|
| 2. | Data import with 5K, 25K, 50K, 100K Create imports | x |
Results
Check In, Check Out
Response Times (CICO)
10/50 Partitions
2 Partitions
Response time comparison CICO + DI
| Transaction | Response time, 95 percentile | Degradation, s | Degradation, % | |
|---|---|---|---|---|
| 10/50 Partitions | 2 Partitions | |||
| Check-in Controller 8us | 0.555 s | 0.576 s | 0.021 s | 4% |
| Check-out Controller 8us | 0.899 s | 0.897 s | -0.002 s | 0% |
| Check-in Controller 20us | 0.554 s | 0.592 s | 0.038 s | 7% |
| Check-out Controller 20us | 0.852 s | 0.860 s | 0.008 s | 1% |
| Check-in Controller 25us | 0.553 s | 0.589 s | 0.036 s | 7% |
| Check-out Controller 25us | 0.834 s | 0.894 s | 0.06 s | 7% |
| Data import 5K | 2m 8 s | 2m 24 s | 16 s | 13% |
| Data import 25K | 10 min 41 s | 11 min 27 s | 46 s | 7% |
| Data import 50K | 21 min 11 s | 19 min 16 s | -115 s | -9% |
| Data import 100K | 42 min 35 s | 40 min 24 s | -131 s | -5% |
Instance CPU Utilization (CICO)
10/50 Partitions
2 Partitions
Service CPU Utilization (CICO)
10/50 Partitions
2 Partitions
Memory Utilization (CICO)
10/50 Partitions
mod-inventory-storage memory usage increased from 57 to 65 during the test. This behaviour was also reproduced for the tests with 2 partitions.
2 Partitions
RDS CPU Utilization (CICO)
10/50 Partitions
2 Partitions
There is a 5% increase in CPU utilization for 25 users test, but this behaviour wasn't reproduced during retesting. It can be caused by external factors.
RDS DB connections (CICO)
10/50 Partitions
2 Partitions
Kafka CPU load (CICO)
10/50 Partitions
2 Partitions
Database Load (CICO)
10/50 Partitions
2 Partitions
Data Import
Instance CPU Utilization (DI)
10/50 Partitions
2 Partitions
Service CPU Utilization (DI)
10/50 Partitions
2 Partitions
Memory Utilization (DI)
10/50 Partitions
2 Partitions
RDS CPU Utilization (DI)
10/50 Partitions
2 Partitions