| Table of Contents |
|---|
...
Ticket:Jira Legacy server System Jira columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key PERF-936
Summary
- Comparing kafka.m5.2xlarge, zookeeper metadata mode against kafka.m7g.2xlarge
...
- , KRaft metadata mode
- Resource utilization
Test Runs
Test # | MSK instance type | Scenario | Load level |
|---|---|---|---|
| 1 | kafka.m5.2xlarge | CICO + DI MARC Bib Create | 8 users + 5K, 25K sequentially |
| 2 | DI MARC Bib Create | 5K, 25K sequentially | |
| 3 | CICO + DI MARC Bib Update | 8 users + 5K, 25K sequentially | |
| 4 | DI MARC Bib Update | 5K, 25K sequentially | |
| 5 | kafka.m7g.2xlarge | CICO + DI MARC Bib Create | 8 users + 5K, 25K sequentially |
| 6 | DI MARC Bib Create | 5K, 25K sequentially | |
| 7 | CICO + DI MARC Bib Update | 8 users + 5K, 25K sequentially | |
| 8 | DI MARC Bib Update | 5K, 25K sequentially |
...
| MSK instance: kafka.m5.2xlarge, metadata mode - ZooKeeper | ||||||
|---|---|---|---|---|---|---|
| Job profile | File size | DI Duration without CI/CO | DI Duration with CI/CO | CI with DI Average sec | CO with DI Average sec | |
| PTF - Create 2 | 5k | 00:03:45 | 00:02:44 | 0.736 | 1.16 | |
| 25k | 00:14:40 | 00:13:36 | 0.787 | 1.176 | ||
| PTF - Updates Success - 6 | 5k | 00:04:43 | 00:04:18 | 25k | 000.764 | 1.153 |
| 25k | 00:20:21 | 00:21:25 | 0.767 | 1.179 | ||
| MSK instance: kafka.m7g.2xlarge, metadata mode - KRaft | ||||||
| Job profile | File size | DI Duration without CI/CO | DI Duration with CI/CO | CI with DI Average sec | CO with DI Average sec | |
| PTF - Create 2 | 5k | 00:02:49 | 00:02:39 | 0.765 | 1.118 | |
| 25k | 00:13:31 | 00:12:04 | 0.777 | 1.186 | ||
| PTF - Updates Success - 6 | 5k | 25k | ||||
...
| 00:04:36 | 00:04:31 | 0.706 | 1.095 | ||
| 25k | 00:24:07 | 00:21:50 | 0.74 | 1.16 |
Check-in/Check-out without DI
| Scenario | Load level | Request | Response time, sec | Response time, sec | ||
|---|---|---|---|---|---|---|
| 95 perc | average | 95 perc | average | |||
| Circulation Check-in/Check-out (without Data import) | 8 users | Check-in | 0.695 | 0.587 | 0.695 | 0.583 |
| Check-out | 1.148 | 0.958 | 1.151 | 0.944 | ||
Comparison
Data Import durations and Check-In/Check-Out response time comparison
- Data Import durations and import durations fluctuate within a 10% range of the baseline (tests with Zookeeper metadata mode)
- Response times of CI/CO response time with Data import do not differ significantly. The number of requests in 2 hour CI/CO with Data Import tests were similar for both MSK clusters- 287669 in m5 and 287155 in m7g MSK instance type.
| Job Profile | File size | DELTA, DI without CI/CO | DELTA, DI+CI/CO | DELTA, CI with DI | DELTA, CO with DI |
|---|---|---|---|---|---|
| PTF - Create 2 | 5k | 00:00:56 | 00:00:05 | -0.029 | 0.042 |
| 25k | 00:01:09 | 00:01:32 | 0.01 | -0.01 | |
| PTF - Updates Success - 6 | 5k25k | 00:00:07 | 00:00:13 | 0.058 | 0.058 |
| 25k | 00:03:46 | 00:00:25 | 0.027 | 0.019 |
Check-in/Check-out without DI
- Check-in/Check-out perform the same in both MSK clusters. The difference of response times is so small that it can be neglected.
| Scenario | Load level | Request | Response time, sec | Response time, sec | Delta | ||||
|---|---|---|---|---|---|---|---|---|---|
| 95 perc | average | 95 perc | average | Average | Circulation Check-in/Check-out (without Data import) | 8 users | Check-in | Check-outAverage | |
| Circulation Check-in/Check-out (without Data import) | 8 users | Check-in | 0.695 | 0.587 | 0.695 | 0.583 | -0.004 | ||
| Check-out | 1.148 | 0.958 | 1.151 | 0.944 | -0.014 | ||||
MSK resource utilization (CPU)
...
MSK instance: kafka.m7g.2xlarge
Top SQL-queries:
Appendix
Infrastructure
PTF -environment qcp1
- 10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 database instance, writer
Name Memory GIB vCPUs max_connections db.r6g.xlarge
32 GiB 4 vCPUs 2731 - MSK ptf-mobius-testing2
- 2 m5.2xlarge brokers in 2 zones (total 2 brokers)
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=2
- revision - 2
- metadata mode - ZooKeeper
- MSK ptf-KRaft-mode
- 2 m7g.2xlarge brokers in 2 zones (total 2 brokers)
Apache Kafka version 3.7.x
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3
- revision - 26
- metadata mode - KRaft
Task count for modules mod-oa-b, modmodule mod-graphql set to 0 before test start.
...