| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Table of Contents |
|---|
Overview
The purpose of this test set is to compare different runs of CheckIn-CheckOut workflow test with different set of mod-pubsub. As we find - to enable multi node on mod-pubsub is needed to change NUMBER_OF_PARTITIONS value to bigger one. In test set we comparing different numbers of nodes and partitions.
Summary
Test set shows that optimal configuration is 2 containers with 2 KAFKA NUMBER_OF_PARTITIONS. 3 containers with 2 nodes shows higher response times than even one container with one partition. (same for 3 nodes with 3 partitions).
Version
mod-pubsub:1.3.3
Tests
| Test# | Virtual Users | Duration | mod-pubsub setup |
|---|---|---|---|
| 1 | 20 | 2 hours | 2 container 1 partition |
| 2 | 20 | 2 hours | 2 containers 2 partitions |
| 3 | 20 | 2 hours | 2 container 3 partitions |
| 4 | 20 | 2 hours | 3 containers 3 partitions |
Results comparison
For comparison purposes we'll use formula to summarize Check-In controller and Check-Out controller, instead of using all calls list.
| 1 vs 2 | 2 vs 3 | 3 vs 1 | 4 vs 3 | |||||||||
| 50th pct | 75th pct | 75 % difference | 50th pct | 75th pct | 75 % difference | 50th pct | 75th pct | 75 % difference | 50th pct | 75th pct | 75 % difference | |
| Total Check-in | -0,449 | -0,69 | -99% | -0,222 | -0,172 | -33% | -0,671 | -0,862 | -137% | 2,416 | 3,018 | 341% |
| Total Check-out | 3,188 | 4,112 | 120% | 1,763 | 2,079 | 40% | 4,951 | 6,191 | 169% | -7,451 | -9,506 | -475% |
CPU comparison during tests
Test 1: 2 containers, 1 partition
Node 1:
Node 2:
Test 2: 2 containers, 2 partitions
node 1:
node 2:
Test 3: 2 containers, 3 partitions
node 1:
node 2:
Test 4: 3 containers, 3 partitions
node 1
node 2
node 3
