Overview
The purpose of this test set is to compare different runs of CheckIn-CheckOut workflow test with different set of mod-pubsub. As we find - to enable multi node on mod-pubsub is needed to change NUMBER_OF_PARTITIONS value to bigger one. In test set we comparing different numbers of nodes and partitions.
Summary
Test set shows that optimal configuration is 2 containers with 2 KAFKA NUMBER_OF_PARTITIONS. 3 containers with 2 nodes shows higher response times than even one container with one partition. (same for 3 nodes with 3 partitions).
Version
mod-pubsub:1.3.3
Tests
Test# | Virtual Users | Duration | mod-pubsub setup |
---|---|---|---|
1 | 20 | 2 hours | 2 container 1 partition |
2 | 20 | 2 hours | 2 containers 2 partitions |
3 | 20 | 2 hours | 3 container 2 partitions |
4 | 20 | 2 hours | 3 containers 3 partitions |
Results comparison
For comparison purposes we'll use Check-In controller and Check-Out controller (summaries all calls) instead of using all calls list.
1 and 2 | 2 and 3 | 3 and 1 | |||||||||
50th pct | 75th pct | 2 and 3 | 50th pct | 75th pct | 3 and 1 | 50th pct | 75th pct | ||||
Check-In Controller | -0,254 | -0,345 | -31% | Check-In Controller | 0,41 | 0,502 | 43% | Check-In Controller | -0,066 | -0,046 | 13% |
Check-Out Controller | -0,717 | -0,743 | -30% | Check-Out Controller | 1,137 | 1,171 | 46% | Check-Out Controller | -2,859 | -7,347 | 16% |
CPU comparison during tests
Test 1
Node 1:
Node 2:
Test 2
node 1:
node 2:
Test 3:
node 1:
node 2:
test 4
node 1
node 2
node 3