Versions Compared

Old Version 5

changes.mady.by.user Roman_Fedynyshyn

Saved on

compared with

New Version Current

changes.mady.by.user Roman_Fedynyshyn

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Jira Legacy
serverFOLIO Issue TrackerSystem JIRA
serverId6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc
keyPERF-152



Table of Contents


Overview

The purpose of this test set is to compare different runs of CheckIn-CheckOut workflow test with different set of mod-pubsub. As we find - to enable multi node on mod-pubsub is needed to change NUMBER_OF_PARTITIONS value to bigger one. In test set we comparing different numbers of nodes and partitions. 


Summary

Test set shows that optimal configuration is 2 containers with 2 KAFKA NUMBER_OF_PARTITIONS. 3 containers with 2 nodes shows higher response times than even one container with one partition. (same for 3 nodes with 3 partitions).


Partitioning logic depends on event types. It means that with "one call test" in any case we'll use only one partition of mod-pubsub. As for CheckIn-CheckOut test we might use one partition more than other (or other two) that can explain differences in CPU usages on different nodes. So bigger partition number can help with complex workflows or with real users. 

Version

mod-pubsub:1.3.3


Tests


Test#Virtual UsersDurationmod-pubsub setup
1202 hours
1
2 container 1 partition
2202 hours2 containers 2 partitions
3202 hours2 container 3
container 2
partitions
4202 hours3 containers 3 partitions

Results comparison

For comparison purposes we'll use Checkformula to summarize  Check-In controller and Check-Out controller (summaries all calls) , instead of using all calls list.

1
and
vs 22
and
vs 33
and
vs 14 vs 3

50th pct75th pct
2 and 3
75 % difference50th pct75th pct75 % difference50th pct75th pct
3 and 1
75 % difference50th pct75th pct75 % difference
Total Check-
In Controller
in-0,
254
449-0,
345
69-
31%
99%
Check
-
In Controller
0,
41
222-0,
502
172
43%
-33%
Check
-
In Controller
0,671-0,
066
862-
0,04613%Check-Out Controller-0,717-0,743-30%Check-Out Controller1,1371,17146%Check-Out Controller-2,859-7,34716%
137%2,4163,018341%
Total Check-out3,1884,112120%1,7632,07940%4,9516,191169%-7,451-9,506-475%



CPU comparison during tests

Test 1:   2 containers,  1 partition

Node 1:

Image Added

Node 2:

Image Added


Test 2:   2 containers,  2 partitions

node 1:

Image Added

node 2:

Image Added


Test 3:  2 containers, 3 partitions

node 1:
Image Added

node 2:

Image Added




Test 4:  3 containers, 3 partitions

node 1

Image Added

node 2

Image Added

node 3

Image Added