PERF-152 - Getting issue details... STATUS

Overview

The purpose of this test set is to compare different runs of CheckIn-CheckOut workflow test with different set of mod-pubsub. As we find - to enable multi node on mod-pubsub is needed to change NUMBER_OF_PARTITIONS value to bigger one. In test set we comparing different numbers of nodes and partitions.

Summary

Test set shows that optimal configuration is 2 containers with 2 KAFKA NUMBER_OF_PARTITIONS. 3 containers with 2 nodes shows higher response times than even one container with one partition. (same for 3 nodes with 3 partitions).

Version

mod-pubsub:1.3.3

Tests

Test#	Virtual Users	Duration	mod-pubsub setup
1	20	2 hours	2 container 1 partition
2	20	2 hours	2 containers 2 partitions
3	20	2 hours	2 container 3 partitions
4	20	2 hours	3 containers 3 partitions

Results comparison

For comparison purposes we'll use Check-In controller and Check-Out controller (summaries all calls) instead of using all calls list.

1 and 2				2 and 3				3 and 1
	50th pct	75th pct		2 and 3	50th pct	75th pct		3 and 1	50th pct	75th pct
Check-In Controller	-0.254	-0.345	-31%	Check-In Controller	0.41	0.502	43%	Check-In Controller	-0.066	-0.046	13%
Check-Out Controller	-0.717	-0.743	-30%	Check-Out Controller	1.137	1.171	46%	Check-Out Controller	-2.859	-7.347	16%