mod-pubsub performance testing

mod-pubsub performance testing

In scope of the ticket (https://folio-org.atlassian.net/browse/MODPUBSUB-64) 2 new sample modules were created locally and registered as 'publisher' and 'subscriber' in the 'mod-pubsub'.

A specific number of events were sent from publisher to subscriber without any timeouts between publishing event.

You can see the schema of this flow below: 

Testing was performed locally on 'folio/snapshot-backend-core' vagrant box with specific resources parameters: CPUS=8; Memory=25GB 

 

Memory

Total count

Payload size

Request time (from publisher module to pub-sub)

Result (Subscriber`s received events number)

 

Memory

Total count

Payload size

Request time (from publisher module to pub-sub)

Result (Subscriber`s received events number)

mod-pubsub

682MB

300

12 KB

First req: 1006ms

Last req: 2931ms

300

Okapi

768MB

500

12 KB 

First req: 1452ms

Last req: 5873ms

416

Kafka

 

700

12 KB

First req: 9081ms

Last req: 14019ms

552

As a result, in case the number of events is more than 500, some events published by the first module were not received by another. This is an issue for further investigation: https://folio-org.atlassian.net/browse/MODPUBSUB-68