PTF - RMB 32 / Vert.x 4.0.0 with mod-configuration Test Report (Honeysuckle)






PERF-169 - Getting issue details... STATUS

Overview

In this workflow, we are checking the performance of RMB 32 / Vert.x 4.0.0 with mod-configuration for the Honeysuckle release.

We tested it with 5, 8 virtual users for 30 minutes.  

Backend:

  • mod-users-17.1.0
  • mod-users-bl-6.0.0
  • mod-authtoken-2.5.1
  • mod-permissions-5.11.2
  • mod-configuration-5.5.0
  • mod-configuration-5.6.0
  • okapi-4.3.3

Environment:

  • 63 back-end modules deployed in 110 ECS services
  • 3 okapi ECS services
  • 8 m5.large  EC2 instances
  • 2 (1 reader, 1 writer) db.r5.xlarge AWS RDS instance
  • INFO logging level

High Level Summary

mod-configuration-5.6.0 with latest RMB 32 / Vert.x 4.0.0 performs better than older release.

GET by id is ~43% faster
POST is ~40% faster
DELETE is ~43% faster

Test Runs

Test

Virtual Users

Duration

1. 

5

30 min

2. 

8

30 min


mod-configuration-5.5.0 vs mod-configuration-5.6.0

Results

mod-configuration-5.5.0

API5 Users Average8 Users Average
GET_/configurations/entries/configId44 ms59 ms
POST_/configurations/entries47 ms63 ms
DELETE_/configurations/entries/configId46 ms61 ms



mod-configuration-5.6.0 - RMB 32 / Vert.x 4.0.0

API5 Users Average8 Users Average
GET_/configurations/entries/configId25 ms25 ms
POST_/configurations/entries28 ms28 ms
DELETE_/configurations/entries/configId26 ms26 ms


Database CPU Utilization

The database CPU utilization is around 9%-10% for both releases. mod-configuration-5.6.0 consumes less CPU for 5 Users compared to mod-configuration-5.5.0

mod-configuration-5.5.0


mod-configuration-5.6.0


Service CPU Utilization

For both 5 and 8 users, mod-configuration-5.6.0 is faster than mod-configuration-5.5.0. mod-configuration-5.6.0 is around 57% faster.

mod-configuration-5.5.0

mod-configuration-5.6.0

Service Memory Utilization

mod-configuration-5.6.0 consumes a little less memory so more memory efficient.

mod-configuration-5.5.0

mod-configuration-5.6.0


Response times

mod-configuration-5.6.0 can process more requests and also has better Average RPS

mod-configuration-5.5.0 for 8 users

mod-configuration-5.6.0 for 8 users