Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
Overview

...

Ticket:

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyPERF-611

Summary


Tests

Job profiles - PTF - Create 2, PTF - Updates Success - 1

ScenarioData quantity
DI Create, DI Update (coherently)25K
DI Create, DI Update (coherently) with CICO  in parallel

DI - 25K

CICO - 20 users

CICO20 users

...

DB typeDB configuration
RDS

db.r6g.xlarge

db.r6g.8xlarge

Serverless

Serverless v2 (0.5 - 128 ACUs)

Serverless v2 (32 - 128 ACUs)

Results

At the table below next results are compared: RDS xlarge agains 0.5-128 ACU Serverless and RDS 8xlarge agains 32-128 ACU Serverless (marked by color).

Process/requestRDSServerless
xlarge8xlarge0.5-128 ACU32-128 ACU
DI Create18 min9 min11 min (-7 min)​14 min (+5 min)​
DI Update17 min10 min16 min (-1 min)​11 min  (+1 min)​
DI Create (with CICO in parallel)22 min9 min20 min (-2 min)​11 min   (+2 min)​
DI Update (with CICO in parallel)22 min, error*12 min25 min, error** (+3 min)​12 min (0 min)​
CI, 95%0.680.7180.806 (+0.126 sec)0.794 (+0.076 sec)​
CO, 95%1.2471.2511.393 (+0.146 sec)​1.312 (+0.061 sec)​
CI (with DI Update in parallel), 95%1.361.1931.277 (-0.083 sec)​1.11 (-0.083 sec)​
CO (with DI Update in parallel), 95%2.3352.0622.321 (-0.014 sec)​1.963 (-0.099 sec)​

...

**Error - io.vertx.core.impl.NoStackTraceThrowable

Response time

db.r6g.xlarge DI with CICO

db.r6g.8xlarge DI with CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI without CICO

Service CPU Utilization

db.r6g.xlarge DI without CICO

Image Modified

db.r6g.xlarge DI with CICO

Image Modified

db.r6g.8xlarge DI without CICO

Image Modified

db.r6g.8xlarge DI with CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Serverless v2 (0.5 - 128 ACUs) DI with CICO

Serverless v2 (32 - 128 ACUs) DI without CICO

Serverless v2 (32 - 128 ACUs) DI with CICO

Memory Utilization

db.r6g.xlarge without DI CICO

Image Modified

db.r6g.xlarge DI with CICO

Image Modified

db.r6g.8xlarge DI without CICO

Image Modified

db.r6g.8xlarge DI with CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI with CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI with CICO

Image Modified

DB CPU Utilization

db.r6g.xlarge DI without CICO

Image Modified

db.r6g.xlarge DI with CICO

Image Modified

db.r6g.8xlarge DI without CICO

Image Modified

db.r6g.8xlarge DI with CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI with CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI with CICO

DB Connections

db.r6g.xlarge DI without CICO

Image Modified

db.r6g.xlarge DI with CICO

Image Modified

db.r6g.8xlarge DI without CICO

Image Modified

db.r6g.8xlarge DI with CICO

Image Modified


Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI with CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI with CICO

Image Modified

Database load

db.r6g.8xlarge DI without CICO

db.r6g.8xlarge DI with CICO

Serverless v2 (32 - 128 ACUs) DI without CICO

Serverless v2 (32 - 128 ACUs) DI with CICO

Top SQL

db.r6g.8xlarge DI without CICO

Image Removed

db.r6g.8xlarge DI with CICO

Image Removed

Serverless v2 (32 - 128 ACUs) DI without CICO

Image Removed

Serverless v2 (32 - 128 ACUs) DI with CICO

...

Appendix

Grafana dashboard

db.r6g.xlarge DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1690186885745&to=1690192449004&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

db.r6g.8xlarge DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1690206826647&to=1690209403208&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

Serverless v2 (0.5 - 128 ACUs) DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1689860038636&to=1689864442762&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

Serverless v2 (32 - 128 ACUs) DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1689934923312&to=1689937778313&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

...