Page Comparison

Versions Compared

Key

This line was added.
This line was removed.
Formatting was changed.

Table of Contents
Table of Contents
Overview

This page is created to investigate Aurora serverless performance by comparing DB xlarge, 8xlarge and Aurora serverless instance types under load running Data Import (DI) with Check-in Check-out (CICO) running as background.

Ticket:

Jira Legacy

server	System Jira
serverId	01505d01-b853-3c2e-90f1-ee9b165564fc
key	PERF-611

Summary

Tests

Job profiles - PTF - Create 2, PTF - Updates Success - 1

Scenario	Data quantity
DI Create, DI Update (coherently)	25K
DI Create, DI Update (coherently) with CICO in parallel	DI - 25K CICO - 20 users
CICO	20 users

...

DB type	DB configuration
RDS	db.r6g.xlarge
RDS	db.r6g.8xlarge
Serverless	Serverless v2 (0.5 - 128 ACUs)
Serverless	Serverless v2 (32 - 128 ACUs)

Results

At the table below next results are compared: RDS xlarge agains 0.5-128 ACU Serverless and RDS 8xlarge agains 32-128 ACU Serverless (marked by color).

Process/request	RDS		Serverless
Process/request	xlarge	8xlarge	0.5-128 ACU	32-128 ACU
DI Create	18 min	9 min	11 min (-7 min)	14 min (+5 min)
DI Update	17 min	10 min	16 min (-1 min)	11 min (+1 min)
DI Create (with CICO in parallel)	22 min	9 min	20 min (-2 min)	11 min (+2 min)
DI Update (with CICO in parallel)	22 min, error*	12 min	25 min, error** (+3 min)	12 min (0 min)
CI, 95%	0.68	0.718	0.806 (+0.126 sec)	0.794 (+0.076 sec)
CO, 95%	1.247	1.251	1.393 (+0.146 sec)	1.312 (+0.061 sec)
CI (with DI Update in parallel), 95%	1.36	1.193	1.277 (-0.083 sec)	1.11 (-0.083 sec)
CO (with DI Update in parallel), 95%	2.335	2.062	2.321 (-0.014 sec)	1.963 (-0.099 sec)

...

**Error - io.vertx.core.impl.NoStackTraceThrowable

Response time

db.r6g.xlarge DI with CICO

There are more response time spikes during the test with xlarge configuration comparing to the tests with 8xlarge.

db.r6g.8xlarge DI with CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI with CICO

There is a spike at the begining of DI Update job. This can be connected ot mod-audit CPU increase at this moment.

Image Removed

Serverless v2 (32 - 128 ACUs) DI with CICO

Image Removed

...

moment.

Image Added

Serverless v2 (32 - 128 ACUs) DI with CICO

Image Added

Service CPU Utilization

db.r6g.xlarge DI without CICO

Maximum CPU utilization - 80% DI Create, 120% DI Update

Image Added

db.r6g.xlarge DI with CICO

Maximum CPU utilization - 75% DI Create, 100% DI Update

Image Added

db.r6g.

...

8xlarge DI without CICO

...

Maximum CPU utilization - 135% DI Create, 160% DI Update
Image Added

db.r6g.

...

8xlarge DI with CICO

Image Removed

...

Maximum CPU utilization - 150% DI Create, 200% DI Update

Image Added

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image Removed

db.r6g.8xlarge DI with CICO

Image RemovedMaximum CPU utilization - 110% DI Create, 125% DI Update

Serverless v2 (0.5 - 128 ACUs) DB configuration consumes more CPU resources than RDS db.r6g.xlarge configuration (110%-125% compared to 80%-120%).

Image Added

Serverless v2 (0.5 - 128 ACUs) DI

...

with CICO

Image RemovedMaximum CPU utilization - 100% DI Create, 105% DI Update

Image Added

Serverless v2 (

...

32 - 128 ACUs) DI

...

without CICO

Image RemovedMaximum CPU utilization - 100% DI Create, 150% DI Update

Serverless v2 (32 - 128 ACUs

...

Image Removed) DB configuration consumes less CPU resources than RDS db.r6g.8xlarge configuration (100%-150% compared to 135%-160%).

Image Added

Serverless v2 (32 - 128 ACUs) DI with CICO

Image RemovedMaximum CPU utilization - 100% DI Create, 160% DI Update

Image Added

Memory Utilization

db.r6g.xlarge without DI CICO

Image RemovedImage Added

db.r6g.xlarge DI with CICO

Image RemovedImage Added

db.r6g.8xlarge DI without CICO

Image RemovedImage Added

db.r6g.8xlarge DI with CICO

Image RemovedImage Added

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image RemovedImage Added

Serverless v2 (0.5 - 128 ACUs) DI with CICO

Image RemovedImage Added

Serverless v2 (32 - 128 ACUs) DI without CICO

Image RemovedImage Added

Serverless v2 (32 - 128 ACUs) DI with CICO

Image RemovedImage Added

DB CPU Utilization

db.r6g.xlarge DI without CICO

Image Modified

db.r6g.xlarge DI with CICO

Image Modified

db.r6g.8xlarge DI without CICO

Image Modified

db.r6g.8xlarge DI with CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI with CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI with CICO

DB Connections

db.r6g.xlarge DI without CICO

Image Modified

db.r6g.xlarge DI with CICO

Image Modified

db.r6g.8xlarge DI without CICO

Image Modified

db.r6g.8xlarge DI with CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (0.5 - 128 ACUs) DI with CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI without CICO

Image Modified

Serverless v2 (32 - 128 ACUs) DI with CICO

Image Modified

Database load

db.r6g.8xlarge DI without CICO

db.r6g.8xlarge DI with CICO

Serverless v2 (32 - 128 ACUs) DI without CICO

Serverless v2 (32 - 128 ACUs) DI with CICO

Appendix

Links

Grafana dashboard

db.r6g.xlarge DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1690186885745&to=1690192449004&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

db.r6g.8xlarge DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1690206826647&to=1690209403208&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

Serverless v2 (0.5 - 128 ACUs) DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1689860038636&to=1689864442762&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

Serverless v2 (32 - 128 ACUs) DI with CICO

http://carrier-io.int.folio.ebsco.com/grafana/d/SqzWB26nk/jmeter-performance-check-in-check-out?orgId=1&from=1689934923312&to=1689937778313&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_Orchid_cptf2_4&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

...