PTF-Test Hybrid DB Deployment on multiple tenants[Galileo environment]. Aurora serverless v2. Part 4

PTF-Test Hybrid DB Deployment on multiple tenants[Galileo environment]. Aurora serverless v2. Part 4

 

Overview

This report details the performance evaluation of two distinct database architectures—Amazon Aurora Serverless v2 and Provisioned RDS (db.r8gd family)—within a multi-tenant FOLIO environment. The objective of this testing phase is to benchmark system stability, scalability, and response times under production-like traffic conditions. Specifically, the evaluation aims to compare the elasticity of Serverless v2 against the consistent performance baseline of provisioned r8gd instances, assessing their ability to handle both "Common Day" and "Worst Day" production load(SMCH) patterns across 20 concurrent tenants.

Ticket: https://folio-org.atlassian.net/browse/PERF-1424

Summary:

  1. Under Common Day load, Aurora Serverless v2 demonstrated better overall performance than the Provisioned r8gd.4xl, delivering consistently lower p90 latencies for heavy inventory operations and authentication workflows. While both architectures processed similar throughput, Serverless v2 proved more efficient at maintaining stable response times and mitigating latency degradation.

  2. Test 6 was deliberately executed to evaluate the lower bounds of DB by downscaling to a db.r8gd.2xl instance under Common Day load. As anticipated, the architecture failed to sustain the 20-tenant concurrency. Severe database memory starvation resulted in a critically high error rate and triggered cascading module restarts, confirming that a 2xlarge instance is strictly insufficient for this baseline workload.

  3. Under Worst Day load conditions, both Aurora Serverless v2 and Provisioned db.r8gd.4xl successfully sustained operations with comparable total throughput. Aurora Serverless demonstrated stronger resilience during heavy I/O tasks, yielding lower p90 latencies for critical inventory operations (e.g., GET inventory items at 4.50s vs 5.15s, and GET inventory instance at 20.95s vs 21.71s). Both architectures proved highly capable of absorbing peak traffic spikes without systemic degradation.

  4. Although the load profile was escalated from Common Day to Worst Day, we did not observe a corresponding increase in overall throughput. To address this bottleneck, we scaled the ECS cluster by allocating 4 tasks to critical modules (mod-inventory, mod-inventory-storage, mod-source-record-manager, and mod-source-record-storage). This infrastructure tuning successfully unblocked the system, increasing total throughput from 1.9k RPS to 2.2k RPS.

  5. Comparing the standard Provisioned db.r8gd.4xl architecture (Test 4) against the identical database configuration paired with a scaled ECS cluster (Test 5) reveals performance improvements under Worst Day load conditions. The ECS tuning eliminated application-level bottlenecks for heavy workflows. Most notably, response times for the critical GET inventory instance operations plummeted from an average of ~17.1s down to ~3.7s, with 90th percentile (p90) latency dropping from 21.71s to 5.67s (a ~74% reduction).

Recommendations & Jiras

Test runs 

Test ID

Architecture

Load Model

Tenant Count

Notes

Status

Test 1

Aurora Serverless v2 (16-128 ACU)

Common Day

20

Baseline for Serverless scalability

PASSED

Test 2

Provisioned db.r8gd.4xl

Common Day

20

Baseline for Provisioned performance

PASSED

Test 3

Aurora Serverless v2 (16-128 ACU)

Worst Day

20

Serverless stress test

PASSED

Test 4

Provisioned db.r8gd.4xl

Worst Day

20

Provisioned stress test

PASSED

Test 5

Provisioned db.r8gd.4xl

Worst Day

20

Tuned ECS cluster (4 tasks for

mod-inventory,mod-inventory-storage, mod-source-record-manager, mod-source-record-storage)

PASSED

Test 6

Provisioned db.r8gd.2xl

Common Day

20

Resource optimization assessment

FAILED

 

Test results

Response time tables

Test 1, 2 - Common day production load

 

Requests

Test 1. Aurora Serverless

Test 2. r8gd.4xl

NumberOfSamples

Average

pct90

NumberOfSamples

Average

pct90

GET bound with parts

4307

315.64 ms

641.30 ms

4449

319.13 ms

666 ms

GET course detail

523830

20.09 ms

36.90 ms

513947

32.96 ms

37 ms

GET course instructors 1

523860

21.63 ms

39 ms

513975

44.67 ms

40 ms

GET course instructors 2

523855

21.39 ms

39.70 ms

513972

28.82 ms

39 ms

GET course instructors 3

523852

21.23 ms

40 ms

513971

31.22 ms

38.90 ms