[Nolana] Check-IN + title-level requests
- 1 Overview
- 2 Summary
- 3 Test Runs
- 4 Results
- 4.1 Response Times
- 4.2 Response time comparison
- 4.3 Service CPU Utilization
- 4.4 Service CPU Utilization 25 users comparison
- 4.5 Instance CPU Utilization
- 4.6 Memory Utilization
- 4.7 RDS CPU Utilization
- 4.8 RDS CPU Utilization 25 users comparison
- 4.9 RDS DB connections
- 4.10 Database Load
- 4.11 Database Load 25 users comparison
- 4.12 Top SQL 25 users comparison
- 5 Appendix
Overview
Test goal is to assess performance of circulation check-in functionality for items with 10 TLR (title-level requests) each.
Ticket: PERF-450: Circulation checkin of items with multiple title-level holdsClosed
Summary
Load tests showed that there is significant degradation (57-354%) in performance of check-in for items with 10 TLRs each and without it - see Response Time Comparison.
Resource monitoring showed that:
CPU consumption by several services increased significantly - see Service CPU Utilization 25 users comparison.
RDS CPU Utilization increased from 20% to 70% - see RDS CPU Utilization 25 users comparison.
Database load increased two times - see Database Load 25 users comparison.
Recommendations & Jiras
Ticket: Investigate performance degradation of Check-in with TLRs
PERF-465: Investigate performance degradation of Check-in with TLRsClosed
Test Runs
Test # | Test Conditions | Duration | Load generator size (recommended) | Load generator Memory(GiB) (recommended) | Notes
|
|---|---|---|---|---|---|
1. | Baseline, Checkin with 1, 8, 25 users | 30 min | t3.medium | 3 | Without TLR |
2. | Verification, Checkin with 1, 8, 25 users | WIth 10 TLR per item |
Results
Response Times
Baseline (items without TLR)
Verification (items with 10 TLRs)
Response time comparison
Users quantity | Response time 95prc, sec |
Degradation, sec |
Degradation, % | |
|---|---|---|---|---|
Baseline (items without TLR) | Verification (items with 10 TLR each) | |||
1 user | 0.607 | 0.953 | 0.346 | 57 |
8 users | 0.484 | 0.782 | 0.298 | 62 |
25 users | 0.441 | 2.001 | 1.56 | 354 |
Service CPU Utilization
Baseline (items without TLR)
Verification (items with 10 TLRs)
Service CPU Utilization 25 users comparison
Baseline (items without TLR)
Verification (items with 10 TLRs)
Modules | Average load | |
|---|---|---|
Baseline | Verification | |
mod-users | 22.1 | 51.6 |
mod-circulation-storage | 3.3 | 7.2 |
mod-inventory-storage | 9 | 20.6 |
mod-circulation | 1.5 | 2.7 |
mod-okapi | 19.9 | 20.8 |
mod-feesfines | 7.1 | 8.7 |
mod-patron-blocks | 0.6 | 1.1 |
mod-pubsub | 5.8 | 5.9 |
mod-authtoken | 5.4 | 6.3 |
mod-configuration | 16.5 | 13.2 |
mod-remote-storage | 16.4 | 19.3 |
mod-inventory | 9.6 | 11.8 |
mod-inventory-storage | 9 | 20.6 |