| Table of Contents |
|---|
...
| Service | Configuration #1 | Configuration #2 | Configuration #3 |
| mod-inventory-b | 99.4 | 105.84 | 102.32 |
| mod-search-b | 96.43 | 89.1 | 96.81 |
| mod-users-b | 63.08 | 61.58 | 60.63 |
- Service CPU utilization changed between tests because of the cluster restarts
- RDS CPU utilization was close to 96% during CI/CO + Data import
- RDS DB Connections were close to 600 during CI/CO + Data import
...
| Request* | Response time (avg, sec) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Pure CICO | CICO + 100K MARC BIB Create | |||||||||
| Check-Out Controller | 0.965 | 2.121 | ||||||||
| Check-In Controller | 0.47 | 1.24 | ||||||||
| POST_circulation/check-out-by-barcode (Submit_barcode_checkout) | 0.314 | 0.879 | ||||||||
| POST_circulation/check-in-by-barcode (Submit_barcode_checkin) | 0.208 | 0.73 | ||||||||
| GET_circulation/loans (Submit_barcode_checkout) | 0.142 | 0.259 | ||||||||
| GET_circulation/loans (Submit_patron_barcode) | 0.1 | 0.203 | ||||||||
| GET_inventory/items (Submit_barcode_checkin) | 0.055 | 0.182 | Authorize_simple | 0.178 | POST_bl-users/login | 0.178 | GET_inventory/items (Submit_barcode_checkout) | 0.142 | GET_automated-patron-blocks (Submit_patron_barcode) | 0.124 |
*Top requests were taken where response times >= 100ms.
...
Infrastructure
PTF -environment pcp1
- 10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 database instance, writer
Name Memory GIB vCPUs max_connections db.r6g.xlarge
32 GiB 4 vCPUs 2731 - MSK tenant
- 4 m5.2xlarge brokers in 2 zones
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3
| Module | Task Def. Revision | Task Def. Revision with MaxRAMPercentage = by default | Task Def. Revision with MaxRAMPercentage = 66.0 | Module Version | Task Count | Mem Hard Limit | Mem Soft limit | CPU units | Xmx | MetaspaceSize | MaxMetaspaceSizeR/W split enabled | MaxRAMPercentage Tests | MaxRAMPercentage = recommended (66%) | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pcp1-pvt | ||||||||||||||
| Thu Apr 04 09:40:28 UTC 2024 | ||||||||||||||
| mod-data-import | 20 | 23 | 24 | mod-data-import:3.0.7 | 1 | 2048 | 1844 | 256 | 1292 | 384 | 512FALSE | 70.1 | 66.0 | |
| mod-authtoken | 16 | 17 | 18 | mod-authtoken:2.14.1 | 2 | 1440 | 1152 | 512 | 922 | 88 | 128FALSE | 80.0 | 66.0 | |
| mod-configuration | 10 | 12 | 13 | mod-configuration:5.9.2 | 2 | 1024 | 896 | 128 | 768 | 88 | 128FALSE | 85.7 | 66.0 | |
| mod-users-bl | 10 | 11 | 12 | mod-users-bl:7.6.0 | 2 | 1440 | 1152 | 512 | 922 | 88 | 128FALSE | 80.0 | 66.0 | |
| mod-inventory-storage | 15 | 17 | 18 | mod-inventory-storage:27.0.4 | 2 | 4096 | 3690 | 2048 | 3076 | 384 | 512 | FALSE | 83.4 | 66.0 |
| mod-circulation-storage | 14 | 15 | 16 | mod-circulation-storage:17.1.7 | 2 | 2880 | 2592 | 1536 | 1814 | 384 | 512FALSE | 70.0 | 66.0 | |
| mod-source-record-storage | 18 | 19 | 20 | mod-source-record-storage:5.7.5 | 2 | 5600 | 5000 | 2048 | 3500 | 384 | 512FALSE | 70.0 | 66.0 | |
| mod-inventory | 15 | 16 | 17 | mod-inventory:20.1.8 | 2 | 2880 | 2592 | 1024 | 1814 | 384 | 512FALSE | 70.0 | 66.0 | |
| mod-di-converter-storage | 18 | 19 | 20 | mod-di-converter-storage:2.1.5 | 2 | 1024 | 896 | 128 | 768 | 88 | 128FALSE | 85.7 | 66.0 | |
| mod-circulation | 14 | 15 | 16 | mod-circulation:24.0.11 | 2 | 2880 | 2592 | 1536 | 1814 | 384 | 512FALSE | 70.0 | 66.0 | |
| mod-pubsub | 13 | 14 | 15 | mod-pubsub:2.11.3 | 2 | 1536 | 1440 | 1024 | 922 | 384 | 512FALSE | 64.0 | 66.0 | |
| mod-users | 34 | 35 | 36 | mod-users:19.3.0-SNAPSHOT.677 | 2 | 1024 | 896 | 128 | 768 | 88 | 128FALSE | 85.7 | 66.0 | |
| mod-patron-blocks | 10 | 11 | 12 | mod-patron-blocks:1.9.0 | 2 | 1024 | 896 | 1024 | 768 | 88 | 128 | FALSE | 85.7 | 66.0 |
| mod-source-record-manager | 17 | 19 | 20 | mod-source-record-manager:3.7.8 | 2 | 5600 | 5000 | 2048 | 3500 | 384 | 512FALSE | 70.0 | 66.0 | |
| nginx-okapi | 9 | nginx-okapi:2023.06.14 | 2 | 1024 | 896 | 128 | 0 | 0 | 0FALSE | 0.0 | ||||
| okapi-b | 11 | 12 | 13 | okapi:5.1.2 | 3 | 1684 | 1440 | 1024 | 922 | 384 | 512FALSE | 64.0 | 66.0 | |
| mod-feesfines | 11 | 12 | 13 | mod-feesfines:19.0.0 | 2 | 1024 | 896 | 128 | 768 | 88 | 128 | FALSE | 85.7 | 66.0 |
Methodology/Approach
- Run CI/CO for 24 hours.
- Run DI script with 12 DI's sequentially after ramp-up period for CI/CO.
- After getting baseline, repeat CI/CO with changed revisions of modules with needed configuration of
JAVA_OPTS -replaced XMX with MaxRAMPercentage. - Before tests restart the cluster to get consistent results.
Additional
...
Screenshots of graphs or charts
Spreadsheet with notes
| View file | ||||
|---|---|---|---|---|
|
...