...
Infrastructure
PTF -environment ncp3
- 9 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
- 2 instances of db.r6.xlarge database instances, one reader, and one writer
- MSK ptf-kakfa-3
- 4 m5.2xlarge brokers in 2 zones
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3
...
Test | Virtual Users | Duration of CI/CO | Load generator size (recommended) | Load generator Memory(GiB) (recommended) |
1. | 8 users CI/CO + DI 50k MARC BIB Create+ 10k Items editing | 30 mins | t3.medium | 3 |
2. | 8 users CI/CO + DI 50k MARC BIB Create+ 10k holdings editing | 30 mins | t3.medium | 3 |
3. | 8 users CI/CO + DI 50k MARC BIB Update+ 10k Items editing | 30 mins | t3.medium | 3 |
| 4. | 8 users CI/CO + DI 50k MARC BIB Update+ 10k Holdings editing | 30 mins | t3.medium | 3 |
Results
Response Times (Average of all tests listed above, in seconds)
| Check-in-check-out | Bulk edit | Data Import | ||||
|---|---|---|---|---|---|---|
| Average (seconds) | Items | Holdings | MARC BIB | |||
| Check-in | Check-out | 10k records | 10k records | 50k Create | 50k Update | |
| Test 1 | 0.715 | 1.332 | 40 min | - | 20 min 19 sec | - |
| Test 2 | 0.756 | 1.383 | - | 20 min 30 sec | 21min 07 sec | - |
| Test 3 | 0.567 | 1.029 | 32 min | - | - | 33 min 33 sec |
| Test 4 | 0.552 | 0.987 | - | 9min 20 sec | - | 30 min 52 sec |
| Jobs Baseline time to compare (single process) | 0.456 | 0.698 | 28 min | 12 min 25 sec | 23 min 43 s24 min 5 s | 20 min 57 s (for mod-source-record-manager v. 3.5.4) |
| CICO + DI MARC BIB Create time | 0.926 | 1.666 | - | - | 19min 28s | - |
| CICO + DI MARC BIB Update time | 0.700 | 1.199 | - | - | - | 27min 39s |
| CICO + Holdings Bulk Edit time | 0.428 | 0.790 | - | 11 min 20 sec | - | - |
| CICO + Items Bulk Edit time | 0.431 | 0.793 | 20min * | - | - | - |
...