IN PROGRESS
Infrastructure
PTF -environment ncp3
- 9 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
- 2 instances of db.r6.xlarge database instances, one reader, and one writer
- MSK ptf-kakfa-3
- 4 m5.2xlarge brokers in 2 zones
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=truec
- log.retention.minutes=480
- default.replication.factor=
Modules memory and CPU parameters
Modules | Version | Task Definition | Running Tasks | CPU | Memory | MemoryReservation | MaxMetaspaceSize | Xmx |
|---|---|---|---|---|---|---|---|---|
Modules | Version | Task Definition | Running Tasks | CPU | Memory | MemoryReservation | MaxMetaspaceSize | Xmx |
| mod-inventory | 19.0.1 | 1 | 2 | 1024 | 2880 | 2592 | 512m | 1814m |
mod-inventory-storage | 25.0.1 | 1-2 | 2 | 1024 | 2208 (1872 in MG) | 1952 (1684 in MG) | 512m | 1440m |
| okapi | 4.14.7 | 1-2 | 3 | 1024 | 1684 (1512 in MG) | 1440 (1360 in MG) | 512m | 922m |
| mod-feesfines | 18.1.0 | 1-2 | 2 | 128 | 1024 | 896 | 128 | 768 |
| mod-patron-blocks | 1.7.1 | 1-2 | 2 | 1024 | 1024 | 896 | 128 | 768 |
| mod-pubsub | 2.7.0 | 1-2 | 2 | 1024 | 1536 (1440 in MG) | 1440 (1296 in MG) | 512 | 922 |
| mod-authtoken | 2.12.0 | 1-2 | 2 | 512 (128 in MG) | 1440 (1024 in MG) | 1152 (896 in MG) | 128 | 922 (768 in MG) |
| mod-circulation-storage | 15.0.0 | 1-2 | 2 | 1024 | 1536 (1152 in MG) | 1440 (1024 in MG) | 512 | 896 |
| mod-circulation | 23.3.0 | 1 | 2 | 1024 | 1024 | 896 | 128 | 768 |
| mod-configuration | 5.9.0 | 1-2 | 2 | 128 | 1024 | 896 | 128m | 768m |
| mod-users | 19.0.0 | 1-2 | 2 | 258 | 1024 | 896 | 128m | 768m |
| mod-remote-storage | 1.7.0 | 1-2 | 2 | 128 | 1872 | 1684 | 512m | 1178m |
| mod-data-import-cs | 1.15.1 | 1-2 | 2 | 258 | 1024 | 896 | 128m | 768m |
| mod-quick-marc | 2.5.0 | 1-2 | 1 | 128 | 2288 (2098 in MG) | 2176 (1920 in MG) | 512m | 1664m |
| mod-source-record-storage | 5.5.2 | 1-2 | 2 | 1024 | 1536 (1440 in MG) | 1440 (1296 in MG) | 512m | 908m |
| mod-data-import | 2.6.1 | 1-2 | 1 | 256 | 2048 | 1844 | 512m | 1292m |
| mod-source-record-manager | 3.5.4 | 2-3 | 2 | 1024 | 4096 (2048 in MG) | 3688 (1844 in MG) | 512m (800M in MG) | 2048m (1024m in MG) |
MG- Morning Glory release
Front End:
- Item Check-in (folio_checkin-7.2.0)
- Item Check-out (folio_checkout-8.2.0)
Results
| MARC File | Profile | DI Duration | Check In (CI), Check Out (CO) | ||
|---|---|---|---|---|---|
| users | CI Average (seconds) | CO Average (seconds) | |||
| 5K.mrc | PTF - Create 2 | 8 | |||
| 10K.mrc | PTF - Create 2 | 8 | 1.480 | 2.068 | |
| 25K.mrc | PTF - Create 2 | 8 | 3.798 | 6.254 | |
| 50K.mrc | PTF - Create 2 | 8 | 1.255 | 2.074 | |
| 100K.mrc | PTF - Create 2 | 8 | - | - | |
| 5K.mrc | PTF - Updates Success - 1 | 8 | |||
| 10K.mrc | PTF - Updates Success - 1 | 8 | |||
| 25K.mrc | PTF - Updates Success - 1 | 8 | |||
| 50K.mrc | PTF - Updates Success - 1 | 8 | |||
| 100K.mrc | PTF - Updates Success - 1 | 8 | |||
Comparisons
The following table compares additional test results to previous release numbers and to the CICO baselines (of Check In average time 0.704s and Checkout average time 1.352s). Note that Lotus numbers are in red, Kiwi numbers are in blue.
in the new version, there is no change in the performance of date-import, but noticeably faster check-in-checkout
Profile | Duration KIWI (Lotus) without CICO | Duration with CICO 8 users | CheckIn average (seconds) | CheckOut average (seconds) | Deviation From the baseline CICO response times | |
|---|---|---|---|---|---|---|
5K MARC BIB Create | PTF - Create 2 | 5 min, 8 min (05:32.264) (08:48.556) | 5 min (05:48.671) | 1.297 0.851 | 2.449 1.388 | CI: 17% CO: 3% |
5K MARC BIB Update | PTF - Updates Success - 1 | 11 min, 13 min (10:07.723) | 7 min 06:27.143 | 1.315 1.102 | 2.469 1.867 | CI: 56% CO: 38% |
10K MARC BIB Create | PTF - Create 2 | 11 min , 14 min 10:07.723 | 13 min 00:10:47.622 | 1.407 1.354 | 2.795 2.271 | CI: 92% CO: 68% |
| 10K MARC BIB Update | PTF - Updates Success - 1 | 22 min, 24 min | 15 min 20:46.29 | 1.691 0.864 | 3.041 1.655 | CI: 51% CO: 54% |
| 25K MARC BIB Create | PTF - Create 2 | 23 mins, 25 mins, 26 mins | 31 min 32:21.273 | 1.536 1.248 | 2.962 2.078 | CI: 77% CO: 54% |
| 25K MARC BIB Update | PTF - Updates Success - 1 | 27 min, 40 mins, 56mins | 33 min 31:40.429 | 1.589 0.951 | 2.997 1.658 | CI: 35% CO: 23% |
| 50K MARC BIB Create | PTF - Create 2 | 40 mins, 43mins 49:55.86 | 63 min 47:53.93 | 1.783 1.271 | 3.231 2.095 | CI: 81% CO: 55% |
| 50K MARC BIB Update | PTF - Updates Success - 1 | 64 min 48:46.35 | FAILED | - | - | CI: CO: |