IN PROGRESS
Infrastructure
PTF -environment ncp3
- 9 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
- 2 instances of db.r6.xlarge database instances, one reader, and one writer
- MSK ptf-kakfa-3
- 4 m5.2xlarge brokers in 2 zones
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3
...
Modules memory and CPU parameters
Modules | Version | Task Definition | Running Tasks | CPU | Memory | MemoryReservation | MaxMetaspaceSize | Xmx |
|---|---|---|---|---|---|---|---|---|
| mod-inventory | 19.0.1 | 1 | 2 | 1024 | 2880 | 2592 | 512m | 1814m |
mod-inventory-storage | 25.0.1 | 1-2 | 2 | 1024 | 2208 (1872 in MG) | 1952 (1684 in MG) | 512m | 1440m |
| okapi | 4.14.7 | 1-2 | 3 | 1024 | 1684 (1512 in MG) | 1440 (1360 in MG) | 512m | 922m |
| mod-feesfines | 18.1.0 | 1-2 | 2 | 128 | 1024 | 896 | 128 | 768 |
| mod-patron-blocks | 1.7.1 | 1-2 | 2 | 1024 | 1024 | 896 | 128 | 768 |
| mod-pubsub | 2.7.0 | 1-2 | 2 | 1024 | 1536 (1440 in MG) | 1440 (1296 in MG) | 512 | 922 |
| mod-authtoken | 2.12.0 | 1-2 | 2 | 512 (128 in MG) | 1440 (1024 in MG) | 1152 (896 in MG) | 128 | 922 (768 in MG) |
| mod-circulation-storage | 15.0.0 | 1-2 | 2 | 1024 | 1536 (1152 in MG) | 1440 (1024 in MG) | 512 | 896 |
| mod-circulation | 23.3.0 | 1 | 2 | 1024 | 1024 | 896 | 128 | 768 |
| mod-configuration | 5.9.0 | 1-2 | 2 | 128 | 1024 | 896 | 128m | 768m |
| mod-users | 19.0.0 | 1-2 | 2 | 258 | 1024 | 896 | 128m | 768m |
| mod-remote-storage | 1.7.0 | 1-2 | 2 | 128 | 1872 | 1684 | 512m | 1178m |
| mod-data-import-cs | 1.15.1 | 1-2 | 2 | 258 | 1024 | 896 | 128m | 768m |
| mod-quick-marc | 2.5.0 | 1-2 | 1 | 128 | 2288 (2098 in MG) | 2176 (1920 in MG) | 512m | 1664m |
| mod-source-record-storage | 5.5.2 | 1-2 | 2 | 1024 | 1536 (1440 in MG) | 1440 (1296 in MG) | 512m | 908m |
| mod-data-import | 2.6.1 | 1-2 | 1 | 256 | 2048 | 1844 | 512m | 1292m |
| mod-source-record-manager | 3.5.4 | 2-3 | 2 | 1024 | 4096 (2048 in MG) | 3688 (1844 in MG) | 512m (800M in MG) | 2048m (1024m in MG) |
MG- Morning Glory release
...
For the baseline test the mod-source-record-manager version was 3.5.0 for the test with CI/CO it was 3.5.4. Maby it is the reason why the time of Data Import with CI/CO is even better than without CI/CO.
...