IN PROGRESS

Overview

Infrastructure

10 m6i.2xlarge EC2 instances (changed. In Lotus it was m5.xlarge)
2 instances of db.r6.xlarge database instances, one reader and one writer
MSK
- 4 m5.2xlarge brokers in 2 zones
- auto.create-topics.enable = true
- log.retention.minutes=120
- 2 partitions per DI topics
mod-inventory memory
- 1024 CPU units, 2592MB mem
- inventory.kafka.DataImportConsumerVerticle.instancesNumber=10
- inventory.kafka.MarcBibInstanceHridSetConsumerVerticle.instancesNumber=10
- kafka.consumer.max.poll.records=10
mod-inventory-storage
- 1024 CPU units, 1684MB mem
mod-source-record-storage
- 1024 CPU units, 1296MB mem
mod-source-record-manager
- 1024 CPU units, 1844MB mem
mod-data-import
- 256 CPU units, 1844MB mem
mod-data-import-cs
- 128 CPU units, 896MB mem

...

Please note that infrastructure has being migrated from 6 m5.xlarge EC2 instances to 10 m6i.2xlarge. Key differences below:

Instance	CPU	RAM
m5.xlarge	4	16
m6i.2xlarge	8	32

Differences in modules memory and CPU parameters

...

	Profile	Duration
1K	Default - Create SRS MARC Authority	24 sec
5K	Default - Create SRS MARC Authority	1 min 21 sec
10K	Default - Create SRS MARC Authority	2 min 32 sec
25K	Default - Create SRS MARC Authority	11 min 14 s
50K	Default - Create SRS MARC Authority	22 min