Overview

...

Total time for all Data Export jobs - 1 hour 16 minutes 47 seconds.

Profile	MARC File	DI Duration Poppy with file splitting feature (hh:mm:ss)	Check In, Check Out Response time (8 users) Poppy
Profile	MARC File	DI Duration Poppy with file splitting feature (hh:mm:ss)	CI Average, sec	CO Average, sec
DI MARC Bib Create (PTF - Create 2)	5K.mrc	00:02:47	1.111	1.432
	10K.mrc	00:05:26	1.261	1.556
	25K.mrc	00:14:31	1.441	1.532
	50K.mrc	00:24:13	1.432	1.478
	100K.mrc	00:49:35	1.358	1.621
DI MARC Bib Update (PTF - Updates Success - 1)	5K.mrc	00:03:39	0.870	1.201
	10K.mrc	00:06:46	0.885	1.216
	25K.mrc	00:17:04	0.949	1.266
	50K.mrc	00:34:23	1.083	1.264
	100K.mrc	01:14:30	1.024	1.383

...

Infrastructure

PTF -environment pcp1

10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
2 database instances, writer/reader

Name Memory GIB vCPUs max_connections
db.r6g.xlarge
32 GiB 4 vCPUs 2731
MSK tenant
- 4 m5.2xlarge brokers in 2 zones
- Apache Kafka version 2.8.0
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3

...

Name	Memory GIB	vCPUs	max_connections
db.r6g.xlarge	32 GiB	4 vCPUs	2731