IN PROGRESS

Table of Contents

Overview

...

There is significant performance improvement for data import in Poppy with file splitting feature compared with Orchid (40% for DI Create, 25% for DI Update) but small degradation (up to 5%) compared to Poppy without file splitting feature running with CICO. CO response times are almost the same as Poppy without file splitting feature. CI response time is 20% slower with and without Data Import.

...

Infrastructure

PTF -environment pcp1

• 10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1

• 2 database  instances, writer/reader

  
  

  Name	Memory GIB	vCPUs	max_connections
  db.r6g.xlarge	32 GiB	4 vCPUs	2731

  
  

• MSK tenant
  
  • 4 m5.2xlarge brokers in 2 zones

  • Apache Kafka version 2.8.0

  • EBS storage volume per broker 300 GiB

  • auto.create.topics.enable=true
  • log.retention.minutes=480
  • default.replication.factor=3

...