Overview

...

• How long does it take to export 100, 1000, 5000, 10k, and 100K records?
• Use it for up to 5 concurrent users.  
• Look for a memory trend and CPU usage
• Pay attention to any RTR token expiration messages and observe how/if BE is affected by expiring tokens. If needed set the Access token's expiration time to 300s or less to trigger the Access token's quick expiration. 

...

• Can it be used with up to 5 concurrent users? 
• Run consecutively four jobs editing 10k  item records
• Run simultaneously four jobs editing 10k item records
• Look for a memory trend and CPU usage

Summary 

Results

Total processing time of upload and edit - commit changes. Units =hours:minutes: seconds

...

Test 2.   Bulk-edit 100-1000-5000-10k records successively from 1VU up to 5VU

RDS CPU utilization

Test 1. Bulk-edit 5 consecutive runs of 100K records, starting from 1VU up to 5VU.  Average CPU for 1VU ~ 32%; 2VU ~ 43%; 3VU ~ 50%; 4VU ~ 52%; 5VU ~ 63%; 

...

Test 2.   Bulk-edit 100-1000-5000-10k records successively from 1VU up to 5VU. Average CPU for 1VU ~ 40%; 2VU ~ 51%; 3VU ~ 53%; 4VU ~ 62%; 5VU ~ 80%; 

Database connections

Test 1. Bulk-edit 5 consecutive runs of 100K records, starting from 1VU up to 5VU. The number of connections to the database did not exceed 200

...

Infrastructure

PTF -environment pcp1

• 11 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
• 2 instances of db.r6.xlarge database instances, one reader, and one writer
• MSK tenant
  
  • 4 m5.2xlarge brokers in 2 zones

  • Apache Kafka version 2.8.0

  • EBS storage volume per broker 300 GiB

  • auto.create.topics.enable=true
  • log.retention.minutes=480
  • default.replication.factor=3

...