...

• How long does it take to export 10K records?
•  What What happens to the job that is running, will it be able to resume and complete successfully when the new task is spun up? 
• Look for a memory trend and use it to decide on the number of concurrent jobs needed to reach the tipping point.  

Infrastructure

• 10 m6i.2xlarge EC2 instances  (changed. In Lotus it was m5.xlarge)
• 2 instances of db.r6.xlarge database instances, one reader and one writer
• MSK
  • 4 m5.2xlarge brokers in 2 zones
  • auto.create-topics.enable = true
  • log.retention.minutes=120
  • 2 partitions per DI topics

...

• All resources shows predictable behaviour without gaps and sudden spikes. 
• Memory usage growing on mod-orders (48%-56%) and mod-orders-storage (45%-51%). However it doesn’t looks like memory leak as it didn't grow continuously. It just grows at the beginning of subsequent exports. 

Knowing Known issue:

...