...

• 8 million inventory records
• 74 FOLIO back-end modules deployed in 144 ECS services
• 3 okapi ECS services
• 12 m5.large  EC2 instances
• 1  writer db.r6g.xlarge 1 reader db.r6g.xlarge AWS RDS instance
• INFO logging level / WARN logging level
• mod-data-export Soft memory limit - 360 MB Hard memory limit - 512 MB

...

INFO level logging

WARN level logging

Check how many jobs can run in parallel

Multiple jobs can run in parallel but data-export fails if trying to export 3 Million instance records with the below configuration.

Current memory allocation to mod-data-export service in ECS task definition container:
Soft memory limit - 360 MB
Hard memory limit - 512 MB

Memory Utilization gradually increases from 101% to 141% as we increase the number of instance records where it eventually crashes.

...

When trying to export 3M records, POST data-export/file-definitions/d63d8a83-e339-44b2-8a2f-41caaf080221/upload fails with 503

Appendix

For more raw data of the test run please see the attached test-report-honeysuckle.xlsx for Honeysuckle.