...
In this workflow, we are checking the performance of exporting MARC Bib records workflow running in the Fameflower release -
Jira Legacy | ||||||
---|---|---|---|---|---|---|
|
We tested with 1, 2 virtual users for 30 minutes. A longevity test will also be executed to see if there were memory issues.
...
Overall data export of Bib Marc record's time in seconds
Average (minutes) 75th %tile (minutes) 1 inventory instance 5 inventory instances 6 inventory instances 1 inventory 1 instance 5 inventory instances6 inventory instances 6 instances 1 user 1.30 5.96 6.7233 1.40 5.97 6.72 2 users 2.66 11.17 11.88 2.75 12.88 13.34 Above data export jobs are run against 7.2 million SRS records. As we increase the number of inventory instance, export time linearly increases with the number of records. Data export fails after running with 6 instances. Since it is an asynchronous task, the export job does not fail immediately. So for example exporting 6 instances will eventually fail but will still take 6 minutes until it stops.
...
- On average, we can improve performance by 50% if we remove redundant "EXPLAIN ANALYZE" query call on mod_source_record_storage.records table
Jira Legacy server FOLIO Issue TrackerSystem Jira serverId 6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc key UIDEXP-107 Jira Legacy server FOLIO Issue TrackerSystem Jira serverId 6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc key MODSOURCE-147 Jira Legacy server FOLIO Issue TrackerSystem Jira serverId 6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc key MODSOURCE-148
Appendix
For more raw data of the test runs please see the attached data-export-test-report.xls.
...