Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

In this workflow, we are checking the performance of exporting MARC Bib records workflow running in the Fameflower release - 

Jira Legacy
serverFOLIO Issue TrackerSystem Jira
serverId6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc
keyPERF-29

We tested with 1, 2 virtual users for 30 minutes.  A longevity test will also be executed to see if there were memory issues.

...

  1. Overall data export of Bib Marc record's time in seconds


    Average (minutes)75th %tile (minutes)

    1 inventory instance5 inventory instances6 inventory instances1 inventory  instance5 inventory instances6 inventory instances6 instances
    1 user1.305.966.72331.405.976.72
    2 users2.6611.1711.882.7512.8813.34

    Above data export jobs are run against 7.2 million SRS records. As we increase the number of inventory instance, export time linearly increases with the number of records. Data export fails after running with 6 instances. Since it is an asynchronous task, the export job does not fail immediately. So for example exporting 6 instances will eventually fail but will still take 6 minutes until it stops.

...

  • On average, we can improve performance by 50% if we remove redundant "EXPLAIN ANALYZE" query call on mod_source_record_storage.records table
  • Jira Legacy
    serverFOLIO Issue TrackerSystem Jira
    serverId6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc
    keyUIDEXP-107
  • Jira Legacy
    serverFOLIO Issue TrackerSystem Jira
    serverId6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc
    keyMODSOURCE-147
  • Jira Legacy
    serverFOLIO Issue TrackerSystem Jira
    serverId6ccf3fe401505d01-3301b853-368a3c2e-983e90f1-20c466b11a49ee9b165564fc
    keyMODSOURCE-148

Appendix

For more raw data of the test runs please see the attached data-export-test-report.xls.

...