Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Table of Contents


Overview

Bulk Edit -

Jira Legacy
serverSystem JiraFOLIO Issue Tracker
serverId01505d016ccf3fe4-b8533301-3c2e368a-90f1983e-ee9b165564fc20c466b11a49
keyPERF-325
Establish a performance baseline for holdings bulk updates. 

...

Infrastructure

PTF -environment

  • 9 m6i.2xlarge EC2 instances located in US West (Oregon)us-west-2 AWS region (comparing to 10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 for Morning Glory release)
  • 2 instances of db.r6.xlarge database instances, one reader, and one writer
  • MSK ptf-kakfka-1
    • 4 m5.2xlarge brokers in 2 zones
    • Apache Kafka version 2.8.0

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=truec
    • log.retention.minutes=480
    • default.replication.factor=3

...

  • mod-data-export-worker-2.1.0-SNAPSHOT.851
  • mod-data-export-spring-1.5.0-SNAPSHOT.58
  • mod-agreements-5.4.0-SNAPSHOT.104
  • mod-notes-4.0.0-SNAPSHOT.237
  • mod-users-19.0.0-SNAPSHOT.573
  • mod-inventory-19.0.0-SNAPSHOT.383
  • mod-inventory-storage-25.0.0-SNAPSHOT.631
  • okapi-4.14.4

Summary 

Test report for Bulk Edits holdings-app functionality 2022-11-10. 

  • 10k records per user, 5 users simultaneously (50k records total) can be uploaded and updated in about 12 min 30 seconds total. 100k records of 1 user can be edited in about 2 hours 17 min
  • The files with identifiers should be strictly determined.
  • The memory usage of mod-data-export-worker increased from 40% to 76%  at the beginning of the tests and slightly grows further
    Jira Legacy
    serverSystem JiraFOLIO Issue Tracker
    serverId01505d016ccf3fe4-b8533301-3c2e368a-90f1983e-ee9b165564fc20c466b11a49
    keyPERF-328
    . All other modules' memory usage was stable.
  • CPU - for 5 parallel jobs - for mod-data-export-worker are spiking up to 155% at the start of tests( in general usage was about 8%). For all other modules did not exceed 40%.  For 100k records jobs, CPU utilization increases only when additional jobs start.
  • For all tests (100, 1k, and 10k -5 concurrent jobs, 100k records - 1job) - RDS CPU utilization did not exceed 50%.

...

Tests for 5 concurrent jobs


1 concurrent jobNolana

"BARCODE". Records number per 1 user

Time to uploadTime to edit - commit changesTotal time
10046 sec3 sec49 sec
10001 min 45 sec40 sec2 min 25 sec
10k6 min 10 sec6min 30 sec12 min 25 sec

Memory usage 5 concurrent jobs

mod-data-export-worker memory usage increased from 40% to 76%  at the beginning of the tests and slightly grows further

Jira Legacy
serverSystem JiraFOLIO Issue Tracker
serverId01505d016ccf3fe4-b8533301-3c2e368a-90f1983e-ee9b165564fc20c466b11a49
keyPERF-328
. All other modules' memory usage was stable.

...