Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
Overview

...

  • Investigate memory growing trend for mod-inventory-storage in tests set #1 (using 1 instance HRID to create all Holdings).

Test Runs 

Profile used for testing - Default - Create Holdings and SRS MARC Holdings

Set of tests №ScenarioTest Conditions
1

DI Holdings Create (previous* approach)

1K, 5K, 10K, 80K sequentially 
2

DI Holdings Create (new** approach)

1K, 5K, 10K, 80K sequentially 

*previous approach - Data import Holdings with mrc file where 1 instance HRID is associated to all holdings (1k, 5k, 10k, 80k)

**new approach - Data import Holdings with mrc file where 1 instance HRID is associated to 1000 holdings 

Test Results

...

CPU (User) usage by broker



Open Search

CPU utilization master node

Image Added

CPU utilization data node

Image Added

Maximum free storage space (GiB)

Image Added

RDS CPU Utilization

For all tests - 95% except of DI Holdings with 1k file - 25%.

...

NameMemory GIBvCPUs
Engine version
db.r6g.xlarge
32 GB4 vCPUs
16.1
  • MSK tenant
    • 2 m5.2xlarge brokers in 2 zones
    • Apache Kafka version 2.8.0
    • EBS storage volume per broker 300 GiB
    • auto.create.topics.enable=true
    • log.retention.minutes=480
    • default.replication.factor=2
  • Open Search ptf-test
    • version OpenSearch_2_7_R20240502 
    • Data nodes
      • Instance type - r6g.2xlarge.search
      • Number of nodes - 4
      • Storage type - EBS
      • EBS volume size (GiB) - 500
    • Dedicated master nodes
      • Instance type - r6g.large.search
      • Number of nodes - 3
  • DB records 
    •  fs09000000
      • Instances - 25901331
      • Items - 27074913
      • Holdings - 25871735
    • fs07000001
      • Instances - 10100620
      • Items - 1484850
      • Holdings - 10522266
    • fs07000002
      • Instances - 1161275
      • Items - 1153548
      • Holdings - 1153548

...