Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinetrue

...

This graph shows the durations of all workflows compared between tests.

Average Case workflows: Part 1.

 

Average Case workflows: Part 2.



This graph shows the total durations of all workflows compared between tests.

...

 WorkflowsBaseline
(high load)
Test 2
(high load)
AIE_TC: Create Invoices2259913458
AIE_TC: Invoices Approve211735251
AIE_TC: Paying Invoices216554919
CICO_TC_Check-In Controller42353322
CICO_TC_Check-Out Controller73865700
CSI_TC:Share local instance1403214781
DE_Exporting MARC Bib records custom workflow364405379912
DE_Exporting MARC Bib records workflow356786402026
EVA_TC: View Account913962
ILR_TC: Create ILR26972215
MSF_TC: mod search by auth query9061830
MSF_TC: mod search by boolean query276485
MSF_TC: mod search by contributors6001063
MSF_TC: mod search by filter query404713
MSF_TC: mod search by keyword query407658
MSF_TC: mod search by subject query7491112
MSF_TC: mod search by title query15482449
OPIH_/oai/records11044649
POO_TC: Add Order Lines10292199076
POO_TC: Approve Order7903679022
POO_TC Create Order5783756468
RTAC_TC: edge-rtac110284726
SDIC_Single Record Import (Create)2609520475
SDIU_Single Record Import (Update)3740036639
TC: Receiving-an-Order-Line14761983735
Serials-Receiving-Workflow14399486692
Unreceiving-a-Piece5074713729
ULR_TC: Users loan Renewal Transaction61764818

...


High Load workflows: Part 1.

Image Added


High Load workflows: Part 2.

Image Added

High Load workflows: Part 3.

Image Added


Resource utilization for Test №1

Baseline MCPT Environment configuration


...

Here we can't see any sign of memory leaks on every module. Memory shows stable trend.



Kafka metrics


DB CPU Utilization

DB CPU was 99% average with ERW: Exporting Receiving Information

...

Here we can't see any sign of memory leaks on every module. Memory shows stable trend.



Kafka metrics





DB CPU Utilization

DB CPU was 99% average with ERW: Exporting Receiving Information

...

Resource utilization for Test №3

The Baseline MCPT Environment configuration was applied, the instance type was changed to x2gd.xlarge, the number of instances was changed to 6, and CPU=0 was set for all services.

Service CPU Utilization

Here we can see that mod-permissions used 20% of the absolute CPU power of the container instance.

...

Here we can't see any sign of memory leaks on every module. Memory shows stable trend.



Kafka metrics






DB CPU Utilization

DB CPU was 64% maximum.

...

Resource utilization for Test №4

The Baseline MCPT Environment configuration was applied, the instance type was changed to x2gd.xlarge, the number of instances was changed to 8, and CPU=0 was set for all services.

Service CPU Utilization

Here we can see that okapi used 20% of the absolute CPU power of the container instance.

...

Here we can't see any sign of memory leaks on every module. Memory shows stable trend.



Kafka metrics






DB CPU Utilization

DB CPU was 91%.

...

Resource utilization for Test №5

The Baseline MCPT Environment configuration was applied, the instance type was changed to x2gd.large, the number of instances was changed to 10, and CPU=0 was set for all services.TT

Service CPU Utilization

...

Here we can't see any sign of memory leaks on every module. Memory shows stable trend.



Kafka metrics




DB CPU Utilization

DB CPU was 42%.

...

Resource utilization for Test №6

The Baseline MCPT Environment configuration was applied, the instance type was changed to r6g.xlarge, the number of instances was changed to 14 but 12 were used, and CPU=2 was set for all services.

Service CPU Utilization

Here we can see that okapi used 46000% CPU of unit power.

...

Inctanse CPU Utilization


Kafka metrics






DB CPU Utilization

DB CPU was 98%.

...

Resource utilization for Test №7

The Baseline MCPT Environment configuration was applied, the instance type was changed to r6g.xlarge, the number of instances was changed to 14, placement strategy was updated to "one task per host", and CPU=2 was set for all services.

Service CPU Utilization

Here we can see that okapi used 44000% of the unit CPU power.


Service Memory Utilization

Here we can't see any sign of memory leaks on every module. Memory shows stable trend.


...

Inctanse CPU Utilization


Kafka metrics






DB CPU Utilization

DB CPU was 98%.


DB Connections

Max number of DB connections was 5150.


DB load

                                                                                                                     

Top SQL-queries



Resource utilization for Test №8

The Baseline MCPT Environment configuration was applied, the instance type was changed to x2gd.large, the number of instances was changed to 14, placement strategy was updated to "one task per host", and CPU=2 was set for all services.

Service CPU Utilization

Here we can see that okapi used 38% of the unit CPU power.


Service Memory Utilization

Here we can't see any sign of memory leaks on every module. Memory shows stable trend.



Kafka metrics






DB CPU Utilization

DB CPU was maximum 53%.


DB Connections

Max number of DB connections was 3842.


DB load

                                                                                                                     

Top SQL-queries



...

PTF - Baseline MCPT environment configuration

  • 14 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
  • 1 database  instance, writer


    NameMemory GIBvCPUs

    db.r6g.4xlarge

    128 GiB16 vCPUs


  • Open Search ptf-test 
    • Data nodes
      • Instance type - r6g.2xlarge.search
      • Number of nodes - 4
      • Version: OpenSearch_2_7_R20240502
    • Dedicated master nodes
      • Instance type - r6g.large.search
      • Number of nodes - 3
  • MSK tenant
    • 4 m5.2xlarge brokers in 2 zones
    • Apache Kafka version 2.8.0

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=true
    • log.retention.minutes=480
    • default.replication.factor=3

...

Baseline MCPT Environment configuration according to tunning environment from previous report task count: 4 for services: mod-permissions, mod-search, mod-patron, mod-inventory, mod-inventory-storage, mod-circulation, mod-circulation-storage, mod-order, mod-order-storage, mod-invoice, mod-invoice-storage, for mod-users and mod-authtoken task count 6. Parameter srs.marcIndexers.delete.interval.seconds=86400 for mod-source-record-storage. Instance type: m6g.2xlargeInstances count: 14Database r6g.4xlargeAmazon OpenSearch Service  ptf-testr6g.2хlarge.search (4 nodes).

...