Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

...

This document contains the results of testing List App refreshing of records in the Ramsons release for Contains any, Contains all, Not contains any, Not contains all Operators.

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyPERF-892

Summary


  • Some lists can’t be created at all, and even if they are, there's a high chance they’ll fail when trying to refresh.
  • Memory utilization increasing for mod-fgm-manager up to 80% during lists refresh then goes down in few minutes - OOM issue for mod-fqm-manager
    Jira Legacy
    serverSystem Jira
    serverId01505d01-b853-3c2e-90f1-ee9b165564fc
    keyMODFQMMGR-501
    but only for creating new lists while the test query is running.
  • For mod-lists, CPU utilization was up to 237% for the test with 10 concurrent users and R/W split enabled. Average CPU usage did not exceed 14 % for all other modules.
  • Approximately DB CPU usage is up to 98.5%.

...

mod-lists & mod-fqm-manager

Service CPU Utilization 

Service CPU Utilization without mod-fqm-manager

Service CPU Utilization with mod-fqm-manager

mod-lists



RDS CPU Utilization 

...

  • 10 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 

  • 1 instance of 2 instances of db.r6g.8xlargexlarge database, writer instance, and reader instance.

  • MSK - fse-tenant
    4 kafka.m7g.xlarge brokers in 2 zones

    • Apache Kafka version 3.7.x

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=true

    • log.retention.minutes=480

    • default.replication.factor=3

  • OpenSearch ptf-testcluster

    • OpenSearch version 2.13

    • Data nodes

      • Availability Zone(s) - 2-AZ without standby

      • Instance type - r6g.2xlarge.search

      • Number of nodes - 4

      • EBS volume size (GiB) - 300

      • Provisioned IOPS - 3000IOPS

      • Provisioned Throughput (MiB/s) - 250 MiB/s

Module versions

  • mod-fqm-manager -R/W split enabled

Cluster Resources - rcp1










Module

Task Definition Revision

Module Version

Task Count

Mem Hard Limit

Mem Soft Limit

CPU Units

Xmx

Metaspace Size

Max Metaspace Size

mod-

...

authtoken

1

mod-

...

authtoken:

...

2.

...

16.

...

0-SNAPSHOT.

...

303

2

...

1440

...

1152

...

512

...

922

...

88

...

128

mod-

...

configuration

1

mod-

...

configuration:

...

5.

...

11.

...

0-SNAPSHOT.

...

355

2

1024

896

0

768

88

128

mod-

...

orders-storage

1

mod-

...

orders-storage:13.8.

...

0-SNAPSHOT.

...

243

2

1024

896

...

512

700

88

128

mod-

...

fqm-manager

...

10

mod-

...

fqm-manager:

...

2.1.0-SNAPSHOT.

...

1197

2

...

3000

...

2600

...

128

...

2048

...

384

...

512

mod-

...

finance

1

mod-

...

finance:

...

5.

...

0.0-SNAPSHOT.

...

174

2

...

1024

...

896

...

0

700

88

128

...

256

mod-

...

lists

...

5

mod-

...

lists:2.

...

1.0-SNAPSHOT.

...

1303

2

1024

896

0

...

768

88

128

...

mod-entities-

...

links

...

4

...

mod-entities-

...

links:3.

...

1.0-SNAPSHOT.

...

113

2

...

2592

...

2480

...

400

...

1440

...

0

...

1024

mod-

...

permissions

...

2

mod-

...

permissions:

...

6.6.0

...

-SNAPSHOT.

...

385

2

...

1684

...

1544

...

512

...

1024

...

384

...

512

mod-

...

orders

1

mod-

...

orders:

...

12.

...

9.0-SNAPSHOT.

...

398

2

...

2048

...

1440

...

1024

...

1024

384

512

edge-

...

patron

1

edge-

...

patron:5.2.

...

0-SNAPSHOT.

...

174

...

2

1024

896

...

256

768

88

128

mod-

...

invoice

1

mod-

...

invoice:

...

5.

...

9.0-SNAPSHOT.

...

205

...

2

...

1440

...

1152

...

512

...

922

...

88

...

128

mod-

...

inventory-storage

...

4

mod-

...

inventory-storage:

...

27.

...

2.0-SNAPSHOT.

...

773

2

...

4096

...

3690

2048

...

3076

512

1024

mod-

...

circulation-

...

storage

1

mod-

...

circulation-

...

storage:17.3.

...

0-SNAPSHOT.

...

405

2

...

2880

2592

...

1536

...

1814

...

384

512

...

1024

mod-source-record-

...

storage

...

2

mod-source-record-

...

storage:

...

5.

...

9.0-SNAPSHOT.

...

405

2

...

5600

...

5000

...

2048

...

3500

...

384

...

512

mod-

...

inventory

1

mod-

...

inventory:

...

20.

...

3.

...

0-SNAPSHOT.

...

546

2

...

2880

...

2592

...

1024

...

1814

...

384

...

512

mod-

...

users

1

mod-

...

users:

...

19.

...

3.

...

2-SNAPSHOT.

...

696

2

...

1024

...

896

...

0

...

768

88

128

edge-

...

fqm

1

edge-

...

fqm:2.1

...

.0-SNAPSHOT.

...

100

2

1024

896

0

768

88

128

mod-

...

source-record-manager

1

mod-source-record-

...

manager:3.

...

9.

...

0-SNAPSHOT.

...

353

2

...

5600

...

5000

...

2048

...

3500

...

384

...

512

...

nginx-

...

edge

1

...

nginx-

...

edge:

...

2023.

...

06.14

2

1024

896

0

...

0

...

0

...

0

...

nginx-

...

okapi

1

...

nginx-

...

okapi:

...

2023.

...

06.14

2

1024

896

0

...

0

...

0

...

0

...

okapi-

...

b

1

...

mod-orders-storage:13.8.0-SNAPSHOT.243

...

2

...

1024

...

896

...

512

...

700

...

88

...

128

...

edge-caiasoft

...

1

okapi:5.3.0

3

1684

1440

1024

922

384

512

mod-invoice-storage

1

mod-invoice-storage:5.9.0-SNAPSHOT.

...

138

2

...

1872

...

1536

...

1024

...

1024

...

384

...

512

mod-

...

service-

...

interaction

1

mod-

...

service-

...

interaction:

...

4.

...

1.0-SNAPSHOT.

...

126

2

...

2048

...

1844

...

256

...

1290

...

384

...

512

mod-

...

login

1

mod-

...

login:7.12.0-SNAPSHOT.

...

324

2

...

1440

...

1298

...

1024

768

...

384

...

512

mod-

...

organizations-

...

storage

1

mod-

...

organizations-

...

storage:

...

4.

...

8.

...

0-SNAPSHOT.

...

131

2

...

1024

...

896

0

...

700

...

88

...

128

...

pub-

...

okapi

1

...

pub-

...

okapi:

...

2023.

...

06.14

2

1024

896

0

...

768

...

0

...

0

...

mod-licenses

fqm-manager revision

Expand
titlemod-

...

2

...

2480

...

2312

...

0

...

1792

...

384

...

512

...

edge-dcb

...

1

...

edge-dcb:1.2.0-SNAPSHOT.39

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-bulk-operations

...

1

...

mod-bulk-operations:2.1.0-SNAPSHOT.119

...

2

...

3072

...

2600

...

1024

...

1536

...

384

...

512

...

mod-fqm-manager

...

10

...

mod-fqm-manager:2.1.0-SNAPSHOT.1197

...

2

...

3000

...

2600

...

128

...

2048

...

384

...

512

...

mod-graphql

...

1

...

mod-graphql:1.12.1.412

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-finance

...

1

...

mod-finance:5.0.0-SNAPSHOT.174

...

2

...

1024

...

896

...

0

...

700

...

88

...

128

...

mod-erm-usage

...

1

...

mod-erm-usage:5.0.0-SNAPSHOT.109

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-batch-print

...

1

...

mod-batch-print:1.2.0-SNAPSHOT.15

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-tlr

...

2

...

mod-tlr:1.0.0-SNAPSHOT.8

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-lists

...

5

...

mod-lists:2.1.0-SNAPSHOT.1303

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-copycat

...

1

...

mod-copycat:1.6.1-SNAPSHOT.208

...

2

...

1024

...

512

...

0

...

768

...

88

...

128

...

mod-entities-links

...

4

...

mod-entities-links:3.1.0-SNAPSHOT.113

...

2

...

2592

...

2480

...

400

...

1440

...

0

...

1024

...

mod-permissions

...

2

...

mod-permissions:6.6.0-SNAPSHOT.385

...

2

...

1684

...

1544

...

512

...

1024

...

384

...

512

...

pub-edge

...

1

...

pub-edge:2023.06.14

...

2

...

1024

...

896

...

0

...

768

...

0

...

0

...

mod-orders

...

1

...

mod-orders:12.9.0-SNAPSHOT.398

...

2

...

2048

...

1440

...

1024

...

1024

...

384

...

512

...

edge-patron

...

1

...

edge-patron:5.2.0-SNAPSHOT.174

...

2

...

1024

...

896

...

256

...

768

...

88

...

128

...

edge-ncip

...

1

...

edge-ncip:1.10.2-SNAPSHOT.116

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-marc-migrations

...

26

...

mod-marc-migrations:1.0.0-SNAPSHOT.8

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

edge-inn-reach

...

1

...

edge-inn-reach:3.3.0-SNAPSHOT.69

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-users-bl

...

1

...

mod-users-bl:7.9.0-SNAPSHOT.318

...

2

...

1440

...

1152

...

512

...

922

...

88

...

128

...

mod-oa

...

1

...

mod-oa:2.1.0-SNAPSHOT.66

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-invoice

...

1

...

mod-invoice:5.9.0-SNAPSHOT.205

...

2

...

1440

...

1152

...

512

...

922

...

88

...

128

...

mod-inventory-storage

...

4

...

mod-inventory-storage:27.2.0-SNAPSHOT.773

...

2

...

4096

...

3690

...

2048

...

3076

...

512

...

1024

...

mod-user-import

...

1

...

mod-user-import:3.9.0-SNAPSHOT.197

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-sender

...

1

...

mod-sender:1.12.1-SNAPSHOT.100

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

edge-oai-pmh

...

1

...

edge-oai-pmh:2.10.0-SNAPSHOT.174

...

2

...

1512

...

1360

...

1024

...

1440

...

384

...

512

...

mod-data-export-worker

...

1

...

mod-data-export-worker:3.3.0-SNAPSHOT.233

...

2

...

3072

...

2048

...

1024

...

2048

...

384

...

512

...

mod-rtac

...

1

...

mod-rtac:3.7.0-SNAPSHOT.203

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-circulation-storage

...

1

...

mod-circulation-storage:17.3.0-SNAPSHOT.405

...

2

...

2880

...

2592

...

1536

...

1814

...

384

...

512

...

mod-source-record-storage

...

2

...

mod-source-record-storage:5.9.0-SNAPSHOT.405

...

2

...

5600

...

5000

...

2048

...

3500

...

384

...

512

...

mod-calendar

...

2

...

mod-calendar:3.2.0-SNAPSHOT.229

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-event-config

...

1

...

mod-event-config:2.7.2-SNAPSHOT.110

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-courses

...

1

...

mod-courses:1.4.11-SNAPSHOT.155

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-circulation-item

...

1

...

mod-circulation-item:1.0.1-SNAPSHOT.26

...

2

...

1024

...

896

...

0

...

0

...

0

...

0

...

mod-inventory

...

1

...

mod-inventory:20.3.0-SNAPSHOT.546

...

2

...

2880

...

2592

...

1024

...

1814

...

384

...

512

...

mod-email

...

1

...

mod-email:1.17.1-SNAPSHOT.128

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-requests-mediated

...

10

...

mod-requests-mediated:1.0.0-SNAPSHOT.4

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-di-converter-storage

...

1

...

mod-di-converter-storage:2.3.0-SNAPSHOT.124

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-pubsub

...

1

...

mod-pubsub:2.15.0-SNAPSHOT.224

...

2

...

1536

...

1440

...

1024

...

922

...

384

...

512

...

mod-circulation

...

1

...

mod-circulation:24.3.0-SNAPSHOT.681

...

2

...

2880

...

2592

...

1536

...

1814

...

384

...

512

...

edge-orders

...

1

...

edge-orders:3.1.0-SNAPSHOT.156

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

edge-rtac

...

1

...

edge-rtac:2.7.3-SNAPSHOT.234

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-template-engine

...

1

...

mod-template-engine:1.20.1-SNAPSHOT.118

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-users

...

1

...

mod-users:19.3.2-SNAPSHOT.696

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-patron-blocks

...

1

...

mod-patron-blocks:1.11.0-SNAPSHOT.163

...

2

...

1024

...

896

...

1024

...

768

...

88

...

128

...

mod-audit

...

1

...

mod-audit:2.9.1-SNAPSHOT.216

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

edge-fqm

...

1

...

edge-fqm:2.1.0-SNAPSHOT.100

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-source-record-manager

...

1

...

mod-source-record-manager:3.9.0-SNAPSHOT.353

...

2

...

5600

...

5000

...

2048

...

3500

...

384

...

512

...

nginx-edge

...

1

...

nginx-edge:2023.06.14

...

2

...

1024

...

896

...

0

...

0

...

0

...

0

...

mod-quick-marc

...

1

...

mod-quick-marc:5.2.0-SNAPSHOT.153

...

1

...

2288

...

2176

...

0

...

1664

...

384

...

512

...

nginx-okapi

...

1

...

nginx-okapi:2023.06.14

...

2

...

1024

...

896

...

0

...

0

...

0

...

0

...

okapi-b

...

1

...

okapi:5.3.0

...

3

...

1684

...

1440

...

1024

...

922

...

384

...

512

...

mod-feesfines

...

1

...

mod-feesfines:19.2.0-SNAPSHOT.198

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-invoice-storage

...

1

...

mod-invoice-storage:5.9.0-SNAPSHOT.138

...

2

...

1872

...

1536

...

1024

...

1024

...

384

...

512

...

mod-reading-room

...

2

...

mod-reading-room:1.0.0-SNAPSHOT.12

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-service-interaction

...

1

...

mod-service-interaction:4.1.0-SNAPSHOT.126

...

2

...

2048

...

1844

...

256

...

1290

...

384

...

512

...

mod-dcb

...

1

...

mod-dcb:1.1.3-SNAPSHOT.40

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-data-export

...

1

...

mod-data-export:5.1.0-SNAPSHOT.240

...

1

...

2048

...

1524

...

1024

...

0

...

0

...

0

...

mod-patron

...

1

...

mod-patron:6.2.0-SNAPSHOT.165

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-oai-pmh

...

1

...

mod-oai-pmh:3.14.0-SNAPSHOT.402

...

2

...

4096

...

3690

...

2048

...

3076

...

384

...

512

...

edge-connexion

...

1

...

edge-connexion:1.4.0-SNAPSHOT.88

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-notes

...

1

...

mod-notes:5.3.0-SNAPSHOT.325

...

2

...

1024

...

896

...

0

...

952

...

384

...

512

...

mod-kb-ebsco-java

...

1

...

mod-kb-ebsco-java:4.2.0-SNAPSHOT.178

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

...

mod-login

...

1

...

mod-login:7.12.0-SNAPSHOT.324

...

2

...

1440

...

1298

...

1024

...

768

...

384

...

512

...

mod-organizations-storage

...

1

...

mod-organizations-storage:4.8.0-SNAPSHOT.131

...

2

...

1024

...

896

...

0

...

700

...

88

...

128

...

mod-data-export-spring

...

1

...

mod-data-export-spring:3.3.1-SNAPSHOT.167

...

1

...

2048

...

1844

...

256

...

1536

...

384

...

512

...

pub-okapi

...

1

...

pub-okapi:2023.06.14

...

2

...

1024

...

896

...

0

...

768

...

0

...

0

...

mod-eusage-reports

...

1

...

mod-eusage-reports:3.0.0-SNAPSHOT.73

...

2

...

1024

...

896

...

0

...

768

...

88

...

128

fqm-manager, rivision #10
"cpu": 128,
"memory": 3000,
"memoryReservation": 2600

{
"name": "mod-fqm-manager.query-retention-duration",
"value": "24h"
}

{
"name": "MAX_QUERY_SIZE",
"value": "30000000"
}

{
"name": "task.execution.pool.core-size",
"value": "9"
}


mod-list revision

Expand
titlemod-list, rivision #5

"name": "mod-lists",
"cpu": 0,
"memory": 1024,
"memoryReservation": 896,

{
"name": "MAX_LIST_SIZE",
"value": "20000000"
}

{
"name": "FOLIO_SYSTEM_USER_ENABLED",
"value": "true"
},

{
"name": "mod-lists.general.refresh-query-timeout-minutes",
"value": "1440"
},



Methodology/Approach

To test Baseline for List refresh JMeter scripts were used.

Test preparation: 

...

  • New lists created with Contains any, Contains all, Not contains any, Not contains all Operators

Refresh list for 1,

...

4,

...

8, and 10 concurrent users tested