/
Monitoring Pick Slip - NLA report

Monitoring Pick Slip - NLA report

Jun 15, 2023

Overview

Tests were conducted in scope of PERF-600: NLA: Test Monitoring Pick Slip IndividuallyClosed task to assess performance of the Monitoring Pick Slip functionality (MPS scenarios in JMeter script) and get the baseline numbers for future testing.

Summary

  • There is response time degradation in comparison with tests for all the workflows running at the same time. Deagradation was observed for requests /circulation/pick-slips/, /service-points  and /locations. Details can be found at the Test results part.

  • There is response time improvement for request /circulation/requests (19-30%) in comparison with tests for all the workflows running at the same time. Details can be found at the Test results part.

  • During load test no increase in CPU utilization was observed.

  • Service memory utilization was stable, and no memory leaks were suspected during tests.

Test Runs 

Test #

# configuration

Load

Test duration

Comment

Test #

# configuration

Load

Test duration

Comment

1

MPS scenarios

/circulation/pick-slips/<servicepointId> : 20 per minute

/circulation/requests : 1 per minute

/service-points : 1 per hour

/locations : 1 per hour

1 hour

Tests were conducted 3 times each, no differences in results were observed

Test Results

 Test results from 1st test run (1st, 2nd and 3rd test run results are similar):

 

 

Request name

Response time normal load

Response time high load

Individual workflow

All the workflows*

All the workflows + DI + FY*

All the workflows*

All the workflows + FY*

AVG (sec)

95 PCTL (sec)

AVG (sec)

95 PCTL (sec)

AVG (sec)

95 PCTL (sec)

AVG (sec)

95 PCTL (sec)

AVG (sec)

95 PCTL (sec)

MPS_Monitoring Pick Slips and Requests GET /circulation/requests

0.478

0.705

0.359

0.480 (-31%)

0.434

0.527 (-25%)

0.365

0.544 (-22%)

0.443

0.571 (-19%)

MPS_Monitoring Pick Slips and Requests GET /circulation/pick-slips/

0.060

0.113

0.112

0.256 (+126%)

0.106

0.312 (+178%)

0.130

0.303 (+168%)

0.112

0.376 (+232%)

MPS_Monitoring /service-points and  /locations (1 request per test)

0.136

0.136

0.303

0.303 (+122%)

0.297

0.297 (+118%)

0.112

0.112 (-17%)

0.233

0.233 (+71%)

*previous test results can be found here: Master Script normal load test - NLA report and Master Script high load test - NLA report (without Data Import)

Instance CPU Utilization

Instance CPU Utilization did not exceed 7,5%.


Service CPU Utilization

During load test no increase in CPU utilization was observed.

Service Memory Utilization

This graph represents memory usage of test runs and shows that no memory leak is suspected for all of the modules.

DB CPU Utilization

DB CPU usage was at the same level as without load - about 7,5%.

DB Connections

Connections count didn't change during the test.

 

Appendix

Infrastructure

PTF -environment ncp3 

  • 9 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1

  • 2 database  instances, one reader, and one writer

  • MSK ptf-kakfa-3

    • 4 m5.2xlarge brokers in 2 zones

    • Apache Kafka version 2.8.0

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=true

    • log.retention.minutes=480

    • default.replication.factor=3

  • Kafka topics partitioning: - 2 partitions for DI topics

 

Modules memory and CPU parameters

Modules

Version

Task Definition

Running Tasks 

CPU

Memory

MemoryReservation

MaxMetaspaceSize

Xmx

Modules

Version

Task Definition

Running Tasks 

CPU

Memory

MemoryReservation

MaxMetaspaceSize

Xmx

mod-inventory-storage

26.0.0

1

2

1024

2208

1952

384

1440

mod-inventory

20.0.4

1

2

1024

2880

2592

512

1814

mod-tags

2.0.1

1

2

128

1024

896

128

768

mod-gobi

2.6.0

1

2

128

1024

896

128

700

mod-remote-storage

2.0.2

1

2

1024

4920

4472

512

3960

mod-invoice-storage

5.6.0

1

2

128

1024

896

128

700

edge-sip2

3.0.0

1

2

128

1024

896

128

768

mod-users-bl

7.5.0

1

2

512

1440

1152

128

922

edge-rtac

2.6.0

1

2

128

1024

896

128

768

mod-feesfines

18.2.1

1

2

128

1024

896

128

768

mod-rtac

3.5.0

1

2

128

1024

896

128

768

mod-erm-usage-harvester

4.3.0

1

2

128

1024

896

128

768

mod-search

2.0.1

1

2

400

2592

2480

1024

1440

mod-service-interaction

2.2.2

1

2

256

2048

1844

512

1290

edge-ncip

1.8.1

1

2

128

1024

896

128

768

mod-authtoken

2.13.0

1

2

512

1440

1152

128

922

mod-permissions

6.3.1

2

2

512

1684

1544

512

1024

mod-circulation-storage

16.0.0

1

2

1024

1536

1440

512

896

mod-ncip

1.13.1

1

2

128

1024

896

128

768

mod-pubsub

2.9.1

1

2

1024

1536

1440

512

922

edge-orders

2.8.1

1

2

1024

1536

1440

512

922

mod-circulation

23.5.4

1

2