/
Master Script high load test - NLA report (without Data Import)

Master Script high load test - NLA report (without Data Import)

Jun 09, 2023

IN PROGRESS

Overview

 

In the scope of https://folio-org.atlassian.net/browse/PERF-531 it's needed to run tests to answer questions: 

  • Can the current System can accommodate a high use case load NLA load model investigation and creation?

  • What happened at peak times when all workflows are running at once? 

  • Typical KPIs:

    • Service CPU

    • Service Memory

    • DB CPU

    • DB Memory

  • Response times

  • Durations of long workflows

  • Recommendations to improve on scaling up/out modules to accommodate peak times

Summary

tested without Data Import due to https://folio-org.atlassian.net/browse/PERF-582

  • The current system can accommodate an average load without Data Import. With data import, we will have 'HTTP 500 Internal Server Error. If the issue persists, please report it to EBSCO Connect.' for several workflows in the source-storage/records/{id}/formatted requests https://folio-org.atlassian.net/browse/PERF-582.

  • Response time for high load (without DI & FYR) in general is the same as for normal load.

  • Service CPU utilization did not exceed 33% even at the beginning of all processes together.  Instance CPU Utilization did not exceed 13%.

  • Service memory utilization was stable, and no memory leaks were suspected during tests.

  • Each FYR (Fiscal close - end of FY rollover) job is consuming a lot of DB CPU. Approximately DB CPU usage is up to 95,2% with FYR and up to 75% without.

Recommendations & Jiras (Optional)

Jiras

https://folio-org.atlassian.net/browse/PERF-582

Test Runs & Results

Test #

# configuration

Test duration

comments

Test #

# configuration

Test duration

comments

1

All workflows started at the same time. Test without Data import

1 hour

NO server errors

2

All workflows started at the same time. Test without Data import

1 hour

NO server errors

3

All workflows started at the same time. Test without Data import

1 hour

NO server errors

 Test results from 1st test run (1st, 2nd and 3rd test run results are similar):

Test #

Workflow name 

Total time it takes to complete workflow

Comments

 

 

Avg (sec) high load with FYR

95th pct (sec) high load with FYR

Avg (sec) high load

95th pct (sec) high load

Avg (sec) normal load

95th pct (sec) normal load

1

Checkin

1.218

1.488

1.093

1.362

1.054

1.591

 

2

Checkout

2.272

2.780

1.830

2.187

1.650

1.948

 

3

View invoices

0.825

1.056

0.565

0.908

0.763

0.913

 

4

Create invoices

1.365

1.639

1.076

1.341

1.174

1.370

 

5

Edit invoices

1.734

2.509

0.531

1.749

1.581

1.897

 

6

Delete invoices

0.982

1.209

0.372

0.884

0.804

0.927

 

7

Approving Invoices

0.943

1.091

0.758

0.920

1.453

1.940

 

8

View Authority records

0.476

0.326

0.29

0.474

0.289

0.381

 

9

View MARC tag table

1.329

2.045

1.028

1.306

0.987

1.284

 

10

View holdings records

1.917

2.521

1.507

2.056

1.526

1.922

 

11

View Bib

1.027

1.359

0.808

1.171

0.841

1.168

 

12

View patron records

0.699

1.106

0.526

0.899

0.566

0.883

 

13

Delete patron records

1.016

1.264

0.627

1.109

0.638

1.070

 

14

Update patron records

1.412

2.138

0.976

1.615

1.043

1.625

 

15

Create patron records

1.273

1.569

0.972

1.308

1.098

1.261

 

16

View Ledger

0.060

0.102

0.054

0.085

0.050

0.088

 

17

Create ledger

0.723

0.923

0.661

0.798

0.616

0.761

 

18

Edit ledger

0.146

0.158

0.054

0.088

0.054

0.085

 

19

Delete a ledger

0.065

0.097

0.055

0.099

0.046

0.080

 

20

Export bib "Default instances export job profile"

16 sec (5000 records)

-

13 sec (5000 records)

-

5 sec  (5000 records)

-

 

21

Export holdings "Default holdings export job profile"

40 sec  (5000 records)

-

37 sec  (5000 records)

-

26 sec  (5000 records)

-

 

22

Export authority records "Default authority export job profile"

8 sec (5000 records)

-

5 sec (5000 records)

-

3 sec  (5000 records)

-

 

23

DI "DISC HRID match"

-

-

-

-

-

-

 

24

DI "DS LA edeposit records update"

-

-

-

-

-

-

 

25

DI "DISC New edeposit records"

-

-

-

-

-

-

 

26

DI "DISC New NON edeposit records"

-

-

-

-

-

-

 

27

View item records

1.545

1.984

1.221

1.598

1.289

1.649

 

28

update item records

1.134

1.460

0.920

1.212

0.998

1.250

 

29

delete item records

1.287

1.617

0.910

1.216

0.927

1.099

 

30

Monitoring Pick Slips and Requests GET /circulation/requests

0.443

0.571

0.365

0.544

0.359

0.480

 

31

Monitoring Pick Slips and Requests GET /circulation/pick-slips/