[Sunflower] [ECS] Test Sharing Records' performance from member to central tenant

[Sunflower] [ECS] Test Sharing Records' performance from member to central tenant

Overview

This document contains the results of testing Sharing local instances(SLI) for MARC Source records. https://folio-org.atlassian.net/browse/PERF-1124 - Test Sharing Records' performance from member to central tenant

Summary

  • The duration on the first three tenants (cs00000int_0001 to cs00000int_0003) for one virtual user process is approximately the same, with an average of about 6.1 to 6.7 seconds. The duration on the last tenant (cs00000int_0004) is around 0.9 seconds, which is 10 and 5 seconds faster than in Quesnelia, respectively. For 2 virtual users, the duration is about 6.7 seconds on cs00000int_0001 and 5.8 seconds on cs00000int_0002. For 3 and 4 virtual users, duration remains around 6.7 seconds for cs00000int_0001 to cs00000int_0003, except for cs00000int_0004 at 0.9 to 0.9 seconds.

  • No memory leak is suspected for SLI modules.

  • Maximum CPU utilization was about 16% on mod-pubsub-b and mod-inn-reach 1VU-14%, 2VU-15%, 3VU-14%, 4VU-13%.

  • RDS CPU utilization was from 20% for 1VU and up to 40% for 4VU. That is three times less than in Quesnelia.

  • All virtual user processes finished successfully (without errors). Error rate = 0.

Test runs

Test 1 was run to get the number to evaluate the performance of the release versions

Test 1.1.[CSP1] was run to compare sunflower critical service patch performance. Ticket: https://folio-org.atlassian.net/browse/PERF-1185

Recommendations and Jiras

  • It's important to add parameters to the task definition to reduce local instance sharing time

    • "name": "JAVA_OPTS", "value": " -Dinventory.sharing.di.status.poll.interval.seconds=2"

Test results

Test 1. Virtual user working sequentially on each of the 4 tenants.

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

6653

0.06

0

6132

 

6600

 

8199

 

8199

cs00000int_0002

100

6119

0.06

0

1083

16016

7301

7301

cs00000int_0003

100

6141

0.06

0

5779

6057

8103

8103

cs00000int_0004

100

912

0.06

0

716

908

1098

1098

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

4640

0.07

0

3220

 

4100

 

16780

 

16800

cs00000int_0002

100

3535

0.07

0

1070

3442

5465

5465

cs00000int_0003

100

3178

0.08

0

2753

3080

5031

5031

cs00000int_0004

100

946

0.09

0

716

893

1829

1829

Test 2. Virtual users working in parallel on 2 tenants.

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

6657

0.06

0

6105

6611

7114

7114

cs00000int_0002

100

5839

0.05

0

1006

5826

7225

7225

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

3493

0.07

0

3009

3455

4287

4287

cs00000int_0002

100

3130

0.07

0

1015

3130

3852

3852

Test 3. Virtual users working parallel on 3 tenants

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

6669

0.06

0

6115

15984

7151

7151

cs00000int_0002

100

5723

0.05

0

1005

15967

8078

8078

cs00000int_0003

100

6231

0.06

0

5755

5951

8883

8883

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

3447

0.08

0

2988

3464

3758

3816

cs00000int_0002

100

3256

0.08

0

1073

3256

3874

3874

cs00000int_0003

100

2957

0.07

0

2630

2941

3519

3786

 

Test 4. Virtual users working parallel on 4 tenants

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

6551

0.06

0

6052

6503

7041

7041

cs00000int_0002

100

5745

0.05

0

1023

5707

7017

7032

cs00000int_0003

100

15536

0.15

0

15269

15528

15809

15809

cs00000int_0004

100

871

0.016

0

679

870

1109

1163

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

Tenant 

TTL REQ, COUNT

Average, MS

THRGHPT, REQ/SEC

ERRORS, COUNT

MIN, MS

MEDIAN, MS

PCT95, MS

MAX, MS

cs00000int_0001

100

3379

0.06

0

3025

3383

3735

3852

cs00000int_0002

100

3146