Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

...

Ticket:

Jira Legacy
serverSystem JiraJIRA
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyPERF-243

...

Load tests showed that there is performance degradation of for 1 - 8 concurrent users tests users with 2000 loans each compared to those without loans.

For 20 concurrent users time of CO is almost the same for both but the degradation of API response time GET_circulation/loans (Submit_barcode_checkout) and GET_circulation/loans (Submit_patron_barcode) is about 5.6%.

Test Runs 

Test #

Test Conditions

Duration 

Load generator size (recommended)Load generator Memory(GiB) (recommended)

Notes


1.

Checkout with 1, 5, 8, and 20 users

30 mint3.medium3

ncp3 environment


Results

Response Times

Baseline (users without loans)

Image Added


Verification (users with 2000 loans)

At the end of 5 users' test, the response time of CO was 20 s

Image Added

Checkout response time comparison


Users quantity

Response time 95prc, sec


Degradation, sec


Degradation, %

Response time Avg, sec


Degradation, sec


Degradation, %

Baseline

(users without loans)

Verification

(users with 2000 loans each)

Baseline

(users without loans)

Verification

(users with 2000 loans each)

1 user1.1461.2690.123 s10.73%0.9501.0150.065 s6.84%
5 users1.0041.0710.067 s6.67%0.8520.9080.056 s6.57%
8 users0.9460.9950.049 s5.18%0.8370.8840.047 s5.62%
20 users0.9320.928-0.004 s-0.43%0.8500.85000.00%

API with degraded response time 95prc, all tests degradation


Degradation, %
API1 user5 users8 users20 users
GET_circulation/loans (Submit_barcode_checkout)5.61%18.62%8.70%5.67%
GET_circulation/loans (Submit_patron_barcode)10.16%18.00%9.35%5.67%

Instance CPU Utilization

Baseline (users without loans)

Image Added


Verification (users with 2000 loans)

...

Baseline (users without loans)

Image Added


Verification (users with 2000 loans)

Image Added

Memory Utilization

Baseline (users without loans)

mod-circulation memory utilization increases from 71% to 73%


Image Added

Verification (users with 2000 loans)

mod-circulation and mod-circulation-storage were restarted before the tests as you can see at the lowest memory utilization percent and then grow reaching baseline numbers.

Image Added

RDS CPU Utilization

Baseline (users without loans)


Image Added


Verification (users with 2000 loans)

Image Added

RDS DB connections

Baseline (users without loans)

Image Added


Verification (users with 2000 loans)

Image Added


Database Load

Baseline (users without loans)


Image Added

Verification (users with 2000 loans)

Image Added


Errors from modules logs

Code Block
13:20:03 [970766/circulation;909245/request-storage] [fs09000000] [9eb67301-6f6e-468f-9b1a-6134dc39a684] [mod_circulation_storage] ERROR PostgresClient Unrecognized field "title" (class org.folio.rest.jaxrs.model.Item), not marked as ignorable (one known property: "barcode"])


Code Block
13:24:41 [${FolioLoggingContext:requestid}] [${FolioLoggingContext:tenantid}] [${FolioLoggingContext:userid}] [${FolioLoggingContext:moduleid}] ERROR ?                    The timeout period of 20000ms has been exceeded while executing GET /circulation/rules/request-policy?item_type_id=025ba2c5-5e96-4667-a677-8186463aee69&loan_type_id=33f7f451-0923-4442-9191-0122c4042388&patron_type_id=5fc96cbd-a860-42a7-8d2b-72af30206712&location_id=38baf4b3-4fe7-47c1-826b-5d35e7b41018 for server pvt.lb.ncp3.folio-eis.us-east-1:9130


Appendix

Infrastructure

PTF -environment ncp3

...