Check-in/check-out with parallel requests

Test objectives

Perform check-in/check-out test with parallel requests to imitate FOLIO UX as much as it is possible. According to https://folio-org.atlassian.net/browse/PERF-220

General test conditions

Software versions
  • mod-circulation-23.0.8
  • mod-circulation-storage-14.0.0
  • mod-inventory-18.1.6
  • mod-inventory-storage- 23.0.2
  • mod-authtoken-2.9.1
  • mod-pubsub-2.5.0
  • mod-patron-blocks-1.5.2
  • mod-feesfines-17.1.1
  • okapi- 4.13.2

Tests performed

Two types of tests have been modified and executed:

  1. Smoke test – to check functional readiness of tests.
  2. Baseline tests – to check load abilities.

Smoke test

Test duration: 1 loop;
Load type: ramp-up 1, 1 user.


 Baseline tests

1st

Test duration: 30 minutes;
Load type: ramp-up -1 sec, user -1.

2nd

Test duration: 30 minutes;
Load type: ramp-up -80 sec, users -8.


Test results

  Smoke test

The JMeter tests work properly, and the Load test can be performed

   Baseline test 1st (1 user)

Performed baseline test with parallel requests has shown that the total number of requests for check-in increases by 19.15%, but at the same time the average response time increases by 28.18% in general, and for check-out total number of requests increases by 15.56%, but at the same time the average response time increases by 30.15%, in general, comparing to test with no parallel requests.


Without parallel requests

http://carrier-io.int.folio.ebsco.com/grafana/d/elIt9zCnz/jmeter-performance-test-copy?orgId=1&from=1656673603163&to=1656675730833&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All


With parallel requests

http://carrier-io.int.folio.ebsco.com/grafana/d/elIt9zCnz/jmeter-performance-test-copy?orgId=1&from=1656675985093&to=1656678021203&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_p&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

Resources usage

There is almost no difference in resource usage between these tests performed for 1 user.


Baseline test 2nd (8 users)

Performed baseline test with parallel requests has shown that the total number of requests for check-in increases by 21.51%, but at the same time the average response time increases by 34.81% in general, and for check-out total number of requests increases by 13.43%, but at the same time the average response time increases by 34.10%, in general, comparing to test with no parallel requests.


Without parallel requests

http://carrier-io.int.folio.ebsco.com/grafana/d/elIt9zCnz/jmeter-performance-test-copy?orgId=1&from=1657005730935&to=1657007613565&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All

With parallel requests

http://carrier-io.int.folio.ebsco.com/grafana/d/elIt9zCnz/jmeter-performance-test-copy?orgId=1&from=1657008552607&to=1657010503861&var-percentile=95&var-test_type=baseline&var-test=circulation_checkInCheckOut_p&var-env=int&var-grouping=1s&var-low_limit=250&var-high_limit=750&var-db_name=jmeter&var-sampler_type=All



Resources usage