PERF-151 - Getting issue details... STATUS
Overview:
As was observed, one okapi node working faster than three okapi nodes for same test. The purpose of this test set - is to define multi node okapi behavior and compare test results from tests with one okapi node and three okapi nodes.
Version:
- okapi 4.3.3;
- okapi 4.6.1.
Tests
| Test# | Test name | Virtual users | time | okapi version | nodes number |
|---|---|---|---|---|---|
| 1 | CheckIn-CheckOut | 8 | 1800 | 4.3.3 | 3 |
| 2 | CheckIn-CheckOut | 8 | 1800 | 4.3.3 | 1 |
| 3 | Get_loans | 8 | 1800 | 4.3.3 | 3 |
| 4 | Get_loans | 8 | 1800 | 4.3.3 | 1 |
| 5 | POST_circulation/check-in-by-barcode | 8 | 1800 | 4.3.3 | 3 |
| 6 | POST_circulation/check-in-by-barcode | 8 | 1800 | 4.3.3 | 1 |
| 7 | CheckIn-CheckOut | 8 | 1800 | 4.6.1 | 3 |
| 8 | CheckIn-CheckOut | 8 | 1800 | 4.6.1 | 1 |
Test summary
During the whole test set result doesn't show any consistency with response times. With okapi 4.3.3 version we can observe that there is a bigger difference in response times between three nodes and one node tests than with same test set for okapi 4.6.1.
Api tests (#3-6) shows results as was expected - three nodes test is faster or a least not slower than one node test.
Test results
Test 1-2
Here is the difference of response times for CheckIn-CheckOut workflow calculated by formula 3 nodes test response time minus 1 nodes test response time.
| Requests | 50th pct | 75th pct | 95th pct | 99th pct |
| Check-In Controller | 0,278 | 0,34 | 0,828 | 0,491 |
| Check-Out Controller | 0,372 | 0,494 | 1,697 | 3,139 |
| GET_accounts (Submit_patron_barcode) | 0,006 | 0,009 | 0,019 | 0,125 |
| GET_automated-patron-blocks (Submit_patron_barcode) | -0,003 | 0,014 | 0,025 | 0,193 |
| GET_circulation/loans (Submit_barcode_checkout) | 0,086 | 0,106 | 0,272 | 1,447 |
| GET_circulation/loans (Submit_patron_barcode) | 0,007 | 0,013 | 0,07 | 0,064 |
| GET_circulation/requests (Submit_barcode_checkin) | 0,012 | 0,013 | 0,055 | 0,077 |
| GET_circulation/requests (Submit_barcode_checkout) | 0,006 | 0,01 | 0,03 | 0,091 |
| GET_circulation/requests (Submit_patron_barcode) | 0,013 | 0,014 | 0,038 | 0,146 |
| GET_circulation/requests_status_openAwaitingPickup (Submit_patron_barcode) | 0,012 | 0,015 | 0,037 | 0,208 |
| GET_configurations/entries (Get_check_in_page) | 0,006 | 0,006 | 0,025 | 0,08 |
| GET_configurations/entries_module_CHECKOUT (Get_checkout_page) | 0,005 | 0,006 | 0,018 | 0,088 |
| GET_configurations/entries_module_USERS (Get_checkout_page) | 0,005 | 0,006 | 0,018 | 0,033 |
| GET_groups (Get_check_in_page) | 0,006 | 0,009 | 0,02 | 0,09 |
| GET_groups (Get_checkout_page) | 0,006 | 0,006 | 0,023 | 0,145 |
| GET_groups (Submit_patron_barcode) | 0,006 | 0,005 | 0,025 | 0,052 |
| GET_inventory/items (Submit_barcode_checkin) | 0,041 | 0,051 | 0,081 | 0,182 |
| GET_inventory/items (Submit_barcode_checkout) | 0,045 | 0,065 | 0,17 | 0,455 |
| GET_loan-policy-storage/loan-policies (Submit_barcode_checkout) | 0,009 | 0,012 | 0,037 | 0,128 |
| GET_manualblocks (Submit_patron_barcode) | 0,007 | 0,009 | 0,02 | 0,086 |
| GET_proxiesfor_proxyUserId (Submit_patron_barcode) | 0,006 | 0,007 | 0,017 | 0,079 |
| GET_proxiesfor_proxyUserId2 (Submit_patron_barcode) | 0,006 | 0,006 | 0,015 | 0,07 |
| GET_proxiesfor_userId (Submit_patron_barcode) | 0,006 | 0,007 | 0,014 | 0,06 |
| GET_service-points (Get_check_in_page) | 0,007 | 0,009 | 0,009 | -0,048 |
| GET_staff-slips-storage/staff-slips (Get_check_in_page) | 0,007 | 0,006 | 0,016 | 0,081 |
| GET_users (Get_check_in_page) | 0,006 | 0,006 | 0,021 | 0,076 |
| GET_users (Submit_patron_barcode) | 0,007 | 0,009 | 0,027 | -0,025 |
| OPTIONS_accounts (Submit_patron_barcode) | 0,001 | 0 | 0 | -0,002 |
| OPTIONS_automated-patron-blocks (Submit_patron_barcode) | 0,001 | 0 | 0 | 0,001 |
| OPTIONS_check-out-by-barcode (Submit_barcode_checkout) | 0 | 0,001 | 0,001 | -0,002 |
| OPTIONS_circulation/check-in-by-barcode (Submit_barcode_checkin) | 0 | 0 | 0,001 | 0,006 |
| OPTIONS_circulation/loans (Submit_barcode_checkout) | 0 | 0,001 | 0 | -0,001 |
| OPTIONS_circulation/loans (Submit_patron_barcode) | 0 | 0,001 | 0 | 0,001 |
| OPTIONS_circulation/requests (Submit_barcode_checkin) | 0,001 | 0,002 | 0,002 | 0,006 |
| OPTIONS_circulation/requests (Submit_barcode_checkout) | 0 | 0,001 | 0 | 0,002 |
| OPTIONS_circulation/requests_status_Open (Submit_patron_barcode) | 0,001 | 0 | 0,001 | 0,002 |
| OPTIONS_circulation/requests_status_OpenAwaitingPickup(Submit_patron_barcode) | 0 | 0,001 | 0 | -0,001 |
| OPTIONS_configurations/entries (Get_check_in_page) | 0 | 0,001 | 0,001 | 0,002 |
| OPTIONS_configurations/entries_module_CHECKOUT (Get_checkout_page) | 0 | 0,001 | 0,001 | 0,003 |
| OPTIONS_configurations/entries_module_USERS (Get_checkout_page) | 0 | 0,001 | 0 | 0,001 |
| OPTIONS_groups (Get_check_in_page) | 0,001 | 0 | 0,001 | 0,003 |
| OPTIONS_groups (Get_checkout_page) | 0,001 | 0 | 0,001 | 0 |
| OPTIONS_groups (Submit_patron_barcode) | 0 | 0,001 | 0,001 | -0,002 |
| OPTIONS_inventory/items (Submit_barcode_checkin) | 0 | 0,001 | 0,001 | 0 |
| OPTIONS_inventory/items (Submit_barcode_checkout) | 0 | 0 | -0,001 | 0,004 |
| OPTIONS_loan-policy-storage/loan-policies (Submit_barcode_checkout) | 0 | 0,001 | 0,001 | 0,001 |
| OPTIONS_manualblocks (Submit_patron_barcode) | 0 | 0,001 | 0 | -0,001 |
| OPTIONS_proxiesfor_proxyUserId (Submit_patron_barcode) | 0,001 | 0 | 0,001 | 0,001 |
| OPTIONS_proxiesfor_userID (Submit_patron_barcode) | 0,001 | 0 | 0,001 | 0,001 |
| OPTIONS_service-points (Get_check_in_page) | 0,001 | 0 | 0,001 | 0,003 |
| OPTIONS_staff-slips-storage/staff-slips (Get_check_in_page) | 0,001 | 0 | 0,001 | 0,001 |
| OPTIONS_users (Get_check_in_page) | 0 | 0,001 | 0,001 | 0,002 |
| OPTIONS_users (Submit_patron_barcode) | 0 | 0,001 | 0,001 | -0,001 |
| POST_bl-users/login | 0,08 | 0,084 | 0,049 | 0,049 |
| POST_circulation/check-in-by-barcode (Submit_barcode_checkin) | 0,19 | 0,232 | 0,46 | 1,112 |
| POST_circulation/check-out-by-barcode (Submit_barcode_checkout) | 0,119 | 0,178 | 0,532 | 1,674 |
| Util_Branch selector randomizer | 0 | 0,001 | 0 | -0,001 |
| Util_SWITCH User type | 0 | 0 | 0 | 0,001 |
As you can see the response times difference on 75% is bigger than 0, which means that one node performs better.
Test 3-4
| Requests | Min | 50th pct | 75th pct | 95th pct |
| GET_circulation/loans | -0,532 | -0,638 | -0,672 | -0,562 |
As you can see, response times difference here means that 3 nodes for this particular api test works faster than 1 node.