PERF-151 - Getting issue details... STATUS

Overview:

As was observed, one okapi node working faster than three okapi nodes for same test. The purpose of this test set - is to define multi node okapi behavior and compare test results from tests with one okapi node and three okapi nodes.

Version:

okapi 4.3.3;
okapi 4.6.1.

Tests

Test#	Test name	Virtual users	time	okapi version	nodes number
1	CheckIn-CheckOut	8	1800	4.3.3	3
2	CheckIn-CheckOut	8	1800	4.3.3	1
3	Get_loans	8	1800	4.3.3	3
4	Get_loans	8	1800	4.3.3	1
5	POST_circulation/check-in-by-barcode	8	1800	4.3.3	3
6	POST_circulation/check-in-by-barcode	8	1800	4.3.3	1
7	CheckIn-CheckOut	8	1800	4.6.1	3
8	CheckIn-CheckOut	8	1800	4.6.1	1

Test summary

During the whole test set result doesn't show any consistency with response times. With okapi 4.3.3 version we can observe that there is a bigger difference in response times between three nodes and one node tests than with same test set for okapi 4.6.1.

Api tests (#3-6) shows results as was expected - three nodes test is faster or a least not slower than one node test.

Test results

Test 1-2

Here is the difference of response times for CheckIn-CheckOut workflow calculated by formula 3 nodes test response time minus 1 nodes test response time.

Requests	50th pct	75th pct	95th pct	99th pct
Check-In Controller	0,278	0,34	0,828	0,491
Check-Out Controller	0,372	0,494	1,697	3,139
GET_accounts (Submit_patron_barcode)	0,006	0,009	0,019	0,125
GET_automated-patron-blocks (Submit_patron_barcode)	-0,003	0,014	0,025	0,193
GET_circulation/loans (Submit_barcode_checkout)	0,086	0,106	0,272	1,447
GET_circulation/loans (Submit_patron_barcode)	0,007	0,013	0,07	0,064
GET_circulation/requests (Submit_barcode_checkin)	0,012	0,013	0,055	0,077
GET_circulation/requests (Submit_barcode_checkout)	0,006	0,01	0,03	0,091
GET_circulation/requests (Submit_patron_barcode)	0,013	0,014	0,038	0,146
GET_circulation/requests_status_openAwaitingPickup (Submit_patron_barcode)	0,012	0,015	0,037	0,208
GET_configurations/entries (Get_check_in_page)	0,006	0,006	0,025	0,08
GET_configurations/entries_module_CHECKOUT (Get_checkout_page)	0,005	0,006	0,018	0,088
GET_configurations/entries_module_USERS (Get_checkout_page)	0,005	0,006	0,018	0,033
GET_groups (Get_check_in_page)	0,006	0,009	0,02	0,09
GET_groups (Get_checkout_page)	0,006	0,006	0,023	0,145
GET_groups (Submit_patron_barcode)	0,006	0,005	0,025	0,052
GET_inventory/items (Submit_barcode_checkin)	0,041	0,051	0,081	0,182
GET_inventory/items (Submit_barcode_checkout)	0,045	0,065	0,17	0,455
GET_loan-policy-storage/loan-policies (Submit_barcode_checkout)	0,009	0,012	0,037	0,128
GET_manualblocks (Submit_patron_barcode)	0,007	0,009	0,02	0,086
GET_proxiesfor_proxyUserId (Submit_patron_barcode)	0,006	0,007	0,017	0,079
GET_proxiesfor_proxyUserId2 (Submit_patron_barcode)	0,006	0,006	0,015	0,07
GET_proxiesfor_userId (Submit_patron_barcode)	0,006	0,007	0,014	0,06
GET_service-points (Get_check_in_page)	0,007	0,009	0,009	-0,048
GET_staff-slips-storage/staff-slips (Get_check_in_page)	0,007	0,006	0,016	0,081
GET_users (Get_check_in_page)	0,006	0,006	0,021	0,076
GET_users (Submit_patron_barcode)	0,007	0,009	0,027	-0,025
OPTIONS_accounts (Submit_patron_barcode)	0,001	0	0	-0,002
OPTIONS_automated-patron-blocks (Submit_patron_barcode)	0,001	0	0	0,001
OPTIONS_check-out-by-barcode (Submit_barcode_checkout)	0	0,001	0,001	-0,002
OPTIONS_circulation/check-in-by-barcode (Submit_barcode_checkin)	0	0	0,001	0,006
OPTIONS_circulation/loans (Submit_barcode_checkout)	0	0,001	0	-0,001
OPTIONS_circulation/loans (Submit_patron_barcode)	0	0,001	0	0,001
OPTIONS_circulation/requests (Submit_barcode_checkin)	0,001	0,002	0,002	0,006
OPTIONS_circulation/requests (Submit_barcode_checkout)	0	0,001	0	0,002
OPTIONS_circulation/requests_status_Open (Submit_patron_barcode)	0,001	0	0,001	0,002
OPTIONS_circulation/requests_status_OpenAwaitingPickup(Submit_patron_barcode)	0	0,001	0	-0,001
OPTIONS_configurations/entries (Get_check_in_page)	0	0,001	0,001	0,002
OPTIONS_configurations/entries_module_CHECKOUT (Get_checkout_page)	0	0,001	0,001	0,003
OPTIONS_configurations/entries_module_USERS (Get_checkout_page)	0	0,001	0	0,001
OPTIONS_groups (Get_check_in_page)	0,001	0	0,001	0,003
OPTIONS_groups (Get_checkout_page)	0,001	0	0,001	0
OPTIONS_groups (Submit_patron_barcode)	0	0,001	0,001	-0,002
OPTIONS_inventory/items (Submit_barcode_checkin)	0	0,001	0,001	0
OPTIONS_inventory/items (Submit_barcode_checkout)	0	0	-0,001	0,004
OPTIONS_loan-policy-storage/loan-policies (Submit_barcode_checkout)	0	0,001	0,001	0,001
OPTIONS_manualblocks (Submit_patron_barcode)	0	0,001	0	-0,001
OPTIONS_proxiesfor_proxyUserId (Submit_patron_barcode)	0,001	0	0,001	0,001
OPTIONS_proxiesfor_userID (Submit_patron_barcode)	0,001	0	0,001	0,001
OPTIONS_service-points (Get_check_in_page)	0,001	0	0,001	0,003
OPTIONS_staff-slips-storage/staff-slips (Get_check_in_page)	0,001	0	0,001	0,001
OPTIONS_users (Get_check_in_page)	0	0,001	0,001	0,002
OPTIONS_users (Submit_patron_barcode)	0	0,001	0,001	-0,001
POST_bl-users/login	0,08	0,084	0,049	0,049
POST_circulation/check-in-by-barcode (Submit_barcode_checkin)	0,19	0,232	0,46	1,112
POST_circulation/check-out-by-barcode (Submit_barcode_checkout)	0,119	0,178	0,532	1,674
Util_Branch selector randomizer	0	0,001	0	-0,001
Util_SWITCH User type	0	0	0	0,001

As you can see the response times difference on 75% is bigger than 0, which means that one node performs better.

Requests	Min	50th pct	75th pct	95th pct
GET_circulation/loans	-0,532	-0,638	-0,672	-0,562

Okapi Clustered Behaviours - test report