/
MOBIUS Baseline Tests: CI/CO multi tenants

MOBIUS Baseline Tests: CI/CO multi tenants

Mar 07, 2024

Overview

  • This document contains the results of testing MOBIUS Baseline Tests: CI/CO. Ticket: PERF-730

https://folio-org.atlassian.net/browse/PERF-730

Summary

  • Three tests were run successfully and without errors on the Mobius-performacne testing cluster (mcpt).

  • No sign of memory leaks on every module. Memory shows stable trend.

  • CI/CO for small tenants IDs has a response time of 15% longer than for large tenants IDs.

  • No modules are showing a growing CPU trend or any spikes. 

  • The CI/CO response time for small tenants IDs with less load is 20% longer than with double load, indicating that CICO works better under a load.

Test Runs 

Test №

Date

Test Conditions

Results

1.

Mar 4, 2024, 5:42 PM UTC

1 CI or CO per min for small tenants, 2 CICO per min for large tenants

Completed

2.

Mar 4, 2024, 8:19 PM UTC

2 CI or CO per min for small tenants, 4 CICO per min for large tenants

Completed

3.

Mar 5, 2024, 2:39 PM UTC

4 CICO per min for one large tenant

Completed

Test Results

Test №1

1CI/CO Small + 2CICO Large

Requests

Total per tenant

50th pct

75th pct

95th pct

 

99th pct

Average

Requests

Total per tenant

50th pct

75th pct

95th pct

 

99th pct

Average

Small tenants - check-in

27

0.992

1.082

1.397

1.831

1.033

Small tenants - checkout

27

1.782

1.964

2.335

2.727

1.831

Large tenants - check-in

92

0.653

0.736

1.024

1.446

0.699

Large tenants - checkout

86

1.217

1.344

1.556

1.894

1.257

Requests Total 50th pct 75th pct 95th pct 99th pct Average CICO_TC_Check-Out Controller_cs00000001_0038 25 2.053 2.293 3.029 3.032 2.125 CICO_TC_Check-Out Controller_cs00000001_0032 24 1.952 2.176 2.856 2.945 2.024 CICO_TC_Check-Out Controller_cs00000001_0028 26 1.829 2.081 2.842 3.498 1.953 CICO_TC_Check-Out Controller_cs00000001_0019 24 1.901 2.029 2.554 2.864 1.943 CICO_TC_Check-Out Controller_cs00000001_0016 23 1.807 2.056 2.803 3.414 1.938 CICO_TC_Check-Out Controller_cs00000001_0010 19 1.815 1.967 2.653 2.780 1.933 CICO_TC_Check-Out Controller_cs00000001_0045 26 1.859 2.051 2.359 2.435 1.917 CICO_TC_Check-Out Controller_cs00000001_0046 23 1.817 1.934 2.077 4.394 1.910 CICO_TC_Check-Out Controller_cs00000001_0057 22 1.796 2.141 2.479 2.828 1.896 CICO_TC_Check-Out Controller_cs00000001_0011 29 1.755 2.161 2.672 2.825 1.888 CICO_TC_Check-Out Controller_cs00000001_0049 25 1.823 2.034 2.585 2.615 1.888 CICO_TC_Check-Out Controller_cs00000001_0056 21 1.855 1.948 2.109 2.972 1.885 CICO_TC_Check-Out Controller_cs00000001_0021 22 1.857 1.980 2.475 2.777 1.881 CICO_TC_Check-Out Controller_cs00000001_0029 27 1.891 1.969 2.406 2.595 1.871 CICO_TC_Check-Out Controller_cs00000001_0052 25 1.842 2.037 2.153 2.513 1.868 CICO_TC_Check-Out Controller_cs00000001_0055 20 1.931 2.032 2.220 2.355 1.868 CICO_TC_Check-Out Controller_cs00000001_0039 22 1.817 1.993 2.479 2.608 1.863 CICO_TC_Check-Out Controller_cs00000001_0005 25 1.851 2.034 2.300 2.357 1.858 CICO_TC_Check-Out Controller_cs00000001_0044 25 1.879 1.974 2.298 2.591 1.857 CICO_TC_Check-Out Controller_cs00000001_0020 24 1.813 2.023 2.205 3.641 1.855 CICO_TC_Check-Out Controller_cs00000001_0026 25 1.733 1.965 2.574 3.367 1.855 CICO_TC_Check-Out Controller_cs00000001_0033 24 1.864 1.994 2.120 2.329 1.848 CICO_TC_Check-Out Controller_cs00000001_0025 24 1.798 1.908 2.716 2.795 1.840 CICO_TC_Check-Out Controller_cs00000001_0004 29 1.806 2.030 2.352 2.668 1.833 CICO_TC_Check-Out Controller_cs00000001_0023 29 1.860 2.026 2.313 2.386 1.831 CICO_TC_Check-Out Controller_cs00000001_0031 25 1.814 2.039 2.161 2.788 1.831 CICO_TC_Check-Out Controller_cs00000001_0060 34 1.704 2.019 2.549 2.799 1.828 CICO_TC_Check-Out Controller_cs00000001_0030 32 1.714 2.037 2.581 2.758 1.825 CICO_TC_Check-Out Controller_cs00000001_0018 22 1.815 1.932 2.222 2.353 1.819 CICO_TC_Check-Out Controller_cs00000001_0040 30 1.768 1.982 2.353 2.539 1.817 CICO_TC_Check-Out Controller_cs00000001_0002 23 1.846 1.930 2.054 2.681 1.816 CICO_TC_Check-Out Controller_cs00000001_0034 28 1.730 1.853 2.539 2.597 1.815 CICO_TC_Check-Out Controller_cs00000001_0012 29 1.705 1.871 2.703 3.061 1.814 CICO_TC_Check-Out Controller_cs00000001_0007 33 1.760 1.995 2.148 2.626 1.812 CICO_TC_Check-Out Controller_cs00000001_0022 32 1.704 1.873 2.227 3.489 1.810 CICO_TC_Check-Out Controller_cs00000001_0041 27 1.754 1.953 2.204 2.757 1.809 CICO_TC_Check-Out Controller_cs00000001_0015 23 1.784 1.940 2.156 2.259 1.801 CICO_TC_Check-Out Controller_cs00000001_0036 20 1.832 1.942 2.066 2.162 1.800 CICO_TC_Check-Out Controller_cs00000001_0048 31 1.718 1.850 2.325 2.784 1.799 CICO_TC_Check-Out Controller_cs00000001_0017 25 1.780 2.003 2.206 2.320 1.798 CICO_TC_Check-Out Controller_cs00000001_0061 32 1.724 1.965 2.170 2.800 1.797 CICO_TC_Check-Out Controller_cs00000001_0047 27 1.734 1.958 2.316 2.522 1.795 CICO_TC_Check-Out Controller_cs00000001_0008 24 1.813 1.948 2.170 2.257 1.785 CICO_TC_Check-Out Controller_cs00000001_0027 31 1.703 1.877 2.311 3.142 1.785 CICO_TC_Check-Out Controller_cs00000001_0001 26 1.683 1.919 2.145 2.794 1.777 CICO_TC_Check-Out Controller_cs00000001_0050 29 1.794 1.867 2.301 2.940 1.776 CICO_TC_Check-Out Controller_cs00000001_0003 27 1.636 1.901 2.246 3.410 1.773 CICO_TC_Check-Out Controller_cs00000001_0062 27 1.744 1.897 2.161 2.163 1.765 CICO_TC_Check-Out Controller_cs00000001_0009 32 1.734 1.832 2.159 2.930 1.764 CICO_TC_Check-Out Controller_cs00000001_0014 30 1.718 1.867 2.178 2.654 1.762 CICO_TC_Check-Out Controller_cs00000001_0035 30 1.672 1.866 2.417 2.623 1.756 CICO_TC_Check-Out Controller_cs00000001_0053 29 1.771 1.872 2.146 2.331 1.752 CICO_TC_Check-Out Controller_cs00000001_0059 27 1.637 1.907 2.115 2.541 1.741 CICO_TC_Check-Out Controller_cs00000001_0058 32 1.655 1.796 2.147 2.764 1.738 CICO_TC_Check-Out Controller_cs00000001_0054 28 1.708 1.931 2.046 2.089 1.734 CICO_TC_Check-Out Controller_cs00000001_0043 31 1.663 1.896 2.013 2.124 1.733 CICO_TC_Check-Out Controller_cs00000001_0013 28 1.689 1.834 2.301 2.509 1.703 CICO_TC_Check-Out Controller_cs00000001_0037 36 1.643 1.713 1.955 2.043 1.651 CICO_TC_Check-Out Controller_cs00000001_0006 82 1.250 1.355 1.584 1.860 1.280 CICO_TC_Check-Out Controller_cs00000001_0024 82 1.192 1.321 1.521 1.616 1.222 CICO_TC_Check-Out Controller_cs00000001_0042 90 1.229 1.341 1.550 1.980 1.275 CICO_TC_Check-Out Controller_cs00000001_0051 90 1.198 1.359 1.569 2.121 1.249 CICO_TC_Check-In Controller_cs00000001_0038 29 1.287 1.378 1.939 2.149 1.278 CICO_TC_Check-In Controller_cs00000001_0018 33 0.955 1.133 1.783 3.462 1.129 CICO_TC_Check-In Controller_cs00000001_0015 32 1.024 1.080 1.666 2.446 1.120 CICO_TC_Check-In Controller_cs00000001_0019 30 1.014 1.125 1.736 3.129 1.112 CICO_TC_Check-In Controller_cs00000001_0001 29 1.030 1.134 1.790 1.844 1.105 CICO_TC_Check-In Controller_cs00000001_0050 25 0.968 1.161 1.686 1.862 1.105 CICO_TC_Check-In Controller_cs00000001_0053 24 1.005 1.139 1.690 2.365 1.096 CICO_TC_Check-In Controller_cs00000001_0021 32 1.013 1.119 1.410 2.925 1.094 CICO_TC_Check-In Controller_cs00000001_0035 24 1.002 1.077 1.171 3.426 1.084 CICO_TC_Check-In Controller_cs00000001_0039 32 1.038 1.171 1.301 1.677 1.074 CICO_TC_Check-In Controller_cs00000001_0058 21 1.026 1.135 1.748 1.753 1.073 CICO_TC_Check-In Controller_cs00000001_0014 24 0.998 1.105 1.699 1.746 1.071 CICO_TC_Check-In Controller_cs00000001_0054 26 0.961 1.101 1.698 2.320 1.070 CICO_TC_Check-In Controller_cs00000001_0036 34 0.992 1.078 1.363 2.987 1.069 CICO_TC_Check-In Controller_cs00000001_0047 27 1.036 1.094 1.234 1.716 1.051 CICO_TC_Check-In Controller_cs00000001_0055 34 1.002 1.102 1.310 1.782 1.049 CICO_TC_Check-In Controller_cs00000001_0040 24 1.010 1.047 1.533 1.606 1.048 CICO_TC_Check-In Controller_cs00000001_0037 18 1.026 1.124 1.329 1.385 1.044 CICO_TC_Check-In Controller_cs00000001_0029 27 1.008 1.104 1.293 1.569 1.043 CICO_TC_Check-In Controller_cs00000001_0030 22 0.984 1.048 1.288 1.912 1.040 CICO_TC_Check-In Controller_cs00000001_0034 26 1.000 1.095 1.731 1.774 1.038 CICO_TC_Check-In Controller_cs00000001_0009 23 1.019 1.083 1.362 1.387 1.037 CICO_TC_Check-In Controller_cs00000001_0005 29 0.968 1.063 1.716 2.030 1.036 CICO_TC_Check-In Controller_cs00000001_0043 23 0.960 1.071 1.697 1.710 1.029 CICO_TC_Check-In Controller_cs00000001_0011 26 0.976 1.086 1.735 1.806 1.026 CICO_TC_Check-In Controller_cs00000001_0033 30 1.008 1.137 1.405 1.419 1.025 CICO_TC_Check-In Controller_cs00000001_0041 27 1.001 1.099 1.260 1.412 1.025 CICO_TC_Check-In Controller_cs00000001_0056 33 1.005 1.049 1.315 1.754 1.025 CICO_TC_Check-In Controller_cs00000001_0010 35 0.991 1.037 1.265 1.772 1.022 CICO_TC_Check-In Controller_cs00000001_0046 31 0.973 1.107 1.226 1.695 1.022 CICO_TC_Check-In Controller_cs00000001_0044 29 1.028 1.074 1.299 1.638 1.021 CICO_TC_Check-In Controller_cs00000001_0045 28 0.951 1.017 1.619 1.683 1.021 CICO_TC_Check-In Controller_cs00000001_0027 23 0.984 1.058 1.211 1.797 1.020 CICO_TC_Check-In Controller_cs00000001_0013 27 0.921 1.080 1.759 1.804 1.019 CICO_TC_Check-In Controller_cs00000001_0008 31 1.023 1.037 1.227 2.076 1.018 CICO_TC_Check-In Controller_cs00000001_0023 25 1.003 1.048 1.478 1.699 1.018 CICO_TC_Check-In Controller_cs00000001_0062 26 0.999 1.049 1.248 1.852 1.018 CICO_TC_Check-In Controller_cs00000001_0003 27 0.999 1.086 1.171 1.247 1.010 CICO_TC_Check-In Controller_cs00000001_0002 32 0.974 1.052 1.223 2.133 1.009 CICO_TC_Check-In Controller_cs00000001_0028 28 0.958 1.106 1.298 1.841 1.006 CICO_TC_Check-In Controller_cs00000001_0049 28 0.984 1.066 1.176 1.524 1.006 CICO_TC_Check-In Controller_cs00000001_0004 25 0.968 1.049 1.299 1.810 1.001 CICO_TC_Check-In Controller_cs00000001_0048 23 0.928 1.048 1.559 1.746 1.000 CICO_TC_Check-In Controller_cs00000001_0017 30 1.010 1.060 1.164 1.659 0.996 CICO_TC_Check-In Controller_cs00000001_0016 32 0.990 1.038 1.153 1.360 0.994 CICO_TC_Check-In Controller_cs00000001_0025 30 0.999 1.035 1.228 1.377 0.994 CICO_TC_Check-In Controller_cs00000001_0026 29 0.979 1.019 1.271 1.741 0.991 CICO_TC_Check-In Controller_cs00000001_0057 31 0.970 1.051 1.129 1.810 0.990 CICO_TC_Check-In Controller_cs00000001_0020 30 0.999 1.063 1.220 1.314 0.989 CICO_TC_Check-In Controller_cs00000001_0032 30 0.956 1.052 1.334 1.786 0.988 CICO_TC_Check-In Controller_cs00000001_0022 22 0.993 1.092 1.188 1.209 0.985 CICO_TC_Check-In Controller_cs00000001_0059 27 0.979 1.058 1.182 1.220 0.983 CICO_TC_Check-In Controller_cs00000001_0060 20 0.968 1.055 1.117 1.415 0.983 CICO_TC_Check-In Controller_cs00000001_0012 26 0.980 1.048 1.167 1.319 0.981 CICO_TC_Check-In Controller_cs00000001_0007 22 0.936 1.024 1.165 1.756 0.978 CICO_TC_Check-In Controller_cs00000001_0061 21 0.904 1.003 1.467 1.783 0.974 CICO_TC_Check-In Controller_cs00000001_0031 29 0.965 1.055 1.131 1.177 0.953 CICO_TC_Check-In Controller_cs00000001_0052 29 0.914 1.022 1.177 1.622 0.943 CICO_TC_Check-In Controller_cs00000001_0024 96 0.677 0.755 1.232 1.424 0.729 CICO_TC_Check-In Controller_cs00000001_0042 88 0.659 0.733 0.960 1.217 0.700 CICO_TC_Check-In Controller_cs00000001_0051 88 0.633 0.715 1.053 1.627 0.684 CICO_TC_Check-In Controller_cs00000001_0006 97 0.641 0.742 0.851 1.517 0.682 CICO_POST_circulation/check-out-by-barcode (Submit_barcode_checkout) 1898 0.455 0.515 0.591 0.746 0.463 CICO_POST_circulation/check-in-by-barcode (Submit_barcode_checkin) 1969 0.418 0.466 0.613 0.941 0.438