[Eureka] Check-in-check-out Test Report (Quesnelia)

Overview

The test's target is to investigate the behaviour of the Check-In/Check-Out activities during fixed load tests. PERF-879 - Getting issue details... STATUS

Summary

Check-In/Check-Out tests on Quesnelia release (Eureka) in QECP1 environment carried out with 8, 20, 30, 75 virtual users during 45 minutes and with 30 virtual users during longevity test (24 hours) to detect any trends in resource utilization

45 minute tests

  • Response times in tests with 8, 20, 30 virtual users delta was 200 ms. The lowest average response times were with 20 virtual users test: Check-In - 625 ms, average Check-Out - 1356 ms
  • The highest average response times showed 75 vUsers test: Check-In - 4 sec 610 ms, Check-Out - 12 sec 589 ms (whole test), Check-In - 622 ms, Check-Out - 1540 ms (before saturation point with 33 vUsers)

Longevity test

  • Longevity test was running 10 hours and began failing because of token expiration. Possible reason here is SSO Session Max limitation 10 hours (fs09000000/realm-settings/sessions).
    • Average response times in 10 hours test for Check-In - 1003 ms, Check-Out - 2870 ms
    • First 5 hours 30 minutes average response times Check-In - 770 ms, Check-Out - 1773 ms, the next 4 hours 30 minutes - Check-In - 1295 ms, Check-Out - 4280 ms
  • Longevity during 24 hours (after session expiration issue was resolved by increasing SSO session Max parameter from 10 to 24 hours)
    • Average response times for all 24 test Check-In - 1311 ms, Check-Out - 4541 ms
    • The same degradation observed as in 10 hours test. Response time increased significantly in 6 hours aft