Browse/subjects report [Lotus]

Browse/subjects report [Lotus]

 

 

Overview 

The purpose of this test set is to test browse/subject/instances API. Measure performance, find possible issues, bottlenecks. 

 MSEARCH-293.  Test performance of subject browsing.

 

Summary

  • 1 user test ended without errors. Average response time 5.509 s. Resources usage is hardly visible on mod-search during test (most of work were done on OpenSearch end). OpenSearch CPU usage reached 70%. 

  • 5 users test ended without errors. Average response time 7.918s.  Resources usage is hardly visible on mod-search during test (most of work were done on OpenSearch end). OpenSearch CPU usage reached 100%. 

  • 10 users ended without errors as well. Average response time is 13.357 s. OpenSearch CPU usage reached 100% immediately after test start.

  • 1-100 users Ramp-up. 

    • first error appeared on 16 users;

    • on 35 users mod-search becomes unstable. * see more details below. 

  • OpenSearch v 1.2 working much slower than  Elasticsearch 7.10. See details in last tests.

 

 

Environment

  • mod-search 1.6.4

  • OpenSearch service

    • nodes type r6g.large.search (X4) * (4 data nodes 3 dedicated master nodes);

    • version OpenSearch 1.2 (latest);

  • kafka 2.8.0

 

 

Test Results

 

Test 1 user

users

Average

75%

Errors

1

5.509

6.164

None

 

 

Resources usage

Note: This test is not visible on most charts, except CPU usage from OpenSearch service.

 

 

 

 

Note: OpenSearch CPU usage reached ±70% during test.

 

*Rest of a charts does not contain any valuable information. 

 

Test 5 users

users

Average

75%

Errors

7.918

9.085

None 

 

 

Resources usage

 

 

 

 

 

Test 10 users

users

Average

75%

Errors

10

13.357

15.568

none

 

 

Resources usage

 

 

 

 

 

 

 

Test 1-100 users (Ramp-Up)

Notable observations: 

  • First errors starts at 16 users;

  • On 35 users system becomes unstable and containers often failed (See CPU chart);

  • After 35 users - error rate reached 91%.

ERRORS:

  • On client side - HTTP 500 Internal Server Error. If the issue persists, please report it to EBSCO Connect.

  • On server side:  ERROR andlerExecutionChain HandlerInterceptor.afterCompletion threw exception
    java.lang.NullPointerException: null.

 

 

Resources usage

 

 

 

 

 

 

Test 5 users + CICO

users

Average

75%

Errors

10

11.347

13.347

none

 

 

 

 

 

 

 

 

 

 

Test Results openSearch cluster Elasticsearch 7.10

 

Test 1 user

users

Average

75%

Errors

Average fse-ptf cluster

1

1.701

3.350

none

5.509

 

 

 

Resources usage

 

 

 

 

 

 

Test 5 users

 

users

Average

75%

Errors

Average fse-ptf cluster

1

1.465

1.656

none

7.918

 

 

Resources usage