PERF-234 Investigate impact of all language analyzers enabled on search

1 Purpose
2 Approach
3 Performance test configuration
4 Errors
5 1 simultaneous user
- 5.1 Boolean search - 1 user
- 5.2 Contributors search - 1 user
- 5.3 Filter search - 1 user
- 5.4 Keyword search - 1 user
- 5.5 Subjects search - 1 user
- 5.6 Title search - 1 user
- 5.7 Performance test results for 1 user
6 10 simultaneous users
- 6.1 Boolean search - 10 users
- 6.2 Contributors search - 10 users
- 6.3 Filter search - 10 users
- 6.4 Keyword search - 10 users
- 6.5 Subjects search - 10 users
- 6.6 Title search - 10 users
- 6.7 Performance test results for 10 users
7 20 simultaneous users
- 7.1 Boolean search - 20 users
- 7.2 Contributors search - 20 users
- 7.3 Filter search - 20 users
- 7.4 Keyword search - 20 users
- 7.5 Subjects search- 20 users
- 7.6 Title search- 20 users
- 7.7 Performance test results for 20 users
8 50 simultaneous users
- 8.1 Boolean search - 50 users
- 8.2 Contributors search - 50 users
- 8.3 Filter search - 50 users
- 8.4 Keyword search - 50 users
- 8.5 Subjects search - 50 users
- 8.6 Title search - 50 users
- 8.7 Performance test results for 50 users
9 100 simultaneous users

Purpose

Establish a baseline for the most common searches that the users might conduct. The performance baseline includes search by: keyword, title, subject, contributor, queries with boolean operations and filters.

All search operations performed for 1, 10, 20, 50, 100 simultaneous users.

Approach

Index bugfest-kiwi dataset at https://falcon-perf-okapi.ci.folio.org and execute list of queries to estimate current performance of mod-search application with all available languages:

{
  "languageConfigs": [
    { "code": "eng" },
    { "code": "heb" },
    { "code": "ara" },
    { "code": "chi" },
    { "code": "spa" },
    { "code": "ger" },
    { "code": "fre" },
    { "code": "ita" },
    { "code": "jpn" },
    { "code": "kor" },
    { "code": "rus" },
    { "code": "swe" }
  ],
  "totalRecords": 12
}

Performance test configuration

Property	Value

Property	Value
Environment	https://falcon-perf-okapi.ci.folio.org
mod-search	2 nodes with CPU limit = 256m and memoryLimit = 536MB
okapi	3 nodes with CPU limit = 256m and memoryLimit = 536MB
mod-authtoken	2 nodes with CPU limit = 128m and memoryLimit = 360MB
mod-login	2 nodes with CPU limit = 128m and memoryLimit = 536MB
mod-permissions	2 nodes with CPU limit = 128m and memoryLimit = 536MB
ElasticSearch	AWS based `Number of nodes: 4` `Resources: r6g.large, 16 GiB of Memory, 2 vCPUs, EBS only, 64-bit Arm platform` `Properties: timeout=30`
Search queries	Keyword search `keyword = "covid"` `keyword = "depress"` `keyword all "covid-19"` `keyword any "covid-19"` `keyword <> "climate change"` `keyword all "depression"` `keyword == "covid-19"` `keyword any "climate change"` `keyword <> "covid-19"` `keyword all "climate change"` `keyword = "climate ch"` `keyword == "climate change"` `keyword any "depression"` `keyword == "depression"` `keyword <> "depression"` `keyword all "climate change"` `keyword = "covid-19"` `keyword = "depression"` `Title search` `title all "Water in Africa"` `title = "Water"` `title = "Africa"` `title any "Water in Africa"` `title == "Water in Africa"` `title <> "Water in Africa"` Subjects search `subjects = "Washington"` `subjects any "Washington Ibiza"` `subjects all "Washington"` `subjects <> "Washington"` `subjects == "Washington"` `subjects = "Washington"` Contributors search `contributors == "Jon Brown"` `contributors any "Brown John"` `contributors == "Brown John"` `contributors all "Jon Brown"` `contributors <> "Jon Brown"` `contributors <> "Brown John"` `contributors = "Brown"` `contributors any "Jon Brown"` `contributors = "Jon*"` `contributors all "Brown John"` Boolean search `subjects all "washington" AND title all "international travel"` `subjects all "washington" OR title all "international travel"` `subjects = ("History" OR "Music")` `subjects all "washington" NOT title all "international travel"` Filter search `languages == "eng"` `languages == ("eng" OR "fre" OR "ita" OR "ukr")` `languages == "eng" AND items.status.name == "Available"` `languages == ("eng" OR "fre") AND items.status.name == ("Available" OR "In transit")` `keyword all "water in africa" AND languages == "eng"`
Count of resources	~8,2 millions (bugfest-iris dataset)
Index size	26.6 Gb per replica (53.2 total)
Performance Test duration	180 (3 min)
V_USERS	1/10/20/50/100
RAMP_UP	5 sec
HOSTNAME	falcon-perf-okapi.ci.folio.org

Errors

All error in test results means that mod-search received response from ElasticSearch:

"Exception happened: Error raised when there was an exception while talking to ES. ConnectionError: Read timed out. (read timeout=30))"

After it, mod-search proxying error to the client in response. It means that the search performed longer than the timeout set up for ES.

PERF-234 Investigate impact of all language analyzers enabled on search

Purpose

Approach

Performance test configuration

Keyword search

Subjects search

Contributors search

Boolean search

Filter search

Errors

1 simultaneous user

Boolean search - 1 user

Contributors search - 1 user

Filter search - 1 user