Overview
The purpose of the document is to assess reindexing performance on a consortium environment. Calculate reindex time and size of index.
Recommendations & Jiras
- Original ticket to test: PERF-635 - Getting issue details... STATUS
- Additional info ElasticSearch Reindex Performance Recommendations
Test Summary
Test Runs /Results
Test # | Instances number | Test Conditions reindexing on Poppy release, consortium environment | Duration | Notes |
1. 2023-11-28 09:20-12:20 UTC | 1766108 | In parallel: 3 tenants | 3 hours |
|
2. 2023-11-29 08:50 - 10:50 UTC | 1212927 | Sequential: cs00000int | 2 hours | |
3. 2023-11-29 14:05 - 15:05 UTC | 353179 | Sequential: cs00000int_0001 | 1 hour | |
| 4. 2023-11-2915:22 - 15:42 UTC | 200002 | Sequential: cs00000int_0002 | 20 min |
Indexing size
| In parallel: 3 tenants | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| health | status | index | uuid | pri | rep | docs.count | docs.deleted | store.size | pri.store.size |
| green | open | pcon_instance_subject_cs00000int | oo6lG2KjRBm68SlF4cQf-A | 4 | 2 | 851506 | 188613 | 3.4gb | 1.1gb |
| green | open | pcon_contributor_cs00000int | D9izLpcOQWmqZFJhl6kyyA | 4 | 2 | 855300 | 231525 | 1.8gb | 685mb |
| green | open | pcon_authority_cs00000int | 5CbWdgFrQSSBRlcNHPk7-A | 4 | 2 | 0 | 0 | 2.4kb | 832b |
| green | open | pcon_instance_cs00000int | 6i5vkM6kRHOOu4ahRqESkA | 4 | 2 | 1204190 | 1498 | 23.7gb | 7.8gb |
Results from get-request for reindex monitoring:
| Tenant | Reindex id | Get request reindex |
|---|---|---|
| cs00000int | 5dfca883-6236-438c-b4a4-bfd2274cdc0b | 1212891 |
| cs00000int_001 | 86a89e41-2858-4a9c-9e58-578ccf677413 | 353179 |
| cs00000int_002 | 01ec9821-aca8-4a28-8c02-844807191ca9 | 200002 |
| SUM | 1766072 |
| Sequential: cs00000int | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| health | status | index | uuid | pri | rep | docs.count | docs.deleted | store.size | pri.store.size |
| green | open | pcon_instance_subject_cs00000int | XMqrUxTkTNKz4rIS1fi9Ug | 4 | 2 | 862411 | 106300 | 3.2gb | 1gb |
| green | open | pcon_contributor_cs00000int | TGA0HARfRLGXMDuFyQcmfg | 4 | 2 | 835533 | 162792 | 1.5gb | 560.8mb |
| green | open | pcon_authority_cs00000int | 5CbWdgFrQSSBRlcNHPk7-A | 4 | 2 | 0 | 0 | 2.4kb | 832b |
| green | open | pcon_instance_cs00000int | R_Goc_w2T8CRnfvfbbsxHg | 4 | 2 | 1212891 | 0 | 25.9gb | 8.5gb |
| Sequential: cs00000int_0001 | |||||||||
| health | status | index | uuid | pri | rep | docs.count | docs.deleted | store.size | pri.store.size |
| green | open | pcon_instance_subject_cs00000int | XMqrUxTkTNKz4rIS1fi9Ug | 4 | 2 | 865366 | 83466 | 4.6gb | 1.5gb |
| green | open | pcon_contributor_cs00000int | TGA0HARfRLGXMDuFyQcmfg | 4 | 2 | 839478 | 90380 | 2.3gb | 806mb |
| green | open | pcon_authority_cs00000int | 5CbWdgFrQSSBRlcNHPk7-A | 4 | 2 | 0 | 0 | 2.4kb | 832b |
| green | open | pcon_instance_cs00000int | R_Goc_w2T8CRnfvfbbsxHg | 4 | 2 | 1222891 | 161584 | 28.5gb | 9.4gb |
| Sequential: cs00000int_0002 | |||||||||
| health | status | index | uuid | pri | rep | docs.count | docs.deleted | store.size | pri.store.size |
| green | open | pcon_instance_subject_cs00000int | XMqrUxTkTNKz4rIS1fi9Ug | 4 | 2 | 955467 | 126534 | 4.5gb | 1.2gb |
| green | open | pcon_contributor_cs00000int | TGA0HARfRLGXMDuFyQcmfg | 4 | 2 | 929045 | 189949 | 2.7gb | 1gb |
| green | open | pcon_authority_cs00000int | 5CbWdgFrQSSBRlcNHPk7-A | 4 | 2 | 0 | 0 | 2.4kb | 832b |
| green | open | pcon_instance_cs00000int | R_Goc_w2T8CRnfvfbbsxHg | 4 | 2 | 1422889 | 161588 | 32.6gb | 10.9gb |
Results from get-request for reindex monitoring:
| Tenant | Reindex id | Get request reindex |
|---|---|---|
| cs00000int | bb944cf4-b99f-4aa3-b13e-f5c92dc630ed | 1212891 |
| cs00000int_001 | cf943d63-50db-4085-9629-783d7acdc67b | 353179 |
| cs00000int_002 | c62e2662-6a21-47fd-9bb8-eea11364c2c1 | 200002 |
| SUM | 1766072 |
Service CPU Utilization
Memory Utilization
DB CPU Utilization
DB Connections
Open Search CPU
Open Search Ibdexing Data Rate
Open Search Ibdexing Latency
