Table of Contents outline true
...
Test # | Instances number | Test Conditions reindexing on Poppy release | Duration | Notes |
1. 2023_10_12 08:47 - 18:32 UTC | In parallel: 3 tenants | 9 hours 45 min |
| |
2. 2023-10-13 09:04 - 09:07 UTC | 100032 | In sequential: fs09000002 | 3 min | |
3. 2023-10-13 09:15 - 09:18 UTC | 100055 | In sequential: fs09000003 | 3 min | |
| 4. 2023-10-13 09:29 - 19:37 UTC | 10,733,729 | In sequential: fs09000000 | 10 hours 8 min |
...
Infrastructure
PTF -environment ocp2
- 10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
- 2 instances of db.r6g.xlarge database instances, one reader, and one writer
- MSK ptf-kakfa-3
- 4 m5.2xlarge brokers in 2 zones
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=3
...
Modules | Version | Task Definition | Running Tasks | CPU | Memory | MemoryReservation | MaxMetaspaceSize | Xmx |
|---|---|---|---|---|---|---|---|---|
| mod-search Poppy | 3.0.0-SNAPSHOT.156 | 6 | 8 | 2048 | 2592 | 2480 | 512 | 1440 |
| mod-inventory-storage Poppy | 26.1.0-SNAPSHOT.685 | 11 | 2 | 2048 | 4096 | 3690 | 512 | 3076 |
| mod-search Orchid | 2.1.0-SNAPSHOT.108 | 3 | 8 | 400 | 2592 | 2480 | 1024 | 1440 |
| mod-inventory-storage Orchid | 26.1.0-SNAPSHOT.644 | 3 | 2 | 1024 | 1952 | 2208 | 512 | 1440 |
Methodology/Approach
- Use Consorita cluster with Poppy releasePTF's "Bugfest" Poppy cluster, which has 10M records, to test with (2 times)
- Configure the environment in accordance with Infrastructure parameters to the one that FSE commonly uses
- Reindex on the new Poppy environment, get the results for indexing time, index size
- Create a comparison of results between sequential order and parallel start.
...