Versions Compared

Old Version 5

changes.mady.by.user Leonid Kolesnykov

Saved on

compared with

New Version 6

changes.mady.by.user Leonid Kolesnykov

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinetrue

...

Comparing interim results of indexing size it was found that the major time during reindexing was taken by contributor and instance_subject indexing (at least 7 hours out of 9 hours 45 min).

Test Runs /Results

Test #

Instances number

Test Conditions

reindexing on Poppy release

Duration 

Notes


1. 2023_10_12 08:47 - 18:32 UTC


In parallel: 3 tenants

9 hours 45 min
  • mod-search task count =8
  • mod-inventory-storage task count = 2
  • mod-okapi task count = 3
  • open search instance scaled up to r6g.4xlarge.search
  • without configuration of number_of_replicas and refresh_interval values of ES/OpenSearch

2. 2023-10-13 09:04 - 09:07 UTC

100032

In sequential: fs09000002

3 min

3. 2023-10-13 09:15 - 09:18 UTC

100055

In sequential: fs09000003

3 min
4. 2023-10-13 09:29 - 19:37 UTC10,733,729In sequential: fs0900000010 hours 8 min

...

Infrastructure

PTF -environment ocp2

  • 10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 
  • 2 instances of db.r6g.xlarge database instances, one reader, and one writer 
  • MSK ptf-kakfa-3
    • 4 m5.2xlarge brokers in 2 zones

    • Apache Kafka version 2.8.0

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=true
    • log.retention.minutes=480
    • default.replication.factor=3

...