Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinetrue

...

Profile

CSV  FileCentral Tenant (fs09000000)
Result
Test Set 1
Result
Test Set 2
Status
DE MARC Bib (Default instances export job profile)

1k.csv0:00:070:00:03COMPLETED
100k.csv0:06:030:02:17COMPLETED
500k.csv0:09:030:04:25COMPLETED
DE MARC Bib (srs - holdings and items)

1k.csv0:00:130:00:10COMPLETED
100k.csv0:20:250:12:41COMPLETED
500k.csv0:38:210:38:53COMPLETED

...

This table contains durations comparison between Quesnelia ECS, NON-ECS and Eureka environments.


ProfileCSV  FileNumber of recordsQuesnelia NON-ECS QCP1Quesnelia ECS
QCON
Quesnelia Eureka
QECP1
DE Duration, DELTA QCP1/QECP1
ResultResultResulthh:mm:ss / percent
DE MARC Bib (Default instances export job profile)1k.csv00:00:0200:00:050:00:03

+00:00:01
+50%

100k.csv00:02:1700:04:240:02:17

0:00:00
0%

500k.csv00:05:1000:06:170:04:25

-00:00:45
-14.5%

DE MARC Bib (srs - holdings and items)1k.csv00:00:0400:00:050:00:10

+00:00:06
+150%

100k.csv00:05:1300:05:580:12:41

+00:07:28
+143.2%

500k.csv00:08:5800:08:280:38:53

+00:29:55
+333.7%


...

DB connections was 830.

Kafka metrics

Image Modified

Image Modified

OpenSearch Data Nodes metrics

...

DB connections was 850.

Kafka metrics


OpenSearch Data Nodes metrics

...

  • 11 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 [Number of ECS instances, instance type, location region]

  • 1 instance of db.r6.xlarge database instance: Writer instance

  • OpenSearch

    • domain: ptf-test

    • Number of nodes: 7

    • Version: OpenSearch_2_13_R20240520-P5

  • MSK - fse-tenant

    • 4 kafka.m7g.xlarge brokers in 2 zones

    • Apache Kafka version 3.7.x

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=true

    • log.retention.minutes=480

    • default.replication.factor=3

...

  • Test 1: Manually tested 1k, 100k and 500k records files Data Export started on Main tenant(fs09000000) using Default instances export job profile.
  • Test 2: Manually tested 1k, 100k and 500k records files Data Export started on Main tenant(fs09000000) using srs - holdings and items job profile.
  • Test 3: Set Instance Count=0 for mod-fqm-manager. Manually tested 1k, 100k and 500k records files Data Export started on Main tenant(fs09000000) using Default instances export job profile.
  • Test 4: Set Instance Count=0 for mod-fqm-manager. Manually tested 1k, 100k and 500k records files Data Export started on Main  tenant(fs09000000) using srs - holdings and items job profile.

...