Versions Compared

Old Version 21

changes.mady.by.user Stanislav Nehrii

Saved on

compared with

New Version 22

changes.mady.by.user Stanislav Nehrii

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinetrue

...

Test â„–

Date

Test Conditions

Results

1

12/20/24, 13:15 AM UTC

View Order history, View Order Line history and View Pieces history with 10, 50, 100 and 1000 changes on Data Set with 500k records

Completed
212/20/24, 13:11 AM UTC

View Order history, View Order Line history and View Pieces history with 10, 50, 100 and 1000 changes on Data Set with 1 million records

Completed
3

12/20/24, 15:45 PM UTC

View Order history, View Order Line history and View Pieces history with 10, 50, 100 and 1000 changes on Data Set with 5 million records

Completed

Test Results

The following table collect transactions results for tests №1,  №2 and №3.


Transactions

Response Time (milliseconds)
Data size 500k


Data size 1 million


Data size 5 million


Averagepct90Averagepct90Averagepct90
TC_open order 10813251387225268942650
TC_open order 50446687453687469647
TC_open order 100737134373913468141722
TC_open order 1000670884657858680838
TC_open order line 10136331591468346415604083
TC_open order line 50913134392515919361458
TC_open order line 100118117841170197812352242
TC_open order line 1000119715341192148512131529
TC_open pieces 10126826431249262112692645
TC_open pieces 50880106588112549151368
TC_open pieces 100111118441126153111441811
TC_open pieces 1000106212861110130510921489
TC_view order history 10541165255816135441388
TC_view order history 50254383249314265380
TC_view order history 100477805486886505849
TC_view order history 1000452647445528464681
TC_view order line history 10754161073815648231974
TC_view order line history 50452619449587489788
TC_view order line history 10069510686771037718968
TC_view order line history 10007339007601207746926
TC_view pieces history 10753143374514227821801
TC_view pieces history 50452701449632454626
TC_view pieces history 100670100865610867011081
TC_view pieces history 10007109457011095694862


The following table collect API results for tests №1,  №2 and №3:

  • GET audit-data/acquisition/order/order_id
  • GET audit-data/acquisition/order-line/order_line_id
  • GET audit-data/acquisition/piece/piece_id/status-change-history


Transactions

Response Time (milliseconds)
Data size 500kData size 1 millionData size 5 millionData size 500kData size 1 millionData size 5 million
AverageAverageAveragepct90pct90pct90
GET audit-data/acquisition/order/[order_10]272834727489
GET audit-data/acquisition/order-line/[po_line_id_10]292729777090
GET audit-data/acquisition/piece/]pieces_10]/status-change-history282827646869
GET audit-data/acquisition/order/[order_50]181618584748
GET audit-data/acquisition/order-line/[po_line_id_50]2023405360344
GET audit-data/acquisition/piece/]pieces_50]/status-change-history172019445151
GET audit-data/acquisition/order/[order_100]222023625966
GET audit-data/acquisition/order-line/[po_line_id_100]272532656375
GET audit-data/acquisition/piece/]pieces_100]/status-change-history222123616260
GET audit-data/acquisition/order/[order_1000]4752481009881
GET audit-data/acquisition/order-line/[po_line_id_1000]122126132212231222
GET audit-data/acquisition/piece/]pieces_1000]/status-change-history60505311710596


The following table collect INSERT INTO duration results for different data size.


Data size 500kData size 1 millionData size 5 millionData size 1 millionData size 5 million

INSERT INTO 
1 row		INSERT INTO 
1 row		INSERT INTO 
1 row		INSERT INTO 
100k		INSERT INTO 
100k
Order
acquisition_order_log		201 msec211 msec236 msec4 secs 361 msec5 secs 330 msec
Order Line
acquisition_order_line_log		198 msec222  msec191 msec6 secs 857 msec7 secs 73 msec
Pieces
acquisition_piece_log		183 msec239 msec303 msec4 secs 399 msec4 secs 393 msec


The following table collect size for tables and indexes.

table_nametable_sizeindexes_sizerow_count
cs00000int_mod_audit.acquisition_order_log2811 MB358 MB5.300.543
cs00000int_mod_audit.acquisition_order_line_log11 GB366 MB5.400.089
cs00000int_mod_audit.acquisition_piece_log3957 MB374 MB5.220.071


Comparison

Test â„–1-â„–2-â„–3

  • The following table compares the average response times for all transactions between tests â„–1,  â„–2 and â„–3. 


  • The following table compares the average response times for API calls:
    • GET audit-data/acquisition/order/order_id
    • GET audit-data/acquisition/order-line/order_line_id
    • GET audit-data/acquisition/piece/piece_id/status-change-history




Resource utilization for Test #1-2-3

...

Here we can see that all modules show a stable trend.

Kafka metrics


OpenSearch Data Nodes metrics

...

PTF - environment Ramsons (rcon)

  • 10 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 [Number of ECS instances, instance type, location region]

  • 1 instance of db.r6.xlarge database instance: Writer instance

  • OpenSearch

    • domain: ptf-test

    • Number of nodes: 7

    • Version: OpenSearch_2_13_R20240520-P5

  • MSK - fse-tenant

    • 4 kafka.m7g.xlarge brokers in 2 zones

    • Apache Kafka version 3.7.x

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=true

    • log.retention.minutes=480

    • default.replication.factor=3

...

  • Open Order tub

  • Open Order (with 1000 changes in history)

  • View Order history

  • Open Order Line (with 1000 changes in history)

  • View Order Line history

  • Open Pieces (with 1000 changes in history)

  • View Pieces history

Attached files

Ramsons ECS (rcon) module configuration parameters:

 

JMeter script:JMeter script:

View file
nameRCON_history.jmx
height250