/
Data Import MARC BIB + CI/CO (Ramsons) [ECS]

Data Import MARC BIB + CI/CO (Ramsons) [ECS]

Overview In progress

  • This document contains the results of testing Check-in/Check-out and Data Import for MARC Bibliographic records on the Ramsons[ECS] release environment. 

PERF-978 - Getting issue details... STATUS  

Summary

  • Data Import with Check In/Check Out tests finished successfully with PTF - Create 2 and PTF - Updates Success - 6 job profiles with files 5K, 10K, 25K, 50K, 100K records.
  • Comparing with previous testing results Quesnelia and Ramsons releases

Test Runs 

Test №ScenarioTest ConditionsResults

1
DI MARC Bib Create5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause)
Completed
CICO 8 users

2
DI MARC Bib Update5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause)


Completed

CICO8 users

Test Results

This table contains durations for Data Import. 

ProfileMARC File

DI Duration

Ramsons (hh:mm:ss)

Check In, Check Out Response time (8 users)

Ramsons

CI Average secCO Average sec

DI MARC Bib Create

(PTF - Create 2)

5K.mrc0:04:111.012
10K.mrc0:06:390.951.88
25K.mrc0:16:131.182.25
50K.mrc0:29:471.112.29
100K.mrc0:56:001.62.4

DI MARC Bib Create

(PTF - Updates Success - 6)

5K.mrc0:06:190.992.2
10K.mrc0:12:101.12.5
25K.mrc0:24:311.042.1
50K.mrc0:49:531.032.2
100K.mrc1:48:0012.1

Check-in/Check-out without DI

ScenarioLoad levelRequestResponse time, sec
Quesnelia
95 percaverage
Circulation Check-in/Check-out
(without Data import)
8 usersCheck-in10.65
Check-out1.91.2

Comparison

This table contains DI durations with CICO comparison between Quesnelia and Ramsons releases.

ProfileMARC FileDI Duration with CI/CODI Delta  
Poppy/Quesnelia
(hh:mm:ss / %)
Check In, Check Out
Response time
(8 users)
Check In, Check Out
Response time
(8 users)
Delta, %

QuesneliaRamsonsQuesnelia/RamsonsQuesnelia/Ramsons
QuesneliaRamsonsCI Average secCO Average secCI Average secCO Average secCICO
DI MARC Bib Create
(PTF - Create 2)
5K.mrc
0:03:21


0.8311.357

10K.mrc
0:06:51


0.8451.410

25K.mrc
0:12:41


0.7191.333

50K.mrc
0:23:19


0.6911.327

100K.mrc
0:51:24


0.6641.335

DI MARC Bib Create

(PTF - U1.571pdates Success - 6)

5K.mrc
0:04:12


0.7641.458

10K.mrc
0:08:15


0.7791.377

25K.mrc
0:20:38


0.7551.401

50K.mrc
0:43:06


0.7501.444

100K.mrc
1:29:09


0.7301.458

Detailed CICO response time comparison without DI

ScenarioLoad levelRequestResponse time, sec
Poppy
Response time, sec
Quesnelia
95 percaverage95 percaverage
Circulation Check-in/Check-out (without Data import)8 usersCheck-in



Check-out




Resource utilization for Test №1

 Resource utilization table

Service CPU Utilization



Service Memory Utilization



DB CPU Utilization



DB Connections



DB load

Top SQL-queries



Resource utilization for Test №2

 Resource utilization table

Service CPU Utilization



Service Memory Utilization


DB CPU Utilization



DB Connections



DB load

Top SQL-queries



Appendix

Infrastructure

PTF -environment rcon
  • rcon 12 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1 
  • 1 instance of db.r6g.xlarge database instance: Writer instance
  • MSK fse-test
      • 4 kafka.m7g.xlarge brokers in 2 zones (2 brokers per zone)
      • Apache Kafka version 3.7.x, metadata mode - KRaft

      • EBS storage volume per broker 300 GiB

      • auto.create.topics.enable=true
      • log.retention.minutes=480
      • default.replication.factor=2
      • revision - 26
  • OpenSearch 2.13 ptf-test cluster
    • r6g.2xlarge.search 4 data nodes

    • r6g.large.search 3 dedicated master nodes

DB table records size:

  • [tenant]
    • instances -            1163924
    • items -                  2091901
    • holding records - 1348036


Methodology/Approach

DI tests scenario (DI MARC Bib Create and Update) were started from UI with delay.

Test runs:

  • Test 1: Manually tested 5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause) records files, DI (DI MARC Bib Create ) started on College tenant(cs00000int_0001) only, and CICO with 8 users on background.
  • Test 2: Manually tested 5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause) records files, DI (DI MARC Bib Update) started on College tenant(cs00000int_0001) only, and CICO with 8 users on background.

At the time of the test run, Grafana was not available. As a result, response times for Check-In/Check-Out were parsed manually from a .jtl files, using the start and finish dates of the data import tests. These results were visualized in JMeter using a Listener (Response Times Over Time).