Table of Contents

outline	true

This document contains the results of testing Check-in/Check-out and Data Import for MARC Bibliographic records on the Ramsons[NON-ECS] release environment.

...

Data Import with Check In/Check Out tests finished successfully with PTF - Create 2 and PTF - Updates Success - 2 job profiles with files 5K, 10K, 25K, 50K, 100K records.
Instance type was updated from m6i.2xlarge to r7g.2xlarge
Comparing with previous testing results Quesnelia and Ramsons releases
- Check-in duration degraded 20% and Check-out duration degraded 40% in average without Data Import
- Data Import Create jobs duration with CI/CO degraded 15%-40% depended of file size
- Data Import Update jobs durations with CI/CO degraded in two times.
- Check-in duration degraded 20% and Check-out duration degraded 40% in average for Data Import Create
- Check-in duration degraded 40% and Check-out duration degraded 45% in average for Data Import Update

Test Runs

Test №	Scenario	Test Conditions	Results
1	DI MARC Bib Create	5K, 10K, 25K, 50K, 100K consequentially	Completed
1	CICO	8 users	Completed
2	DI MARC Bib Update	5K, 10K, 25K, 50K, 100K consequentially	Completed
2	CICO	8 users	Completed

...

Profile

MARC File

DI Duration

DI Delta
Quesnelia/Ramsons

with CI/CO
(hh:mm:ss)

Check In, Check Out
Response time
(8 users)

Delta, %

without CI/CO

with CI/CO

Quesnelia

Ramsons

Quesnelia/Ramsons

Quesnelia

Ramsons

Quesnelia

Ramsons

CI Average sec

CO Average sec

CI Average sec

CO Average sec

CI

CO

DI MARC Bib Create (PTF - Create 2)

5K.mrc

00:03:20

00:02:32

0:02:53

0:00:21
+14%

0.645

0.901

0.837

1.628

+23%

+45%

10K.mrc

00:06:00

00:05:33

00:05:03

0:05:35

0:00:32
+11%

0.628

0.922

0.809

1.460

+22%

+37%

25K.mrc

00:13:41

0:14:16

00:11:58

0:15:13

0:03:15
+27%

0.639

0.96

0.895

1.545

+29%

+38%

50K.mrc

00:21:59

0:28:23

00:23:29

0:27:17

0:03:48
+16%

0.678

1.003

0.901

1.495

+25%

+33%

100K.mrc

00:40:16

0:49:03

00:46:07

1:04:31

0:18:24
+40%

0.686

0.998

0.896

1.459

+23%

+32%

DI MARC Bib Update (PTF - Updates Success - 2)

5K.mrc

00:07:10

00:03:24

0:07:25

0:04:01
+118%

0.628

0.975

0.992

1.767

+37%

+45%

10K.mrc

00:10:27

0:15:00

00:06:29

0:12:52

0:04:01
+98%

0.664

1.018

1.100

1.903

+40%

+47%

25K.mrc

00:23:16

0:34:41

00:16:15

0:37:02

0:20:47
+128%

0.717

1.062

1.225

1.957

+41%

+46%

50K.mrc

00:40:52

1:10:01

00:33:33

1:13:16

0:39:43
+118%

0.721

1.071

1.299

1.957

+44%

+45%

100K.mrc

01:02:00

2:27:05

01:10:14

2:32:25

1:22:11
+117%

0.739

1.081

1.297

2.027

+43%

+47%

Detailed CICO response time comparison without DI

Scenario	Load level	Request	Response time, ms Ramsons		Response time, ms Quesnelia		Delta, %
Scenario	Load level	Request	95 perc	average	95 perc	average	Ramsons/Quesnelia average
Circulation Check-in/Check-out (without Data import)	8 users	Check-in	767	625	609	521	+19.96%
Circulation Check-in/Check-out (without Data import)	8 users	Check-out	1.347	1.138	1.070	803	+41.72%

Test №1-2

Resource utilization

...

DB CPU Utilization

DB Connections

Kafka metrics

OpenSearch Data Nodes metrics

...

Infrastructure

PTF -environment rcp1

rcp1 5 r7g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 instance of db.r6g.xlarge database instance: Writer instance
MSK fse-test
- - 4 kafka.m7g.xlarge brokers in 2 zones (2 brokers per zone)
  - Apache Kafka version 3.7.x, metadata mode - KRaft
  - EBS storage volume per broker 300 GiB
  - auto.create.topics.enable=true
  - log.retention.minutes=480
  - default.replication.factor=2
  - revision - 26
OpenSearch 2.13 ptf-test cluster
- r6g.2xlarge.search 4 data nodes
- r6g.large.search 3 dedicated master nodes

DB tables records size:

Tennent	instance count	holdings count	item count	authority count
fs09000000	30.587.260	30.646.075	31.734.818	16.535.572

Methodology/Approach

DI tests scenario (DI MARC Bib Create and Update) were started on Ramsons (rcp1) env with file splitting features enabled on a NON-ECS environment.

...

Version	Old Version 13	New Version 14
Changes made by	Stanislav Nehrii	Stanislav Nehrii
Saved on	Jan 28, 2025	Jan 28, 2025

Versions Compared

Key

Test Runs

Test №1-2

Resource utilization

DB CPU Utilization

DB Connections

Kafka metrics

OpenSearch Data Nodes metrics

Infrastructure

Methodology/Approach

Page Comparison

Versions Compared

Key

Test Runs

Test №1-2

Resource utilization

DB CPU Utilization

DB Connections

Kafka metrics

OpenSearch Data Nodes metrics

Infrastructure

Methodology/Approach