Data Import MARC BIB + CI/CO (Ramsons) [NON-ECS]

Data Import MARC BIB + CI/CO (Ramsons) [NON-ECS]

Overview

  • This document contains the results of testing Check-in/Check-out and Data Import for MARC Bibliographic records on the Ramsons[NON-ECS] release environment. 

https://folio-org.atlassian.net/browse/PERF-969 

Summary

  • Data Import with Check In/Check Out tests finished successfully with PTF - Create 2 and PTF - Updates Success - 2 job profiles with files 5K, 10K, 25K, 50K, 100K records.

  • Instance type was updated from m6i.2xlarge to r7g.2xlarge

  • Comparing with previous testing results Quesnelia and Ramsons releases

    • Check-in duration degraded by 20% and Check-out duration degraded by 40% on average without Data Import

    • Data Import Create jobs duration without CI/CO degraded by 5%-30%, depending on file size

    • Data Import Update jobs durations without CI/CO degraded by 44%-138%, depending on file size

    • Data Import Create jobs duration with CI/CO degraded by 15%-40%, depending on file size

    • Data Import Update jobs durations with CI/CO degraded by two times.

    • Check-in duration degraded by 20% and Check-out duration degraded by 40% on average for Data Import Create

    • Check-in duration degraded by 40% and Check-out duration degraded by 45% on average for Data Import Update

  • During the test, a slow SQL query was detected with a latency of 28,32 seconds.

Test Runs 

Test №

Scenario

Test Conditions

Results

Test №

Scenario

Test Conditions

Results


1

DI MARC Bib Create

5K, 10K, 25K, 50K, 100K consequentially


Completed

CICO

 8 users


2

DI MARC Bib Update

5K, 10K, 25K, 50K, 100K consequentially


Completed

CICO

8 users

Test Results

This table contains durations for Data Import with Check-in/Check-out

Profile

MARC File

DI Duration

Ramsons

(hh:mm:ss)

Check In, Check Out Response time (8 users)

Ramsons

CI Average, ms

CO Average, ms

DI MARC Bib Create

(PTF - Create 2)

5K.mrc

0:02:53

837

1.628

10K.mrc

0:05:35

809

1.460

25K.mrc

0:15:13

895

1.545

50K.mrc

0:27:17

901

1.495

100K.mrc

1:04:31

896

1.459

DI MARC Bib Update

(PTF - Updates Success - 2)

5K.mrc

0:07:25

992

1.767

10K.mrc

0:12:52

1.100

1.903

25K.mrc

0:37:02

1.225

1.957

50K.mrc

1:13:16

1.299

1.957

100K.mrc

2:32:25

1.297

2.027

Check-in/Check-out without Data Import

Scenario

Load level

Request

Response time, ms
Quesnelia

95 perc

average

Circulation Check-in/Check-out
(without Data import)

8 users

Check-in

767

625

Check-out

1347

1138

Comparison

This table contains DI durations with CICO comparison between Quesnelia and Ramsons releases.

Profile

MARC File

DI Duration

DI Delta  
Quesnelia/Ramsons

without CI/CO
(hh:mm:ss)

DI Delta  
Quesnelia/Ramsons

with CI/CO
(hh:mm:ss)

Check In, Check Out
Response time
(8 users)

Check In, Check Out
Response time
(8 users)

Delta, %

without CI/CO

with CI/CO

Quesnelia

Ramsons

Quesnelia/Ramsons

Quesnelia/Ramsons

Quesnelia

Ramsons

Quesnelia

Ramsons

CI Average sec

CO Average sec

CI Average sec

CO Average sec

CI

CO

DI MARC Bib Create (PTF - Create 2)

5K.mrc

00:03:20

 

00:02:32

0:02:53

 

0:00:21
+14%

0.645

0.901

0.837

1.628

+23%

+45%

10K.mrc

00:06:00

00:05:33

00:05:03

0:05:35

00:00:27
+7%

0:00:32
+11%

0.628

0.922

0.809

1.460

+22%

+37%

25K.mrc

00:13:41

0:14:16

00:11:58

0:15:13

00:00:35
+4%

0:03:15
+27%

0.639

0.96

0.895

1.545

+29%

+38%

50K.mrc

00:21:59

0:28:23

00:23:29

0:27:17

00:06:24
+29%

0:03:48
+16%

0.678

1.003

0.901

1.495

+25%

+33%

100K.mrc

00:40:16

0:49:03

00:46:07

1:04:31

00:08:47
+22%

0:18:24
+40%

0.686

0.998

0.896

1.459

+23%

+32%

DI MARC Bib Update (PTF - Updates Success - 2)

5K.mrc

00:07:10

 

00:03:24

0:07:25

 

0:04:01
+118%

0.628

0.975

0.992

1.767

+37%

+45%

10K.mrc

00:10:27

0:15:00

00:06:29

0:12:52

00:04:33
+43%

0:04:01
+98%

0.664

1.018

1.100

1.903

+40%

+47%

25K.mrc

00:23:16

0:34:41

00:16:15

0:37:02

00:11:27
+49%

0:20:47
+128%

0.717

1.062

1.225

1.957

+41%

+46%

50K.mrc

00:40:52

1:10:01

00:33:33

1:13:16

00:29:19
+71%

0:39:43
+118%

0.721

1.071

1.299

1.957

+44%

+45%

100K.mrc

01:02:00

2:27:05

01:10:14

2:32:25

01:05:05
+137%

1:22:11
+117%

0.739