Data Import MARC BIB + CI/CO (Ramsons) [NON-ECS]
Overview
This document contains the results of testing Check-in/Check-out and Data Import for MARC Bibliographic records on the Ramsons[NON-ECS] release environment.
https://folio-org.atlassian.net/browse/PERF-969
Summary
Data Import with Check In/Check Out tests finished successfully with PTF - Create 2 and PTF - Updates Success - 2 job profiles with files 5K, 10K, 25K, 50K, 100K records.
Instance type was updated from m6i.2xlarge to r7g.2xlarge
Comparing with previous testing results Quesnelia and Ramsons releases
Check-in duration degraded by 20% and Check-out duration degraded by 40% on average without Data Import
Data Import Create jobs duration without CI/CO degraded by 5%-30%, depending on file size
Data Import Update jobs durations without CI/CO degraded by 44%-138%, depending on file size
Data Import Create jobs duration with CI/CO degraded by 15%-40%, depending on file size
Data Import Update jobs durations with CI/CO degraded by two times.
Check-in duration degraded by 20% and Check-out duration degraded by 40% on average for Data Import Create
Check-in duration degraded by 40% and Check-out duration degraded by 45% on average for Data Import Update
During the test, a slow SQL query was detected with a latency of 28,32 seconds.
Test Runs
Test № | Scenario | Test Conditions | Results |
|---|---|---|---|
| DI MARC Bib Create | 5K, 10K, 25K, 50K, 100K consequentially |
|
CICO | 8 users | ||
| DI MARC Bib Update | 5K, 10K, 25K, 50K, 100K consequentially |
|
CICO | 8 users |
Test Results
This table contains durations for Data Import with Check-in/Check-out.
Profile | MARC File | DI Duration Ramsons (hh:mm:ss) | Check In, Check Out Response time (8 users) Ramsons | |
|---|---|---|---|---|
CI Average, ms | CO Average, ms | |||
DI MARC Bib Create (PTF - Create 2) | 5K.mrc | 0:02:53 | 837 | 1.628 |
10K.mrc | 0:05:35 | 809 | 1.460 | |
25K.mrc | 0:15:13 | 895 | 1.545 | |
50K.mrc | 0:27:17 | 901 | 1.495 | |
100K.mrc | 1:04:31 | 896 | 1.459 | |
DI MARC Bib Update (PTF - Updates Success - 2) | 5K.mrc | 0:07:25 | 992 | 1.767 |
10K.mrc | 0:12:52 | 1.100 | 1.903 | |
25K.mrc | 0:37:02 | 1.225 | 1.957 | |
50K.mrc | 1:13:16 | 1.299 | 1.957 | |
100K.mrc | 2:32:25 | 1.297 | 2.027 | |
Check-in/Check-out without Data Import
Scenario | Load level | Request | Response time, ms | |
|---|---|---|---|---|
95 perc | average | |||
Circulation Check-in/Check-out | 8 users | Check-in | 767 | 625 |
Check-out | 1347 | 1138 | ||
Comparison
This table contains DI durations with CICO comparison between Quesnelia and Ramsons releases.
Profile | MARC File | DI Duration | DI Delta without CI/CO | DI Delta with CI/CO | Check In, Check Out | Check In, Check Out | Delta, % | ||||||
without CI/CO | with CI/CO | Quesnelia | Ramsons | Quesnelia/Ramsons | Quesnelia/Ramsons | ||||||||
Quesnelia | Ramsons | Quesnelia | Ramsons | CI Average sec | CO Average sec | CI Average sec | CO Average sec | CI | CO | ||||
DI MARC Bib Create (PTF - Create 2) | 5K.mrc | 00:03:20 |
| 00:02:32 | 0:02:53 |
| 0:00:21 | 0.645 | 0.901 | 0.837 | 1.628 | +23% | +45% |
10K.mrc | 00:06:00 | 00:05:33 | 00:05:03 | 0:05:35 | 00:00:27 | 0:00:32 | 0.628 | 0.922 | 0.809 | 1.460 | +22% | +37% | |
25K.mrc | 00:13:41 | 0:14:16 | 00:11:58 | 0:15:13 | 00:00:35 | 0:03:15 | 0.639 | 0.96 | 0.895 | 1.545 | +29% | +38% | |
50K.mrc | 00:21:59 | 0:28:23 | 00:23:29 | 0:27:17 | 00:06:24 | 0:03:48 | 0.678 | 1.003 | 0.901 | 1.495 | +25% | +33% | |
100K.mrc | 00:40:16 | 0:49:03 | 00:46:07 | 1:04:31 | 00:08:47 | 0:18:24 | 0.686 | 0.998 | 0.896 | 1.459 | +23% | +32% | |
DI MARC Bib Update (PTF - Updates Success - 2) | 5K.mrc | 00:07:10 |
| 00:03:24 | 0:07:25 |
| 0:04:01 | 0.628 | 0.975 | 0.992 | 1.767 | +37% | +45% |
10K.mrc | 00:10:27 | 0:15:00 | 00:06:29 | 0:12:52 | 00:04:33 | 0:04:01 | 0.664 | 1.018 | 1.100 | 1.903 | +40% | +47% | |
25K.mrc | 00:23:16 | 0:34:41 | 00:16:15 | 0:37:02 | 00:11:27 | 0:20:47 | 0.717 | 1.062 | 1.225 | 1.957 | +41% | +46% | |
50K.mrc | 00:40:52 | 1:10:01 | 00:33:33 | 1:13:16 | 00:29:19 | 0:39:43 | 0.721 | 1.071 | 1.299 | 1.957 | +44% | +45% | |
100K.mrc | 01:02:00 | 2:27:05 | 01:10:14 | 2:32:25 | 01:05:05 | 1:22:11 | 0.739 | ||||||