Data Import MARC BIB + CI/CO (Ramsons) [ECS]
Overview In progress
- This document contains the results of testing Check-in/Check-out and Data Import for MARC Bibliographic records on the Ramsons[ECS] release environment.
- PERF-978Getting issue details... STATUS
Summary
- Data Import with Check In/Check Out tests finished successfully with PTF - Create 2 and PTF - Updates Success - 6 job profiles with files 5K, 10K, 25K, 50K, 100K records.
- Comparing with previous testing results Quesnelia and Ramsons releases
Test Runs
Test № | Scenario | Test Conditions | Results |
---|---|---|---|
1 | DI MARC Bib Create | 5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause) | Completed |
CICO | 8 users | ||
2 | DI MARC Bib Update | 5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause) |
|
CICO | 8 users |
Test Results
This table contains durations for Data Import.
Profile | MARC File | DI Duration Ramsons (hh:mm:ss) | Check In, Check Out Response time (8 users) Ramsons | |
---|---|---|---|---|
CI Average sec | CO Average sec | |||
DI MARC Bib Create (PTF - Create 2) | 5K.mrc | 0:04:11 | 1.01 | 2 |
10K.mrc | 0:06:39 | 0.95 | 1.88 | |
25K.mrc | 0:16:13 | 1.18 | 2.25 | |
50K.mrc | 0:29:47 | 1.11 | 2.29 | |
100K.mrc | 0:56:00 | 1.6 | 2.4 | |
DI MARC Bib Create (PTF - Updates Success - 6) | 5K.mrc | 0:06:19 | 0.99 | 2.2 |
10K.mrc | 0:12:10 | 1.1 | 2.5 | |
25K.mrc | 0:24:31 | 1.04 | 2.1 | |
50K.mrc | 0:49:53 | 1.03 | 2.2 | |
100K.mrc | 1:48:00 | 1 | 2.1 |
Check-in/Check-out without DI
Scenario | Load level | Request | Response time, sec Quesnelia | |
---|---|---|---|---|
95 perc | average | |||
Circulation Check-in/Check-out (without Data import) | 8 users | Check-in | 1 | 0.65 |
Check-out | 1.9 | 1.2 |
Comparison
This table contains DI durations with CICO comparison between Quesnelia and Ramsons releases.
Profile | MARC File | DI Duration with CI/CO | DI Delta Poppy/Quesnelia (hh:mm:ss / %) | Check In, Check Out Response time (8 users) | Check In, Check Out Response time (8 users) | Delta, % | ||||
Quesnelia | Ramsons | Quesnelia/Ramsons | Quesnelia/Ramsons | |||||||
Quesnelia | Ramsons | CI Average sec | CO Average sec | CI Average sec | CO Average sec | CI | CO | |||
DI MARC Bib Create (PTF - Create 2) | 5K.mrc | 0:03:21 | 0.831 | 1.357 | ||||||
10K.mrc | 0:06:51 | 0.845 | 1.410 | |||||||
25K.mrc | 0:12:41 | 0.719 | 1.333 | |||||||
50K.mrc | 0:23:19 | 0.691 | 1.327 | |||||||
100K.mrc | 0:51:24 | 0.664 | 1.335 | |||||||
DI MARC Bib Create (PTF - U1.571pdates Success - 6) | 5K.mrc | 0:04:12 | 0.764 | 1.458 | ||||||
10K.mrc | 0:08:15 | 0.779 | 1.377 | |||||||
25K.mrc | 0:20:38 | 0.755 | 1.401 | |||||||
50K.mrc | 0:43:06 | 0.750 | 1.444 | |||||||
100K.mrc | 1:29:09 | 0.730 | 1.458 |
Detailed CICO response time comparison without DI
Scenario | Load level | Request | Response time, sec Poppy | Response time, sec Quesnelia | ||
---|---|---|---|---|---|---|
95 perc | average | 95 perc | average | |||
Circulation Check-in/Check-out (without Data import) | 8 users | Check-in | ||||
Check-out |
Resource utilization for Test №1
Service CPU Utilization
Service Memory Utilization
DB CPU Utilization
DB Connections
DB load
Top SQL-queries
Resource utilization for Test №2
Service CPU Utilization
Service Memory Utilization
DB CPU Utilization
DB Connections
DB load
Top SQL-queries
Appendix
Infrastructure
PTF -environment rcon |
---|
|
DB table records size:
|
---|
Methodology/Approach
DI tests scenario (DI MARC Bib Create and Update) were started from UI with delay.
Test runs:
- Test 1: Manually tested 5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause) records files, DI (DI MARC Bib Create ) started on College tenant(cs00000int_0001) only, and CICO with 8 users on background.
- Test 2: Manually tested 5K, 10K, 25K, 50K, 100K consequentially (with 5 min pause) records files, DI (DI MARC Bib Update) started on College tenant(cs00000int_0001) only, and CICO with 8 users on background.
At the time of the test run, Grafana was not available. As a result, response times for Check-In/Check-Out were parsed manually from a .jtl files, using the start and finish dates of the data import tests. These results were visualized in JMeter using a Listener (Response Times Over Time).