Data Import with Check-ins Check-outs (Quesnelia)[non-ECS]

Overview

This document contains the results of testing Check-in/Check-out and Data Import for MARC Bibliographic records in the Quesnelia release.

Ticket: PERF-824 - Getting issue details... STATUS

Summary

  • Data import tests finished successfully for all files. Duration of DI grew in correspondence with the number of records in files.
  • Check-in and Check-out with 8 virtual users was performed during DI Create and Update jobs. No issues.
  • Data Import in Quesnelia with CICO perform faster than without it.
  • Comparing Poppy and Quesnelia releases
    • Check-in / Check-out perform better in Quesnelia.  Response time improved during Create jobs - 30% in Average, and during DI Update jobs - 15% in Average.
    • DI durations do not differ much
  • Resource utilization
    • Average CPU utilization did not exceed 150% for all modules. The highest consumption observed from mod-inventory - 144% in DI Update job with 25k file. The same maximum level as in Poppy. 
    • No memory leaks observed during tests.
    • Average DB CPU usage during data import has 5% decreasing in Quesnelia - close to 90%.
    • Average connection count during data import is about 750 connections for create jobs that is 450 connections higher than in Poppy. For update jobs - 730 connections.

Test Runs 

Test #

Scenario

Load levelComment
1DI MARC Bib Create5K, 10K, 25K, 50K, 100K consequentially
CICO 8 users
2DI MARC Bib Update5K, 10K, 25K, 50K, 100K consequentially
CICO 8 users

Test Results

Data import

Files for Data Import update jobs prepared during previous tests. So no need to run Data Export.

Profile
MARC File


DI Duration

Quesnelia (hh:mm:ss)

Check In, Check Out Response time (8 users)

Quesnelia

CI Average secCO Average sec
DI MARC Bib Create (PTF - Create 2)5K.mrc00:02:320.6450.901
10K.mrc00:05:030.6280.922
25K.mrc00:11:580.6390.960
50K.mrc00:23:290.6781.003
100K.mrc00:46:070.6860.998
DI MARC Bib Update (PTF - Updates Success - 1)5K.mrc00:03:240.6280.975
10K.mrc00:06:290.6641.018
25K.mrc00:16:150.7171.062
50K.mrc00:33:330.7211.071
100K.mrc01:10:140.7391.081

Check-in/Check-out without DI

ScenarioLoad levelRequestResponse time, sec
Quesnelia
95 percaverage
Circulation Check-in/Check-out (without Data import)8 usersCheck-in0.6090.521
Check-out1.0700.803

Comparison

CICO