Skip to end of banner
Go to start of banner

Data Import with Check-ins Check-outs

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 23 Next »

Infrastructure

  • 6 m5.xlarge EC2 instances 
  • 2 instances of db.r6.xlarge database instances, one reader and one writer
  • MSK
    • 4 m5.2xlarge brokers in 2 zones
    • auto.create-topics.enable = true
    • log.retention.minutes=120
  • mod-inventory memory
    • 256 CPU units, 1814MB mem
    • inventory.kafka.DataImportConsumerVerticle.instancesNumber=10
    • inventory.kafka.MarcBibInstanceHridSetConsumerVerticle.instancesNumber=10
    • kafka.consumer.max.poll.records=10
  • mod-inventory-storage
    • 128 CPU units, 544MB mem
  • mod-source-record-storage
    • 128 CPU units, 908MB mem
  • mod-source-record-manager
    • 128 CPU units, 1292MB mem
  • mod-data-import
    • 128 CPU units, 1024MB mem

Software versions

  • mod-data-import v2.4.1
  • mod-data-import-converter-storage v1.13.2
  • mod-source-record-manager v3.3.8
  • mod-source-record-storage v5.3.2
  • mod-inventory v18.1.4
  • mod-inventory-storage v23.0.2

Results


MARC FileProfileTenantDI DurationCheck In (CI), Check Out (CO)




userstenantCI Average (seconds)CO Average (seconds)




8fs090000000.7041.352
25K.mrcPTF - Create 2cap100:26:59.840-

25K.mrcPTF - Create 2cap100:22:37.0938fs090000001.4802.068
25K.mrcPTF - Create 2cap100:34:53.3120fs090000003.7986.254
25K.mrcPTF - Create 2cap100:25:58.25820fs090000001.2552.074
25K_mark_autority.mrcDefault - Create SRS MARC Authoritycap100:12:26.710---
25K_mark_autority.mrcDefault - Create SRS MARC Authoritycap100:15:14.1258fs090000000.7841.248
25K_mark_autority.mrcDefault - Create SRS MARC Authoritycap100:15:09.88120fs090000002.2954.281


Comparisons

The following table compares additional test results to previous release numbers and to the CICO baselines (of Check In average time 0.704s and Checkout average time 1.352s). Note that Lotus numbers are in red, Kiwi numbers are in blue.


Profile

Duration

KIWI (Lotus) without CICO

Duration

with CICO 8 users

CheckIn average (seconds)

CheckOut average (seconds)

Deviation From the baseline CICO response times

5K MARC Create

PTF - Create 2

5 min, 8 min (05:32.264)

(08:48.556)

 5 min

(05:48.671)

1.297 

0.851


2.449

1.388

CI:  17%

CO:  3%

5K MARC Update

PTF - Updates Success - 1

11 min, 13 min

(10:07.723)

7 min

06:27.143

1.315

1.102

2.469

1.867

CI:  56%

CO:  38%

10K MARC Create

PTF - Create 2

11 min , 14 min

10:07.723

 13 min

00:10:47.622

1.407

1.354

2.795

2.271

CI:  92%

CO:  68%

10K MARC UpdatePTF - Updates Success - 122 min, 24 min15 min1.6913.041

CI:  

CO:  

25K MARC CreatePTF - Create 223 mins, 25 mins, 26 mins

31 min

32:21.273

1.536

1.248

2.962

2.078

CI:  77%

CO:  54%

25K MARC UpdatePTF - Updates Success - 127 min, 40 mins, 56mins

33 min

31:40.429

1.589

0.951

2.997

1.658

CI:  35%

CO: 23%

50K MARC CreatePTF - Create 240 mins, 43mins

63 min

47:53.93

1.783

1.271

3.231

2.095

CI:  81%

CO:  55%

50K MARC UpdatePTF - Updates Success - 164 min

FAILED


-


-

CI:  

CO:  

5k CREATE

5K marc update

10k marc create

Lotus 25K MARC Create

Lotus 25K MARC Update

Lotus 50 k marc create

  • No labels