Skip to end of banner
Go to start of banner

Data Import with Check-ins Check-outs

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 22 Next »

Infrastructure

  • 6 m5.xlarge EC2 instances 
  • 2 instances of db.r6.xlarge database instances, one reader and one writer
  • MSK
    • 4 m5.2xlarge brokers in 2 zones
    • auto.create-topics.enable = true
    • log.retention.minutes=120
  • mod-inventory memory
    • 256 CPU units, 1814MB mem
    • inventory.kafka.DataImportConsumerVerticle.instancesNumber=10
    • inventory.kafka.MarcBibInstanceHridSetConsumerVerticle.instancesNumber=10
    • kafka.consumer.max.poll.records=10
  • mod-inventory-storage
    • 128 CPU units, 544MB mem
  • mod-source-record-storage
    • 128 CPU units, 908MB mem
  • mod-source-record-manager
    • 128 CPU units, 1292MB mem
  • mod-data-import
    • 128 CPU units, 1024MB mem

Software versions

  • mod-data-import v2.4.1
  • mod-data-import-converter-storage v1.13.2
  • mod-source-record-manager v3.3.8
  • mod-source-record-storage v5.3.2
  • mod-inventory v18.1.4
  • mod-inventory-storage v23.0.2
file for DIProfiletenantduration of DI
CICO




userstenantCI Average (seconds)CO Average (seconds)




8fs090000000.7041.352
25K.mrcPTF - Create 2cap100:26:59.840-

25K.mrcPTF - Create 2cap100:22:37.0938fs090000001.4802.068
25K.mrcPTF - Create 2cap100:34:53.3120fs090000003.7986.254
25K.mrcPTF - Create 2cap100:25:58.25820fs090000001.2552.074
25K_mark_autority.mrcDefault - Create SRS MARC Authoritycap100:12:26.710---
25K_mark_autority.mrcDefault - Create SRS MARC Authoritycap100:15:14.1258fs090000000.7841.248
25K_mark_autority.mrcDefault - Create SRS MARC Authoritycap100:15:09.88120fs090000002.2954.281

Additional testing using the profile to create MARC Bibs and instances, holdings, and items. 

0.7041.352

Profile

Duration

KIWI (Lotus) without CICO

Duration

with CICO 8 users

CheckIn average (seconds)

CheckOut average (seconds)

Deviation From the baseline CICO response times

5K MARC Create

PTF - Create 2

5 min, 8 min (05:32.264)

(08:48.556)

 5 min

(05:48.671)

1.297 

0.851


2.449

1.388

CI:  17%

CO:  3%

5K MARC Update

PTF - Updates Success - 1

11 min, 13 min

(10:07.723)

7 min

06:27.143

1.315

1.102

2.469

1.867

CI:  56%

CO:  38%

10K MARC Create

PTF - Create 2

11 min , 14 min

10:07.723

 13 min

00:10:47.622

1.407

1.354

2.795

2.271

CI:  92%

CO:  68%

10K MARC UpdatePTF - Updates Success - 122 min, 24 min15 min1.6913.041

CI:  

CO:  

25K MARC CreatePTF - Create 223 mins, 25 mins, 26 mins

31 min

32:21.273

1.536

1.248

2.962

2.078

CI:  77%

CO:  54%

25K MARC UpdatePTF - Updates Success - 127 min, 40 mins, 56mins

33 min

31:40.429

1.589

0.951

2.997

1.658

CI:  35%

CO: 23%

50K MARC CreatePTF - Create 240 mins, 43mins, 

63 min

47:53.93

1.783

1.271

3.231

2.095

CI:  81%

CO:  55%

50K MARC UpdatePTF - Updates Success - 164 min

FAILED


-


-

CI:  

CO:  

5k CREATE

5K marc update

10k marc create

Lotus 25K MARC Create

Lotus 25K MARC Update

Lotus 50 k marc create

  • No labels