Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


error from logs 

WARN Fetcher [Consumer clientId=consumer-DI_INVENTORY_HOLDING_CREATED.mod-inventory-18.0.4-33, groupId=DI_INVENTORY_HOLDING_CREATED.mod-inventory-18.0.4] Received unknown topic or partition error in fetch for partition kcp1.Default.fs09000000.DI_INVENTORY_HOLDING_CREATED-0
@timestamp1642416090190



Profile

KIWI

KIWI (with OL)

KIWI 

with

partitions N# 2

5K MARC Create

PTF - Create 2

5 min, 8 min

8 min5 min

5K MARC Update

PTF - Updates Success - 1

11 min, 13 min

6 min7 min

10K MARC Create 

PTF - Create 2

11 min , 14 min

12 min10 min

10K MARC Update

PTF - Updates Success - 1

22 min, 24 min

15 min11 min
25K MARC CreatePTF - Create 223 mins, 25 mins, 26 mins24 min23 min
25K MARC UpdatePTF - Updates Success - 11 hour 20 mins (completed with errors) *, 56 mins40 minfailed
50K MARC CreatePTF - Create 2Completed with errors, 1 hr 40 mins43 min-
50K UpdatePTF - Updates Success - 12 hr 32 mins (job stuck at 76% completion)1hr 4min-

...

12:34:54 [] [] [] [] ERROR KafkaConsumerWrapper Consumer - id: 51 subscriptionPattern: SubscriptionDefinition(eventType=DI_SRS_MARC_BIB_RECORD_MATCHED_READY_FOR_POST_PROCESSING, subscriptionPattern=kcp1\.Default\.\w{1,}\.DI_SRS_MARC_BIB_RECORD_MATCHED_READY_FOR_POST_PROCESSING) Error while commit offset: 21596

number of partitions - 3

Image Added