[RRT] DuplicateException is thrown when saving batch of Bib records for linked Authority (Ramsons BF clone)

Description

For some reason when handling the collection of 179 Bib records and trying to save them DuplicateException is being thrown and only part of the records (or to be precise 100) are being handled and events are being sent for them in srs.marc-bib kafka topic. Here is the error log:

2024-09-16 10:04:10.192,10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] WARN RecordDaoImpl saveRecords:: Error during batch record save,qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.192,10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] ERROR inkChunkKafkaHandler Failed to handle srs.marc-bib event,qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.192,"10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] INFO KafkaConsumerWrapper businessHandlerCompletionHandler:: Duplicate event for a record - id: 0 subscriptionPattern: SubscriptionDefinition(eventType=links.instance-authority, subscriptionPattern=qata\.\w{1,}\.links.instance-authority) offset: 1 has been skipped, logging more info about it in error handler",qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.192,"10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] WARN KafkaConsumerWrapper businessHandlerCompletionHandler:: Error handler has not been implemented for subscriptionPattern: SubscriptionDefinition(eventType=links.instance-authority, subscriptionPattern=qata\.\w{1,}\.links.instance-authority) failures",qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.191,10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] INFO RecordDaoImpl saveRecords:: Skipped saving records due to duplicate event: SQL Unique constraint violation prevented repeatedly saving the record,qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:14.193,"10:04:14 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] INFO inkChunkKafkaHandler Sending 100 bib update events for jobId c860960d-2169-429d-97e6-6265dac6d10d, authorityId 6cb16779-d12d-5105-8816-f88dc0510880",qata/mod-source-record-storage/

Environment

None

Potential Workaround

None

CSP Request Details

CSP approval requested on 12/16/2024

CSP Approved

Yes

CSP Rejection Details

None

Attachments

6
  • 27 Dec 2024, 09:55 AM
  • 27 Dec 2024, 09:55 AM
  • 27 Dec 2024, 09:55 AM
  • 27 Dec 2024, 09:55 AM
  • 27 Dec 2024, 09:55 AM
  • 27 Dec 2024, 09:55 AM

Checklist

hide

Activity

Show:

JenkinsNotifications January 25, 2025 at 3:16 PM

Deployed to the Ramsons bf env. Moved status to In bugfix review from status Awaiting deployment. Please proceed with the verification.

Natalia Zaitseva January 24, 2025 at 9:41 AM

Oleg Kurdyayev January 24, 2025 at 8:32 AM

verified in scope of https://folio-org.atlassian.net/browse/MODINV-1125 , please proceed with deployment on BF environment

cc

Oleg Kurdyayev January 9, 2025 at 2:04 PM

Testing blocked by https://folio-org.atlassian.net/browse/MODINV-1125 . It will be closed when the MODINV-1125 ticket is resolved.

JenkinsNotifications December 30, 2024 at 4:52 AM

Deployed to the Ramsons bf env. Moved status to In bugfix review from status Awaiting deployment. Please proceed with the verification.

Done

Details

RCA Group

Implementation coding issue

Assignee

Reporter

Priority

Story Points

Sprint

Development Team

Folijet

Fix versions

Release

Ramsons (R2 2024) Bug Fix

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs
Created December 27, 2024 at 9:55 AM
Updated January 29, 2025 at 12:55 PM
Resolved January 24, 2025 at 9:41 AM
TestRail: Cases
TestRail: Runs

Flag notifications