[RRT] DuplicateException is thrown when saving batch of Bib records for linked Authority (Ramsons BF clone)
Description
Environment
None
Potential Workaround
None
CSP Request Details
CSP approval requested on 12/16/2024
CSP Approved
Yes
CSP Rejection Details
None
Attachments
6
- 27 Dec 2024, 09:55 AM
- 27 Dec 2024, 09:55 AM
- 27 Dec 2024, 09:55 AM
- 27 Dec 2024, 09:55 AM
- 27 Dec 2024, 09:55 AM
- 27 Dec 2024, 09:55 AM
blocks
clones
is blocked by
Checklist
hideActivity
Show:
JenkinsNotifications January 25, 2025 at 3:16 PM
Deployed to the Ramsons bf env. Moved status to In bugfix review from status Awaiting deployment. Please proceed with the verification.
Natalia Zaitseva January 24, 2025 at 9:41 AM
waiting for https://folio-org.atlassian.net/browse/MODINV-1125 on BF env
Oleg Kurdyayev January 24, 2025 at 8:32 AM
verified in scope of https://folio-org.atlassian.net/browse/MODINV-1125 , please proceed with deployment on BF environment
cc @Maksym Ishchenko
Oleg Kurdyayev January 9, 2025 at 2:04 PM
Testing blocked by https://folio-org.atlassian.net/browse/MODINV-1125 . It will be closed when the MODINV-1125 ticket is resolved.
JenkinsNotifications December 30, 2024 at 4:52 AM
Deployed to the Ramsons bf env. Moved status to In bugfix review from status Awaiting deployment. Please proceed with the verification.
Done
Details
Details
RCA Group
Implementation coding issue
Assignee
Aliaksandr Fedasiuk
Aliaksandr FedasiukReporter
Ruslan Lavrov
Ruslan LavrovPriority
Story Points
0
Sprint
None
Development Team
Folijet
Fix versions
Release
Ramsons (R2 2024) Bug Fix
TestRail: Cases
Open TestRail: Cases
TestRail: Runs
Open TestRail: Runs
Created December 27, 2024 at 9:55 AM
Updated January 29, 2025 at 12:55 PM
Resolved January 24, 2025 at 9:41 AM
TestRail: Cases
TestRail: Runs
For some reason when handling the collection of 179 Bib records and trying to save them DuplicateException is being thrown and only part of the records (or to be precise 100) are being handled and events are being sent for them in
srs.marc-bib
kafka topic. Here is the error log:2024-09-16 10:04:10.192,10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] WARN RecordDaoImpl saveRecords:: Error during batch record save,qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.192,10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] ERROR inkChunkKafkaHandler Failed to handle srs.marc-bib event,qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.192,"10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] INFO KafkaConsumerWrapper businessHandlerCompletionHandler:: Duplicate event for a record - id: 0 subscriptionPattern: SubscriptionDefinition(eventType=links.instance-authority, subscriptionPattern=qata\.\w{1,}\.links.instance-authority) offset: 1 has been skipped, logging more info about it in error handler",qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.192,"10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] WARN KafkaConsumerWrapper businessHandlerCompletionHandler:: Error handler has not been implemented for subscriptionPattern: SubscriptionDefinition(eventType=links.instance-authority, subscriptionPattern=qata\.\w{1,}\.links.instance-authority) failures",qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:10.191,10:04:10 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] INFO RecordDaoImpl saveRecords:: Skipped saving records due to duplicate event: SQL Unique constraint violation prevented repeatedly saving the record,qata/mod-source-record-storage/4c69d5be3283405ab052204bca345606,094560336093:qata-folio-eis 2024-09-16 10:04:14.193,"10:04:14 [] [fs00001069] [bdf03f05-ffdb-43e8-86c7-c5d72bef30c7] [] INFO inkChunkKafkaHandler Sending 100 bib update events for jobId c860960d-2169-429d-97e6-6265dac6d10d, authorityId 6cb16779-d12d-5105-8816-f88dc0510880",qata/mod-source-record-storage/