PubSub updates, improvements, care and feeding of (UXPROD-3472)

[UXPROD-4381] Pubsub deprecation part 2 Created: 28/Jun/23  Updated: 30/Nov/23

Status: Open
Project: UX Product
Components: None
Affects versions: None
Fix versions: None
Parent: PubSub updates, improvements, care and feeding of

Type: New Feature Priority: TBD
Reporter: Stephanie Buck Assignee: Stephanie Buck
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Issue links:
Cloners
clones UXPROD-4328 Pubsub deprecation part 1 Draft
Defines
is defined by CIRC-1836 Move ITEM_CHECKED_OUT event publishin... Open
is defined by CIRC-1837 Move ITEM_CHECKED_IN event publishing... Open
is defined by CIRC-1838 Move ITEM_DECLARED_LOST event publish... Open
is defined by CIRC-1839 Move ITEM_AGED_TO_LOST event publishi... Open
is defined by CIRC-1840 Move ITEM_CLAIMED_RETURNED event publ... Open
is defined by CIRC-1841 Move LOAN_DUE_DATE_CHANGED event publ... Open
is defined by CIRC-1842 Move LOAN_CLOSED event publishing to ... Open
is defined by CIRC-1846 Ignore Kafka message duplicates Open
is defined by CIRCSTORE-434 Create message_outbox table Open
is defined by CIRCSTORE-435 Create Message relay for sending mess... Open
is defined by CIRCSTORE-436 Create an endpoint for handling ITEM_... Open
is defined by CIRCSTORE-437 Create an endpoint for handling ITEM_... Open
is defined by CIRCSTORE-438 Create an endpoint for handling ITEM_... Open
is defined by CIRCSTORE-439 Create an endpoint for handling ITEM_... Open
is defined by CIRCSTORE-440 Create an endpoint for handling ITEM_... Open
is defined by CIRCSTORE-441 Create an endpoint for handling LOAN_... Open
is defined by CIRCSTORE-442 Create an endpoint for handling LOAN_... Open
is defined by CIRCSTORE-444 Create CRUD for circulation events Open
is defined by MODFEE-359 Create message_outbox table Open
is defined by MODFEE-360 Create Message relay for sending mess... Open
is defined by MODFEE-361 Implement Message outbox patter for F... Open
is defined by MODFEE-362 Implement Message outbox patter for L... Open
is defined by MODPATBLK-167 Ignore Kafka message duplicates Open
Release: Not Scheduled
Epic Link: PubSub updates, improvements, care and feeding of
Back End Estimate: XXXL: 30-45 days
Back End Estimator: Alexander Kurash
Development Team: Vega
PO Rank: 0

 Description   

Current situation or problem: mod-pubsub fails to deliver some of the events for unknown reasons. This issue cannot be reliably reproduced, but it happens every now and again on production which leads to automated patron blocks failures. The data can be re-syned manually as a workaround. It is thought that this issue comes from the fact that, by introducing another layer over Kafka, mod-pubsub is losing the delivery guarantees provided by Kafka.

In scope
Phase 2 of mod-pubsub deprecation - implementation of Transactional Outbox pattern (https://microservices.io/patterns/data/transactional-outbox.html).
The goal is to guarantee that the message will only be published when the action has actually succeeded and all the necessary DB records have been updated.

Out of scope

Use case(s)

Proposed solution/stories

Links to additional info

https://folio-org.atlassian.net/wiki/display/DD/PubSub+deprecation+plan 

Questions


Generated at Fri Feb 09 00:39:29 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.