Batch Importer (Bib/Acq) (UXPROD-47)

[UXPROD-4446] Deleting old versions of records from SRS Created: 23/Aug/23  Updated: 05/Feb/24

Status: Draft
Project: UX Product
Components: None
Affects versions: None
Fix versions: Ramsons (R2 2024)
Parent: Batch Importer (Bib/Acq)

Type: New Feature Priority: P2
Reporter: Ann-Marie Breaux (Inactive) Assignee: Ryan Taylor
Resolution: Unresolved Votes: 0
Labels: data-import, epam-folijet, folijet-olamide, loc, possible-ramsons
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Attachments: PNG File UXPROD-4446.png    
Issue links:
Defines
defines UXPROD-47 Batch Importer (Bib/Acq) Analysis Complete
is defined by MODSOURMAN-857 SPIKE: investigate deleting old versi... Open
Release: Ramsons (R2 2024)
Epic Link: Batch Importer (Bib/Acq)
Front End Estimate: Small < 3 days
Front End Estimator: Oleksandr Hladchenko
Front-End Confidence factor: 70%
Back End Estimate: Medium < 5 days
Back End Estimator: Kateryna Senchenko
Back-End Confidence factor: 60%
Development Team: Folijet
PO Rank: 70

 Description   

Current situation or problem:
When SRS records are updated, the previous version is marked as old (and the newest version is marked as actual), but the older versions are not deleted. Over time, many, many previous versions of records will build up in SRS and potentially affect performance. There are also lots of "trash" data saved to SRS as a result of failed or stopped imports (records linked to a snapshot/jobExecution that is Cancelled or records that don't have 999 ff i UUIDs) - consider ways to clean up that data as well.

In scope

Out of scope

Use case(s):

Proposed solution/stories:

Links to additional info:

Questions for developers:
*If UI import log related to the previous version of a record has not yet been deleted, what would happen if an SRS record related to the log was deleted. Would it break the log? Do we need to prevent SRS records from being deleted if they are still connected to an import log in the UI?

  • Should we plan to keep the current and most recent previous? (would that be helpful for when we implement the rollback feature?)
  • Would there be any issues related to the various UUIDs assigned during imports?
  • Would there be any issues related to
    • quickMARC updates?
    • LDP data extracts?
    • Data export
    • OAI-PMH
  • OK for it to apply to all SRS records? all 3 MARC types, EDIFACT invoices?
  • How often to run the cleanup? Make it variable in the MOD or UI settings?
  • How much effort would this be? T-shirt sizes for UI and BE

Questions for SMEs

  • Any specific requirements?
  • Any questions or concerns?

Results of this spike

  • Wiki page with design
  • All required Jira stories
  • T-shirt sizes for UI and MOD

Generated at Fri Feb 09 00:39:59 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.