Features that will be implemented to enhance FOLIO's ability to support consortia (Phase 1) (UXPROD-4049)

[UXPROD-4094] Reports on bad data encountered during harvests Created: 24/Feb/23  Updated: 30/Nov/23  Resolved: 18/Sep/23

Status: Closed
Project: UX Product
Components: None
Affects versions: None
Fix versions: Poppy (R2 2023)
Parent: Features that will be implemented to enhance FOLIO's ability to support consortia (Phase 1)

Type: New Feature Priority: P2
Reporter: Magda Zacharska Assignee: Magda Zacharska
Resolution: Done Votes: 0
Labels: OAI-PMH-Support
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Issue links:
Continues
continues UXPROD-4006 Harvesting bad data Closed
Defines
is defined by MODOAIPMH-494 Make records with bad data available ... Closed
is defined by MODOAIPMH-514 Purge error logs Closed
is defined by MODOAIPMH-515 Export harvest logs into csv format Closed
is defined by UIOAIPMH-67 Display list of recently run harvests Closed
Release: Poppy (R2 2023)
Epic Link: Features that will be implemented to enhance FOLIO's ability to support consortia (Phase 1)
Front End Estimate: Small < 3 days
Front End Estimator: Vadym Shchekotilin
Front-End Confidence factor: 80%
Back End Estimate: XL < 15 days
Back End Estimator: Viachaslau Khandramai (Inactive)
Back-End Confidence factor: 80%
Development Team: Firebird
PO Rank: 0

 Description   

Current situation or problem:
In UXPROD-4006 Closed the bad data encountered in during harvest is logged into OAI-PMH logs that is not easily accessible to the harvesting client software. This feature will help make this information available also to the librarians who try troubleshoot discovery issues.

In scope
If the record contains invalid data (nonexisting reference data identifiers, invalid characters) then instead of logging the records in the log the records is:

  • in a separate storage area (S3/minIO)
  • the stored data contains:
    • identifier of the harvest
    • identifier of the affected record
    • cause of the error
  • provide an endpoint to retrieve the information about the bad data
  • UI component to display this information in a user friendly way

Generated at Fri Feb 09 00:37:13 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.