[FOLIO-3681] Extend solution that will update Instances when MARC Bib-Instance mapping rules have changed Created: 05/Jan/23  Updated: 30/Nov/23  Resolved: 11/Oct/23

Status: Closed
Project: FOLIO
Components: None
Affects versions: None
Fix versions: None

Type: Task Priority: TBD
Reporter: Shans Kaluhin Assignee: Shans Kaluhin
Resolution: Won't Do Votes: 0
Labels: back-end, epam-spitfire
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Issue links:
Cloners
clones FOLIO-3659 Create solution that will update MARC... Closed
Relates
relates to UXPROD-3969 Improve solution that will refresh In... Open
relates to MODSOURCE-718 [RRT] Script to Refresh Instances fails. Closed
Sprint:
Story Points: 3
Development Team: Spitfire

 Description   

Approach
Create a java app that has to do the update work:
1. Create data-import job profile for MARC-to-MARC matching by 999ff$s subfield and update bibliographic record. Job/Match/Action/Mapping profiles will be hidden

  • Job Profile: Release Upgrade - Migrate MARC bibliographic records 
  • Action Profile: Release Upgrade - Migrate MARC bibliographic records 
  • Match Profile: Release Upgrade - Migrate MARC bibliographic records 
  • Mapping Profile: Release Upgrade - Migrate MARC bibliographic records

2. Load bibliographic records by pages of 50k (should be configurable) from SRS (GET /source-storage/records?recordType=MARC_BIB&state=ACTUAL&offset=<P>&limit=<N>
3. Verify that createdDate & updatedDate of records are older that time of script launch (If new records was detected - update totalRecords)
4. Prepare mrc file or JSON payload (README)
5. Initialize data-import job
6. Wait until the data-import job finished (GET /change-manager/jobExecutions/<id> and check status of job)
7. Load the next page and repeat 3-6 until there are no authority records left.
8. Delete the job profile created in 1st step
9. Logging should exist to indicate N of batch that is in progress now.

Validate that a user can view Job status

  • job status is shown on the Data Import Logs UI
  • For each record update, user can view SRS/MOD-Inventory-Storage output

Documentation 

  • Instructions must be provided to Hosting providers/System administrators for using the standalone application 
    • Must consider that some libraries have already upgraded to Morning Glory weeks/months before this implementation. 
    • Include a note that this should be run off-hours
  • Release notes for Morning Glory and Nolana should be updated and include link to Instructions 

Testing - MORE details to discuss

  • Need a story for PTF
  • Need an environment(s) to test 
    • Upgrade Lotus > Morning Glory   
      • Work with FSE? 
    • Upgrade Morning Glory > Nolana
      • Work with FSE?   

 



 Comments   
Comment by Ann-Marie Breaux (Inactive) [ 18/Jan/23 ]

Hi Shans Kaluhin and Khalilah Gambrell OK if Folijet adopts this Jira? We plan to make it a spike under feature UXPROD_3969, and look into it once the Spitfire Authority one has been exercised more

Generated at Thu Feb 08 23:29:55 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.