Page Comparison

...

1. Optimize Insert & Update of marc_records_lb in mod-source-record-storage - to be finished in Poppy

   Jira Legacy
   server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODSOURCE-601

   •  Implementation
   •  Some additional changes and merging
   •  

     Testing: preliminary results - basic import of 50k MARC Bibs + Create Inventory Instances takes 34 min (Orchid results - 54 min)

     Image Modified

                                                  

2. Enable R/W split for mod-source-record-manager

   Jira Legacy
   server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODSOURMAN-966

   •  Preliminary investigation: Synchronization of read instance with main is not fast enough causing errors for single record operations
   •  Implement a short-term solution: rewrite request for get job execution by id to go to a main instance of the DB - can be done in Poppy
   •  Test to make sure there are no other places that could be affected by R/W split
   •  Investigate more thoroughly and define more elaborate solution
     • Notes: Performance Improvement EPIC: Enable Read/Write
3. Configure external storage for uploading files and schedule its processing

   Jira Legacy
   server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key ARCH-19

   Jira Legacy
   server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODDATAIMP-392

    
   •  Define approach
   •  Create and estimate implementation stories
   •  Implement
     • Notes: Notes on scalability of mod-data-import
4. Refactor mod-source-record-storage to move away from storing data in jsonb

   Jira Legacy
   server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODSOURCE-627

   •  Define approach
   •  Create and estimate implementation stories
   •  Implement
   •  Test
     • Notes: PostgreSQL JSONB is not for free
5. Optimize DI import flow (possibly remove post-processing step for Create Instance action)

   Jira Legacy
   server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODDATAIMP-744

   •  Explore possibility to remove post-processing for Create Instance action - to be done in Poppy
   •  Define approach
   •  Create and estimate implementation stories
   •  Implement
     • Notes: 1. Create MARC Bib, create Instance, Holdings, Item - see diagram, steps 25-30 can be simplified potentially
6. Create indexes for 010 and 035 MARC fields in mod-source-record-storage
   •  Implementation done in Orchid 
     • Notes: This change has impact on Update jobs with MARC-to-Marc matching on 010 or 035 fields
7. Configure MAX connection pool size and timeout

...