Data Import Architecture Refinements (Quesnelia)

Description

Next steps:

  • POs/Olamide/Kate review this feature

  • categorize the types of changes

  • split into Q and post-Q

  • for post-Q, can we organize into a multi-release roadmap

Status

  • 14 Sept 2023: 1st high-level review done, next: move the post-Q out and then re-review/refine the possible Q issues

Current situation or problem: Various infrastructure changes to improve the performance of source record storage

Possible changes

  • Delete old, unused versions of MARC records

  • reformat SRS data schema

Out of scope

Use case(s)

Proposed solution/stories

Links to additional info

Questions

Priority

Development Team

Folijet

Assignee

Solution Architect

Parent Field Value

None

Parent Status

None

Checklist

hide

TestRail: Results

Activity

Show:

Ryan TaylorOctober 10, 2023 at 5:16 PM
Edited

Discussed with Olamide, Kate, & Ann-Marie and we decided to only commit to the top 3 stories initially prioritized for this feature. Stories 4-10 will be moved to Ramsons' Architecture feature and can be pulled into Quesnelia as Stretch work if capacity allows. Based on these changes, we've lowered the Back End estimate from XXXL to XL.

The following stories moved to UXPROD-4469 Data Import Architecture Refinements (Ramsons) and given Folijet-Quesnelia-Stretch tag

    4.) MODSOURCE-631: 4 SPIKE: figure out a way to clean up records created by a cancelled job
    5.) MODINV-844: 5 Discard Duplicate Data Import Events
    6.) MODDATAIMP-923 6 Expose Incoming Record Journey Through The System (5)
    7.) MODSOURMAN-1028 7 Save Journal Records in Batches (3)
    8.) MODSOURCE-678 8 Optimize events process query (3)
    9.) MODDATAIMP-789 9 SPIKE: Design solution to clean up temp data (5)
    10.)MODSOURCE-623 10 SPIKE: Reduce Connection Pool Size When Connections Are Idle (2)

Ann-Marie BreauxMay 2, 2023 at 5:31 AM

Hi I created this feature per our conversation from last week. There ma be other issues in the Poppy Misc feature that we should re-link to it. Should we mark this feature as Poppy?

Done

Details

Reporter

PO Rank

120

Front End Estimate

Small < 3 days

Front End Estimator

Front-End Confidence factor

90%

Back End Estimate

XL < 15 days

Back End Estimator

Back-End Confidence factor

90%

Release

Quesnelia (R1 2024)

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs

Created May 2, 2023 at 5:24 AM
Updated April 29, 2024 at 8:03 PM
Resolved April 29, 2024 at 8:03 PM
TestRail: Cases
TestRail: Runs