Creating multiple large invoices quickly from Data Import failed (JUNIPER HF)

Description

Purpose/Overview:
Support large EDIFACT invoices import file. The attached file has 18 invoices, with a total of 1104 invoice lines.
NOTE: This does NOT mean that a single invoice is larger than 999 lines. In this particular file, the largest is 100 lines. But there are multiple invoices, so the total lines across all invoices is more than 1000.

Requirements/Scope:

  1. EDIFACT file can contain hundreds invoices with thousands invoice lines must finished successfully.

Approach:
1. Limit number of invoice lines to process in parallels. Make sense to implement buffer for processing.
2. Also take a look SELECT requests in the mod-orders-storage and optimize them ()

Acceptance criteria:

  • As long as the data contains all required fields, the Invoices app creates all invoices and invoice lines passed to it from Data Import, and then reports back for display in the Data Import UI log.

  • AC

CSP Request Details

Data Import fix approved by CPT on Slack release_bug_triage channel 21 Sept 2021 (MODDICORE-177). Since it appears to be an Acq problem instead, copying that approval to this Jira.

CSP Rejection Details

None

Potential Workaround

None

Attachments

3

Checklist

hide

TestRail: Results

Activity

Show:

Ann-Marie Breaux November 29, 2021 at 10:24 AM
Edited

Tested on Juniper BF with the following files and profiles:

  • 20201114072017.EDI Create Large Harrassowitz serial invoice IMD+L (9 invoices, 1326 lines)

  • 20211112095358.24-SER.subs.edi Create Large Harrassowitz serial invoice MOA+39 (17 invoices, 277 lines)

  • 20191130072046.TAMUSER.edi Create Large Harrassowitz serial invoice (18 invoices, 1104 lines)

  • ALE0092.R110817.T100818.INV Create large EBSCO subscription invoice (31 invoices, 1732 lines)

All successfully created all invoices and invoice lines. I did need to adjust the TAMU field mapping profile to default the currency instead of reading it in from the file, to clear errors for a few invoice lines, but that's no big deal. Bottom line: Beautiful! Closing this Jira.

cc:

Oleksii Petrenko November 26, 2021 at 4:35 PM

Deployed to Juniper BF. Please proceed with verifications

Kateryna Senchenko November 24, 2021 at 12:33 PM

Hi everyone,

This issue should be retested once  is resolved, blocking until then

Dennis Bridges November 23, 2021 at 5:02 PM

Just making note here that an issue was identified and Folijet was alerted.

Ann-Marie Breaux November 22, 2021 at 12:48 PM

Hi Just wanted to check on this issue, as we have our next go/no-go for Juniper HF4 today. Is there anything being worked on by Thunderjet in relation to this Jira? If yes, any updates on when it might be ready?

Done

Details

Assignee

Reporter

Tester Assignee

Priority

Story Points

Sprint

Development Team

Thunderjet

Fix versions

Release

R2 2021 Hot Fix #4

RCA Group

Data related (ex. Can be detected with large dataset only)

CSP Approved

Yes

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs
Created November 2, 2021 at 10:50 AM
Updated June 27, 2022 at 9:29 AM
Resolved November 26, 2021 at 12:09 PM
TestRail: Cases
TestRail: Runs