Exporting Orders and Importing Invoices in EDIFACT format (Thunderjet work) (UXPROD-1153)

[UXPROD-195] Import invoice in EDIFACT format (Folijet work) Created: 20/Jan/18  Updated: 02/Aug/21  Resolved: 28/Apr/21

Status: Closed
Project: UX Product
Components: None
Affects versions: None
Fix versions: R1 2021
Parent: Exporting Orders and Importing Invoices in EDIFACT format (Thunderjet work)

Type: New Feature Priority: P2
Reporter: Ann-Marie Breaux (Inactive) Assignee: Ann-Marie Breaux (Inactive)
Resolution: Done Votes: 0
Labels: EDI, Showstopper-5Colleges, Showstopper-Chicago, Showstopper-MichiganState, Showstopper-TAMU, acquisitions, cap-mvp, data-import, invoices, po-mvp, q3-2020-stretch, q4-2019-at-risk, q4-2019-spillover, r1-2021-at-risk, r1-2021-stretch, r1-highlight
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Attachments: File DukeHRSW20200620072009.edi    
Issue links:
Continues
is continued by UXPROD-3068 EDIFACT invoice import refinement Draft
Defines
is defined by MODSOURMAN-443 Iris Bugfest: EDIFACT invoices get stuck Closed
is defined by MODDATAIMP-317 SPIKE- Research Open source parser fo... Closed
is defined by MODDATAIMP-328 SPIKE - Research data structure schem... Closed
is defined by MODDATAIMP-330 SPIKE - Research EDIFACT record readi... Closed
is defined by MODDATAIMP-339 SPIKE - Review EDIFACT syntax details... Closed
is defined by MODDATAIMP-364 Set up Rancher env for EDIFACT invoic... Closed
is defined by MODDATAIMP-373 Fill Rancher environment via sample d... Closed
is defined by MODDICONV-164 Create default EDIFACT field mapping ... Closed
is defined by MODDICONV-165 Create default EDIFACT field mapping ... Closed
is defined by MODDICONV-166 Create default EDIFACT field mapping ... Closed
is defined by MODDICONV-172 Update default EDIFACT mapping profil... Closed
is defined by MODINVOICE-227 Implement action profile handler for ... Closed
is defined by MODINVOICE-231 Logic for Invoice line data from Purc... Closed
is defined by MODSOURCE-249 Receive event with parsed EDIFACT rec... Closed
is defined by MODSOURMAN-408 Publish event about EDIFACT record cr... Closed
is defined by MODDATAIMP-352 Implement source reader for EDIFACT f... Closed
is defined by MODDICORE-115 Add implementation for EDIFACT reader Closed
is defined by MODDICORE-116 Support for invoice adjustments mapping Closed
is defined by MODDICORE-117 Create invoice and multiple invoice l... Closed
is defined by MODINVOICE-108 Create EDIFACT invoice parser to crea... Closed
is defined by MODSOURCE-233 Support for storing EDIFACT records i... Closed
is defined by MODSOURCE-234 CRUD operations support for EDIFACT r... Closed
is defined by MODSOURMAN-399 Implement processing of EDIFACT recor... Closed
is defined by UIDATIMP-868 Adjust "vendor name" field value Closed
is defined by MODINVOICE-229 Logic for POL-Invoice line matching -... Closed
Gantt End to End
has to be finished together with UXPROD-2622 Support for "Import invoice in EDIFAC... Closed
has to be finished together with UXPROD-2847 Part 2 - Support for "Import invoice ... Closed
Relates
relates to UXPROD-1381 CRUD for EDIFACT Invoice Field Mappin... Closed
relates to UXPROD-1152 CRUD invoices and resolve/process inv... Closed
relates to UXPROD-190 Create/Renew orders in FOLIO from EBS... Closed
Epic Link: Exporting Orders and Importing Invoices in EDIFACT format (Thunderjet work)
Analysis Estimate: Medium < 5 days
Front End Estimate: Small < 3 days
Back End Estimate: XXL < 30 days
Back End Estimator: Oleksii Kuzminov
Development Team: Folijet
PO Rank: 99
Rank: Chalmers (Impl Aut 2019): R5
Rank: Chicago (MVP Sum 2020): R1
Rank: Cornell (Full Sum 2021): R1
Rank: Duke (Full Sum 2021): R1
Rank: 5Colleges (Full Jul 2021): R1
Rank: FLO (MVP Sum 2020): R4
Rank: GBV (MVP Sum 2020): R4
Rank: hbz (TBD): R4
Rank: Hungary (MVP End 2020): R1
Rank: Lehigh (MVP Summer 2020): R1
Rank: Leipzig (Full TBD): R1
Rank: Leipzig (ERM Aut 2019): R4
Rank: MI State-Lib of MI (Sum 2021): R1
Rank: MO State (MVP June 2020): R1
Rank: St. Michael's College (Sum 2021): R1
Rank: TAMU (MVP Jan 2021): R1
Rank: U of AL (MVP Oct 2020): R1
Score: 7
Showstopper for Summer 2021 Implementers?: Yes
Showstopper Comments from Summer 2021 Implementers: [Steven from Five Colleges: Five Colleges Showstopper Majority of invoices now loaded as EDI. Not having this would be a cause an major slowdown in Invoice processing] [John from TAMU: I'll second Steven's comment. About 80% of our invoices are loaded via EDI for one time and recurring purchases so this is a showstopper.] [Response from Ann Marie: We are going to have the UI work done in Iris (being able to create a field mapping profile, action, and job profile). The acquisitions dev team is also doing some prep work so that we can connect Data Import and Invoices. The actual connection work and testing will be early in Juniper. My intention is also to have data import provide default field mapping profiles for all the vendors who have been identified so far (12 vendors), which can be edited, duplicated, or deleted by the library. That should make the setup work easier for everyone.] [Tod from Chicago: This is a showstopper for us as well. From Scott: "There are ~ 6,000 lines created this way annually, almost all of them in the months of November/December (when the large serial renewal invoices are issued)." The staffing increase needed to handle these in a short time is not just possible.][Kay and Shawn from MI St U. All workflows are built around import of EDI invoices, we are not staffed to pay one at a time.]
Showstopper December 11 Meeting Summary: This is a 'showstopper' for 4 libraries, and a major annoyance for others like Cornell. This feature mostly impacts big libraries, and is the last feature in a trio. Thunderjet's is responsible for one of three features, and has split it in two (part 2 is UXPROD-2847). This is the final feature that pulls everything together. TAMU needs the feature 1 month before implement, but the other libraries indicated that a month after implementation would be o.k. (Given a month before implementation for TAMU is July 1, perhaps we should aim for that?)
Showstopper Capacity Planning Team Recommendation: The Capacity Planning Team recommended to the FOLIO Product Council that the Iris release date be extended to May 3 (from March 1) so that all of the at-risk 'showstopper' features could be completed and released before the July implementations. (Slide deck presented to PC: https://docs.google.com/presentation/d/12s_fs3vqjm4hAGIfZ_HX1jm--v8QOEFber5uvo0VTGw/edit?usp=sharing)
Showstopper FOLIO Product Council Decision: FOLIO Product Council compromised and allowed the Iris release to be delayed by one month, to April 5. Due to the size of the t-shirt estimate for this feature, it is not likely to be completed as part of the Iris release (Holly is confirming with Anne-Marie, but she is out right now). The Capacity Planning Team will be meeting to discuss how/when this feature will be delivered to the libraries needing it before implementation.

 Description   

Purpose: This mechanism will allow the automation of Invoice/Invoice line creation for Vendors that can supply EDIFACT invoices (e.g. EBSCO, GOBI, Harrassowitz, WT Cox, etc.)

High-Level Requirements:

  • Receive EDIFACT files in a specified location
  • Create a couple event handlers
  • Parser
  • Test with invoices from the key vendors

Confirm which vendors, in which order, will be contacted and tested with

If other formats needed (e.g. xInvoice for Europe, add more features to cover those)

Note that this feature relies on Data Import's development of EDIFACT field mapping profiles ( UXPROD-1381 Closed )

Per Oleksii Kuzminov and Taras Spashchenko: may require a research spike to look at available open source EDIFACT parsers/libraries (similar to MARC4J for MARC records; decided that we will use staedi library

Here is the Google Drive folder with official documentation, draft of field mapping syntax, default profiles, and sample invoices: https://drive.google.com/drive/folders/1ePm2M3FcHIZFVolxD4-WX8joEc1S_iVC



 Comments   
Comment by Steve Bischof [ 09/Dec/20 ]

Five Colleges Showstopper Majority of invoices now loaded as EDI. Not having this would be a cause an major slowdown in Invoice processing

Comment by John Ballestro [ 09/Dec/20 ]

I'll second Steven's comment. About 80% of our invoices are loaded via EDI for one time and recurring purchases so this is a showstopper.

Comment by Ann-Marie Breaux (Inactive) [ 10/Dec/20 ]

Hi John Ballestro and Steve Bischof We are going to have the UI work done in Iris (being able to create a field mapping profile, action, and job profile). The acquisitions dev team is also doing some prep work so that we can connect Data Import and Invoices. The actual connection work and testing will be early in Juniper. My intention is also to have data import provide default field mapping profiles for all the vendors who have been identified so far (12 vendors), which can be edited, duplicated, or deleted by the library. That should make the setup work easier for everyone.

cc: Dennis Bridges

Comment by Tod Olson [ 10/Dec/20 ]

Chicago - This is a showstopper for us as well. From Scott:

There are ~ 6,000 lines created this way annually, almost all of them in the months of November/December (when the large serial renewal invoices are issued).

The staffing increase needed to handle these in a short time is not just possible.

Comment by Jeremy Huff [ 18/Dec/20 ]

This Java library seems to be a popular solution for parsing EDIFACT: http://www.smooks.org/

Generated at Fri Feb 09 00:06:27 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.