Batch Importer (Bib/Acq) (UXPROD-47)

[UXPROD-185] Import Orders in MARC format Created: 20/Jan/18  Updated: 29/Jan/24  Resolved: 05/Apr/23

Status: Closed
Project: UX Product
Components: None
Affects versions: None
Fix versions: Orchid (R1 2023)
Parent: Batch Importer (Bib/Acq)

Type: New Feature Priority: P2
Reporter: Cate Boerema (Inactive) Assignee: Ann-Marie Breaux (Inactive)
Resolution: Done Votes: 1
Labels: Lehigh(round_ii+mvp), acquisitions, cap-mvp, consortia-ebsco, crossrmapps, data-import, epam-folijet, galileo, loc, marcimport, orders, po-mvp
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Issue links:
Continues
is continued by UXPROD-3814 Import Orders in MARC format - Refine... Analysis Complete
Defines
defines UXPROD-47 Batch Importer (Bib/Acq) Analysis Complete
is defined by MODDATAIMP-790 Cannot create orders on Folijet Ranch... Closed
is defined by UIDATIMP-1344 Error after selecting order option on... Closed
is defined by UIDATIMP-1410 Bugfest Order field mapping profile: ... Closed
is defined by FAT-3047 Implement Karate test for Import Orde... Closed
is defined by MODDATAIMP-760 Test and make adjustments for Importi... Closed
is defined by MODDATAIMP-781 Test performance of importing Orders Closed
is defined by MODDATAIMP-791 Adjust module permissions for DI wrt ... Closed
is defined by MODDICORE-286 SPIKE: Finalise tech design Closed
is defined by MODDICORE-290 Extend Mapper for Order/OrderLines Closed
is defined by MODDICORE-303 Allow for mapping the vendor, materia... Closed
is defined by MODDICORE-305 Order import: fix product identifier ... Closed
is defined by MODDICORE-306 Order import: fix product identifier ... Closed
is defined by MODDICORE-307 Order import: fix product identifier ... Closed
is defined by MODDICORE-316 Order import: creating an order with ... Closed
is defined by MODINV-742 Check and verify created mechanism fo... Closed
is defined by MODINV-765 Implement mechanism for checking the ... Closed
is defined by MODINV-774 Set POLine id when Item is created by DI Closed
is defined by MODORDERS-373 Check that Action profile action for ... Closed
is defined by MODORDERS-773 Create "CreateOrderEventHandler" for ... Closed
is defined by MODORDERS-775 Add deduplication mechanism for Creat... Closed
is defined by MODORDERS-808 Create "OrdersPostProcessingEventHand... Closed
is defined by MODORDERS-817 Associate mapped POLines with single ... Closed
is defined by MODORDERS-823 Implement logic that defines which ev... Closed
is defined by MODORDERS-840 Extend error handling logic if can't ... Closed
is defined by MODORDERS-843 Adjust deduplication mechanism to sto... Closed
is defined by MODORDERS-844 Add cache to store organisations info... Closed
is defined by MODORDERS-851 Part 2: Adjust deduplication mechani... Closed
is defined by MODORDERS-863 Error when importing open orders that... Closed
is defined by MODORDERS-876 Extra holdings/items created for open... Closed
is defined by MODORDERS-878 Adjust prefix and suffix for generate... Closed
is defined by MODSOURCE-577 Prevent Instance PostProcessing Handl... Closed
is defined by MODSOURMAN-877 Extend mapping parameters, based on s... Closed
is defined by MODSOURMAN-932 Fill Journal Record info for Orders u... Closed
is defined by MODSOURMAN-936 Add logic in Journal Handler for Post... Closed
is defined by MODSOURMAN-937 Send DI_MARC_BIB_FOR_ORDER_CREATED ev... Closed
is defined by MODSOURMAN-946 Handle DI_ERROR event for POLines Closed
is defined by MODSOURMAN-948 Improve schema for the 'journal_recor... Closed
is defined by MODSOURMAN-951 Allow for mapping the POL's fund base... Closed
is defined by MODSOURMAN-952 Allow for mapping the POL's expense c... Closed
is defined by MODSOURMAN-954 Confirm that a MARC mapping and/or de... Closed
is defined by MODSOURMAN-955 Include OrderId to the DTO that is us... Closed
is defined by MODSOURMAN-961 Provide actual incoming records total... Closed
is defined by UIDATIMP-294 Field Mapping Profile details: Order ... Closed
is defined by UIDATIMP-1217 Create the field mapping profile for ... Closed
is defined by UIDATIMP-1231 Update the Action profile UI for Orders Closed
is defined by UIDATIMP-1257 Create the UI for the Orders JSON tab... Closed
is defined by UIDATIMP-1258 Create hotlink from "Created" in DI L... Closed
is defined by UIDATIMP-1264 Create the UI for the Orders Log info... Closed
is defined by UIDATIMP-1267 Data Import field mapping profile: En... Closed
is defined by UIDATIMP-1304 Order and Order line field mapping: V... Closed
is defined by UIDATIMP-1305 Order and Order line field mapping: C... Closed
is defined by UIDATIMP-1337 Order field mapping profile: Include ... Closed
is defined by UIDATIMP-1346 Error after selecting order option on... Closed
is defined by UIDATIMP-1361 Ensure accepted values property for "... Closed
is defined by UIDATIMP-1362 Order field mapping profile: Update t... Closed
is defined by UIDATIMP-1366 Order field mapping: Vendor field err... Closed
is defined by UIDATIMP-1367 Order field mapping profile: Show the... Closed
is defined by UIDATIMP-1368 Order field mapping profile: Show the... Closed
is defined by UIDATIMP-1371 Order line field mapping: Fix organiz... Closed
is defined by UIDATIMP-1375 Adjust UI permission for DI Settings Closed
is defined by UIDATIMP-1380 Provide "required" property for "prod... Closed
is defined by UIDATIMP-1386 Order field mapping profile: Fix the ... Closed
is defined by UIDATIMP-1387 Order field mapping profile: Fix the ... Closed
is defined by UIDATIMP-1389 Order import: creating an order with ... Closed
is defined by UIDATIMP-1396 Order field mapping profile: Make Pur... Closed
is defined by UIDATIMP-1397 Order field mapping profile: Add info... Closed
is defined by UIDATIMP-1398 Order field mapping profile: Adjust t... Closed
is defined by UIDATIMP-1399 Order field mapping profile: Adjust t... Closed
is defined by UIDATIMP-1400 Order field mapping profile: Inactiva... Closed
is defined by UIDATIMP-1401 Order field mapping profile: Inactiva... Closed
is defined by UIDATIMP-1402 Order field mapping profile: Inactiva... Closed
is defined by UIDATIMP-1408 Adjust mapping details for DI wrt PO ... Closed
is defined by UIDATIMP-1417 Order field mapping profile: Inactiva... Closed
is defined by UIDATIMP-1418 Order field mapping profile: Disable ... Closed
is defined by UIDATIMP-1419 Order field mapping profile: Cannot s... Closed
is defined by UIDATIMP-1429 Activate "Location" field for Open Or... Closed
is defined by FAT-3172 Review of C365634 test case Closed
is defined by FAT-3466 Review of C367955 Closed
is defined by FAT-3467 Review of C367952 Closed
is defined by FAT-3468 Review of C367951 Closed
is defined by FAT-3469 Review of C367954 Closed
is defined by FAT-3470 Review of C367953 Closed
is defined by MODDICORE-284 SPIKE: Gather details on mapping MARC... Closed
is defined by MODDICORE-296 Verify Order+OrderLine mapping after ... Closed
is defined by MODORDERS-753 Implement processing of DI Kafka even... Closed
is defined by MODORDERS-777 Investigate why build time increased ... Closed
is defined by MODORDERS-860 Adjust POL "create inventory" field o... Closed
is defined by MODORDSTOR-328 Add isAcknowledged field for poLine d... Closed
is defined by UIDATIMP-1214 Update the Match profile UI: Create/E... Closed
is defined by UIDATIMP-1215 Update the Action profile UI: Create/... Closed
is defined by UIDATIMP-1246 Update the Action profile UI again: C... Closed
is defined by UIDATIMP-1265 Add required field asterisks & valida... Closed
is defined by UIDATIMP-1266 Add required info icons to Order fiel... Closed
is defined by UIDATIMP-1271 Accessibility check: Data Import Fiel... Closed
is defined by UIDATIMP-1272 Accessibility check: Data Import Fiel... Closed
is defined by UIDATIMP-1291 Cover Order field mapping profile wit... Closed
is defined by UIDATIMP-1332 Accessibility errors: Data Import Fie... Closed
is defined by UIDATIMP-1333 Improve mapping profile for Orders. Closed
is defined by UIDATIMP-1342 Order field mapping profile: Address ... Closed
is defined by UIDATIMP-1348 Receiving value disappears from Order... Closed
is defined by UIDATIMP-1359 Empty Order type after switching to a... Closed
is defined by UIDATIMP-1374 Order field mapping: Typo in the Valu... Closed
is defined by UIDATIMP-1376 Add permission for viewing Order and ... Closed
is defined by UIDATIMP-1381 Add permission for viewing adding Acq... Closed
is defined by UIDATIMP-1388 Manual clearing of the Vendor/Materia... Closed
is defined by UIDATIMP-1404 Order field mapping profile: Fix the ... Closed
is defined by UIDATIMP-1405 Order field mapping profile: Fix the ... Closed
is defined by UIDATIMP-1431 Order field mapping profile: Get conf... Closed
Duplicate
is duplicated by UXPROD-2282 MARC Field Mapping Profiles Details f... Closed
Gantt End to Start
has to be done after UXPROD-1925 Holdings: Display of POL number, Orde... Closed
has to be done after UXPROD-3361 Prep for Importing Orders in MARC format Closed
Relates
relates to UXPROD-3698 Allow Orders to generate Instance wit... Draft
relates to UXPROD-3699 Records transmitted to FOLIO from GOB... Draft
relates to UXPROD-2075 MARC Bib Field Mapping Profiles Detai... Closed
relates to UXPROD-2209 Bring Action Profiles to life: next work Closed
relates to UXPROD-2286 MARC Field Mapping Profiles Details f... Closed
relates to MODORDERS-334 Update purchase order number pattern Closed
relates to UIDATIMP-234 SPIKE 2: Figure out best process for ... Closed
Release: Orchid (R1 2023)
Epic Link: Batch Importer (Bib/Acq)
Analysis Estimate: Large < 10 days
Analysis Estimator: Ann-Marie Breaux (Inactive)
Front End Estimate: XL < 15 days
Front End Estimator: Oleksii Kuzminov
Front-End Confidence factor: 90%
Back End Estimate: XXL < 30 days
Back End Estimator: Oleksii Kuzminov
Back-End Confidence factor: 90%
Development Team: Folijet
Kiwi Planning Points (DO NOT CHANGE): 65
PO Rank: 135
Rank: Chalmers (Impl Aut 2019): R5
Rank: Chicago (MVP Sum 2020): R1
Rank: Cornell (Full Sum 2021): R1
Rank: Duke (Full Sum 2021): R1
Rank: 5Colleges (Full Jul 2021): R1
Rank: FLO (MVP Sum 2020): R1
Rank: GBV (MVP Sum 2020): R5
Rank: Grand Valley (Full Sum 2021): R2
Rank: hbz (TBD): R1
Rank: Hungary (MVP End 2020): R1
Rank: Lehigh (MVP Summer 2020): R1
Rank: Leipzig (Full TBD): R5
Rank: Leipzig (ERM Aut 2019): R5
Rank: MI State-Lib of MI (Sum 2021): R1
Rank: MO State (MVP June 2020): R1
Rank: Spokane Public Library (Jan 2021): R2
Rank: TAMU (MVP Jan 2021): R1
Rank: U of AL (MVP Oct 2020): R4

 Description   

Combined with UXPROD-2282 Closed , which was closed as a duplicate

Split the Acq record types (orders and invoices) from the Inventory and MARC record types ( UXPROD-2075 Closed , UXPROD-2286 Closed )

See the Syntax and Field Types tabs of https://drive.google.com/open?id=17kCccovBR-RAVK-coW7fpXvJfaRmYA2mUHoVLSF9Spo for field mapping syntax details

Main work in this feature will be the Order field mapping profile

Help the user set mapping rules and profiles for dealing with incoming batch loads:

  • Find data elements in fields of incoming MARC Bibliographic file
  • Map to data elements of appropriate FOLIO Acquisitions records
  • Same field mapping options as MARC Inventory field mapping profiles
    • Allow for sequential mapping (first look in this field for data, then in this field)
    • Allow for defaults
    • Allow for blanking out data in existing FOLIO fields A-M check is this is needed - maybe only create, not update?
    • Allow for mappings to be created and saved as data mapping profiles, or to be created on the fly
    • Apply the rules to parse the incoming data and deliver to the FOLIO Orders app, to create orders and order lines

--------------

Bring job profiles to life for MARC Bibliographic records creating (not yet deleting) Order + Order line records

Note: This is based on UI input, not command line. Data Migration may take care of loading PO and PO Line data based on command line interaction with Order APIs.

Parse incoming order data in MARC records to identify relevant order details, package them up, and deliver to the orders app with appropriate rules, so that orders and order lines can be created.

When start importing orders and shelfready data, preference is to match on PO or Order Key and then update associated Instance, MARC Bib, Holdings, Items – make sure this is a requirement in the order import (see UXPROD-3345 Closed )

See additional details here: https://folio-org.atlassian.net/wiki/display/MM/Create+orders+by+importing+MARC+Bibliographic+Records



 Comments   
Comment by Cate Boerema (Inactive) [ 15/May/18 ]

Jakub Skoczen, we are trying to tighten up the beta planning and this item, which we have slated for development in Beta 2 isn't estimated. Could you please put a tshirt size on it (front and backend)? If you need more info, I am sure Ann-Marie Breaux can provide it.

Comment by Ann-Marie Breaux (Inactive) [ 15/May/18 ]

Cate Boerema Jakub Skoczen We're still trying to finalize overall scope of this epic. May take us another week or two to do that. Let me know if you need more details before that.

Comment by Cate Boerema (Inactive) [ 18/Nov/19 ]

Hi Ann-Marie Breaux I see this is still in draft. Do you think it at risk at this point? If so, please add the q4-2019-at-risk tag. Thanks!

Comment by Julie Brannon [ 10/Mar/21 ]

Ann-Marie Breaux: I'm slightly confused because I thought work is already underway to implement this feature.  Has it been overlooked for an R2 assignment here on the Jira issue? At Duke we're working on the feature pointing exercise and don't want to assign points to features that are already being implemented.  Any guidance you could offer would be appreciated.

Comment by Ann-Marie Breaux (Inactive) [ 10/Mar/21 ]

Hi Julie Brannon Same as UXPROD-2282 Closed . Unfortunately, it looks like we will not be able to get this done in R2 2021/Juniper. I went over the plans for Juniper with Hkaplanian, and I think the developers will have too much cleanup, bug fixes, and stabilization for functionality delivered in Iris. At this point, I'm thinking this will be the top priority for the Import devs for Kiwi (depending on the points, of course)

Comment by Mike Gorrell [ 16/Sep/21 ]

Ann-Marie Breaux - this now says Lotus/R1-2022. How is your confidence level for this?

Comment by Ann-Marie Breaux (Inactive) [ 17/Sep/21 ]

Hi Mike Gorrell Creating orders and invoices from MARC data are Folijet's top dev priorities in Lotus.

Comment by Mike Gorrell [ 17/Sep/21 ]

Great! Thanks

Comment by Ann-Marie Breaux (Inactive) [ 15/Nov/21 ]

Moved Michigan State's R1 ranking from UXPROD-2282 Closed (closed as duplicate) to this feature

Comment by Anya [ 04/Feb/22 ]

What is the target release for this? 

Comment by Ann-Marie Breaux (Inactive) [ 07/Oct/22 ]

Development has not proceeded as quickly as I hoped on this (complexity of sorting out the requirements across 2 dev teams, shortened Nolana dev period, varying functionality in Orders and Import apps). Spoke with Data Import Subgroup and Acquisitions SIG this week to explain that we will be delaying the release until Orchid, so that we have time to put all of the pieces together, identify gaps in the basic workflow, and have solid UAT. Updated the feature and all linked stories from Nolana to Orchid release value

Comment by Charlotte Whitt [ 06/Feb/23 ]

Hi Ann-Marie Breaux - in a meeting we are trying to understand the connection between:

Which feature is to be done first, and which to be done after the other.

CC: Christie Thomas Erin Nettifee Jacquie Samples

Comment by Ann-Marie Breaux (Inactive) [ 07/Feb/23 ]

Hi Charlotte Whitt This feature ( UXPROD-185 Closed ) will be completed in Orchid. I don't know when UXPROD-663 Draft will be completed. I left a comment on that feature a few minutes ago, based on a question from Erin. UXPROD-3814 Analysis Complete will probably be in the Quesnelia release, once libraries have a chance to work with the functionality of UXPROD-185 Closed . And of course if there are signficant bugs for UXPROD-185 Closed , we'll aim to take care of them during Orchid Bugfest or Poppy.

Comment by Julie Brannon [ 28/Feb/23 ]

Ann-Marie Breaux Is this feature still included in Orchid?  I'm looking at Test Rail for the upcoming BugFest and I'm not seeing test cases related to MARC import to create orders, so I wondered if maybe it will be included in Poppy instead?  Or I also might be completely missing them in Bug Fest .  Thanks!

Comment by Ann-Marie Breaux (Inactive) [ 07/Jun/23 ]

Hi Khalilah Gambrell I'm curious why this completed Folijet feature was reassigned to Spitfire. Was it perhaps a mistake? OK if I switch it back?

Generated at Fri Feb 09 00:06:22 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.