Batch Importer (Bib/Acq) (UXPROD-47)

[UXPROD-2075] MARC Bib Field Mapping Profiles Details for Inventory records Created: 30/Sep/19  Updated: 06/Oct/21  Resolved: 10/Jul/20

Status: Closed
Project: UX Product
Components: None
Affects versions: None
Fix versions: Q2 2020
Parent: Batch Importer (Bib/Acq)

Type: New Feature Priority: P2
Reporter: Ann-Marie Breaux (Inactive) Assignee: Ann-Marie Breaux (Inactive)
Resolution: Done Votes: 0
Labels: Lehigh(round_ii+mvp), acq-dataimp, cap-mvp, data-import, delimited_files, marcimport, po-mvp, q2, q3-2019-spillover, q4-2019-spillover, round_ii, split
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Issue links:
Defines
defines UXPROD-47 Batch Importer (Bib/Acq) Analysis Complete
is defined by MODDICONV-108 Backend save process doesn't clean up... Closed
is defined by MODPUBSUB-93 Import job gets stuck on folio-snapsh... Closed
is defined by UIDATIMP-443 More than one record cannot be create... Closed
is defined by UIDATIMP-456 Mapping Profiles Form existing record... Closed
is defined by MODDICORE-6 Mapping profile engine Closed
is defined by MODDICORE-8 Create PoC for mapping engine and des... Closed
is defined by MODDICORE-10 Add implementation for MARC reader Closed
is defined by MODDICORE-11 Implement the Instance writer Closed
is defined by MODDICORE-12 Implement the Holding writer Closed
is defined by MODDICORE-54 Field mappings: Date picker ###TODAY#... Closed
is defined by MODDICORE-55 Field mappings: Date picker "else" lo... Closed
is defined by MODDICORE-62 Accepted values fields ignored in sub... Closed
is defined by MODDICORE-65 Field mappings: Reference dropdowns -... Closed
is defined by UIDATIMP-15 Data Import Field Mapping Profile det... Closed
is defined by UIDATIMP-290 Data Import Field Mapping Profile det... Closed
is defined by UIDATIMP-292 Data Import Field Mapping Profile det... Closed
is defined by UIDATIMP-368 Data Import field mapping profile det... Closed
is defined by UIDATIMP-377 SPIKE: Define API Contract for Mappin... Closed
is defined by UIDATIMP-381 Unlink action profile from field mapp... Closed
is defined by UIDATIMP-400 Data Import field mapping profile det... Closed
is defined by UIDATIMP-401 Data Import field mapping profile det... Closed
is defined by UIDATIMP-402 Data Import field mapping profile det... Closed
is defined by UIDATIMP-407 Data Import field mapping profile det... Closed
is defined by UIDATIMP-408 Validation for MARC Field mapping syntax Closed
is defined by UIDATIMP-469 Augment MappingProfilesForm static vi... Closed
is defined by UIDATIMP-471 Distinguish not mapped and unmappable... Closed
is defined by UIDATIMP-477 Create a "value prohibited" control c... Closed
is defined by UIDATIMP-482 When deleting a mapped value for a re... Closed
is defined by UIDATIMP-500 Initial data doesn't show up for chec... Closed
is defined by UIDATIMP-501 withRepeatableActions decorator doesn... Closed
is defined by UIDATIMP-506 Field mappings: Item - Incorrect posi... Closed
is defined by UIDATIMP-507 Field mappings: Repeatable field drop... Closed
is defined by UIDATIMP-511 Field mappings: Reference dropdowns -... Closed
is defined by UIDATIMP-512 Field mappings: Reference dropdowns -... Closed
is defined by UIDATIMP-513 Field mappings: Reference dropdowns -... Closed
is defined by UIDATIMP-514 Field mappings: Reference dropdowns -... Closed
is defined by UIDATIMP-515 Field mappings: Reference dropdowns -... Closed
is defined by UIDATIMP-516 Field mappings: Reference dropdowns -... Closed
is defined by UIDATIMP-518 Change placement of repeatable decora... Closed
is defined by UIDATIMP-519 extend DTO with acceptedValues array Closed
is defined by UIDATIMP-523 Field mappings: Date picker - Instanc... Closed
is defined by UIDATIMP-538 Field mapping: Instance, Holding, Ite... Closed
is defined by UIDATIMP-540 Save profile button on edit mode beco... Closed
is defined by UIDATIMP-542 Field mappings: Holdings - Holdings t... Closed
is defined by UIDATIMP-543 Field mappings: Holdings - Digitizati... Closed
is defined by UIDATIMP-544 Adjust mapping rules for repeatable f... Closed
is defined by UIPFIMP-10 Wording in action profile relink moda... Closed
is defined by MODDICONV-82 Update mapping profile Closed
is defined by MODDICONV-98 Extend MappingProfile data structure ... Closed
is defined by MODDICONV-135 Field mappings: Repeatable fields dro... Closed
is defined by MODDICORE-13 Implement the Item writer Closed
is defined by MODDICORE-31 Implement rule processor to work with... Closed
is defined by MODDICORE-61 Field mappings: Repeatable fields dro... Closed
is defined by MODDICORE-66 Mapping exception in mod-inventory wi... Closed
is defined by UIDATIMP-231 SPIKE: Figure out best process for bu... Closed
is defined by UIDATIMP-234 SPIKE 2: Figure out best process for ... Closed
is defined by UIDATIMP-235 SPIKE 3: Figure out best process for ... Closed
is defined by UIDATIMP-236 SPIKE 4: Figure out best process for ... Closed
is defined by UIDATIMP-279 Attach one or more action profiles to... Closed
is defined by UIDATIMP-336 Typo in a field mapping profile modal Closed
is defined by UIDATIMP-360 New UI components for field mapping d... Closed
is defined by UIDATIMP-361 Syntax for field mapping details Closed
is defined by UIDATIMP-364 Field mapping UI component: Toggle bu... Closed
is defined by UIDATIMP-365 Field mapping UI component: Key-value... Closed
is defined by UIDATIMP-366 Field mapping UI component: Input/Sel... Closed
is defined by UIDATIMP-367 Field mapping UI component: Repeatabl... Closed
is defined by UIDATIMP-403 Data Import field mapping profile det... Closed
is defined by UIDATIMP-406 Cover Mapping Profile Form with tests... Closed
is defined by UIDATIMP-442 Cover Mapping Profile Form with tests... Closed
is defined by UIDATIMP-445 Render Repeatable Fields as MultiColu... Closed
is defined by UIDATIMP-470 Field mapping profile details section... Closed
is defined by UIDATIMP-472 Field mapping profile - Add line abov... Closed
is defined by UIDATIMP-475 Field mapping profile details for Ite... Closed
is defined by UIDATIMP-476 Field mapping profiles for Instance: ... Closed
is defined by UIDATIMP-502 Layout styles are broken in repeatabl... Closed
is defined by UIDATIMP-503 Field mappings: Instance - 1st checkb... Closed
is defined by UIDATIMP-504 Field mappings: Holdings - Conflict b... Closed
Relates
relates to UXPROD-1397 Generating a MARC bibliographic recor... Closed
relates to UXPROD-185 Import Orders in MARC format Closed
relates to UXPROD-2286 MARC Field Mapping Profiles Details f... Closed
relates to UXPROD-2550 MARC Bib Field Mapping Profiles Detai... Closed
relates to UXPROD-3361 Prep for Importing Orders in MARC format Closed
relates to UIDATIMP-410 Small problems when duplicating profi... Closed
relates to UXPROD-149 Create Instance records from a MARC b... Closed
relates to UXPROD-1380 CRUD for MARC Field Mapping Profiles,... Closed
relates to UXPROD-1479 Simple UI for edit of the default MAR... Draft
relates to UXPROD-1860 Migration. Simple UI for edit of the ... Draft
relates to UXPROD-658 Import Inventory Items from MARC Bibs... Closed
relates to UXPROD-659 Import Inventory Holdings from MARC B... Closed
relates to UXPROD-1377 CRUD for Job Profiles Closed
relates to UXPROD-1379 CRUD for Action Profiles Closed
relates to UXPROD-1769 Remaining Job and Match profile work,... Closed
relates to UXPROD-2074 Bring Action Profiles to life: prep work Closed
relates to UXPROD-2077 Remaining Job and Match profile work,... Closed
relates to UXPROD-2208 Remaining Job and Match profile work,... Closed
relates to UXPROD-2209 Bring Action Profiles to life: next work Closed
relates to UXPROD-2338 Remaining Job and Match profile refin... Closed
relates to UXPROD-2351 Import Inventory Holdings from MARC B... Closed
relates to UXPROD-2353 Import Inventory Items from MARC Bibs... Closed
relates to UXPROD-2354 Import Inventory Instances from MARC ... Closed
relates to UIDATIMP-363 UIs for MARC field mapping detail scr... Closed
relates to UXPROD-656 Data Import (Batch Importer for Bib A... Closed
relates to UXPROD-1220 Ability to assign Tags to Data Import... Closed
Epic Link: Batch Importer (Bib/Acq)
Analysis Estimate: Large < 10 days
Analysis Estimator: Ann-Marie Breaux (Inactive)
Front End Estimate: XXL < 30 days
Front End Estimator: Taras Tkachenko
Front-End Confidence factor: Low
Back End Estimate: Medium < 5 days
Back End Estimator: Oleksii Kuzminov
Development Team: Folijet
PO Rank: 124
Rank: Chalmers (Impl Aut 2019): R4
Rank: Chicago (MVP Sum 2020): R1
Rank: Cornell (Full Sum 2021): R1
Rank: Duke (Full Sum 2021): R1
Rank: 5Colleges (Full Jul 2021): R1
Rank: FLO (MVP Sum 2020): R1
Rank: GBV (MVP Sum 2020): R2
Rank: Lehigh (MVP Summer 2020): R1
Rank: MO State (MVP June 2020): R2

 Description   

Most work finished in Q2 2020. Moving the item status updating and logic to a separate Q3 2020 feature UXPROD-2550 Closed

Help the user set mapping rules and profiles for dealing with incoming batch loads:

  • find data elements in fields of incoming MARC Bibliographic file
  • map to data elements of appropriate FOLIO Inventory, Acquisitions, MARCcat, and Source Record Storage records
  • Allow for sequential mapping (first look in this field for data, then in this field)
  • Allow for defaults
  • Allow for blanking out data in existing FOLIO fields
  • Allow for mappings to be created and saved as data mapping profiles, or to be created on the fly
  • Apply the rules to parse the incoming data and deliver to the appropriate FOLIO loader apps, to CRUD the proper kinds of records

See https://docs.google.com/drawings/d/1IN2t0T838HtHytNctdugQN0nL8_KSJ-PzysQxSyZ1Hc/edit for a schematic

See the Syntax and Field Types tabs of https://drive.google.com/open?id=17kCccovBR-RAVK-coW7fpXvJfaRmYA2mUHoVLSF9Spo for field mapping syntax details

Split: See separate features for Field mapping profile details for MARC SRS records ( UXPROD-2286 Closed ) and Field mapping profile details for Order, Invoice records ( UXPROD-2282 Closed )

From Taras Tkachenko - see if there's a way to validate before saving the profile (or changes to the profile), in case any syntax errors or anything that looks like it will cause an issue - a button to test or validate the profile, perhaps using some stub data?



 Comments   
Comment by Cate Boerema (Inactive) [ 18/Nov/19 ]

Hi Ann-Marie Breaux I see this is still in draft. Do you think it at risk at this point? If so, please add the q4-2019-at-risk tag. Thanks!

Comment by Ann-Marie Breaux (Inactive) [ 25/Feb/20 ]

Will split MARC field mapping profile details for Orders/Invoices to a separate Feature

Generated at Fri Feb 09 00:20:55 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.