Batch Importer (Bib/Acq)
(UXPROD-47)
|
|
| Status: | Closed |
| Project: | mod-source-record-manager |
| Components: | None |
| Affects versions: | None |
| Fix versions: | 3.3.0 | Parent: | Batch Importer (Bib/Acq) |
| Type: | Bug | Priority: | P2 |
| Reporter: | Ian Hardy | Assignee: | Aivar Iusupov |
| Resolution: | Done | Votes: | 0 |
| Labels: | data-import, epam-folijet, folijet-support, has-testrail, sprint-135, support | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original estimate: | Not Specified | ||
| Attachments: |
|
||||||||||||||||||||||||||||
| Issue links: |
|
||||||||||||||||||||||||||||
| Sprint: | |||||||||||||||||||||||||||||
| Story Points: | 3 | ||||||||||||||||||||||||||||
| Development Team: | Folijet Support | ||||||||||||||||||||||||||||
| Release: | Lotus R1 2022 | ||||||||||||||||||||||||||||
| Potential Workaround: | remove or renumber all other 999 fields | ||||||||||||||||||||||||||||
| Affected Institution: |
Lehigh
|
||||||||||||||||||||||||||||
| Epic Link: | Batch Importer (Bib/Acq) | ||||||||||||||||||||||||||||
| RCA Group: | Legitimate regression | ||||||||||||||||||||||||||||
| Description |
|
Overview Steps to Reproduce:
Expected Behavior Additional Information 21:03:50.486 [vert.x-worker-thread-6] ERROR rdChunksKafkaHandler [873231eqId] Can't process the kafka record: java.lang.IllegalArgumentException: Invalid UUID string: Y Removing all Local 999 fields other than the one with $i and $s for UUIDs will work. Tested on mod-source-record-storage 5.1.9 and 5.0.5 Attached a file to represent the record with one 999 (works) and legacy 999s (does not work)
|
| Comments |
| Comment by Lisa McColl [ 05/Jan/22 ] |
|
Testing on Lehigh University's production server (Juniper) and Kiwi-bugfest: When a MARC record contains 999 fields other than a 999 that FOLIO exports (i.e.: a 999 field with indicators "ff" and a subfield i and subfield s example: =999 ff$i29573076-a7ee-462a-8f9b-2659ab7df23c$s7ca42730-9ba6-4bc8-98d3-f068728504c9)
then import fails. I tested this using the "Default - Create instance and SRS MARC Bib" import profile. Job never runs if record contains 999 fields that have indicators and subfields other than the ones FOLIO exports. As soon as these "legacy" 999s were removed, then the MARC record imported successfully.
Example of 999 fields that occur in Lehigh University's records =999
Expected behavior: FOLIO will accept records with 999 fields if the indicators are not "ff" and with various subfields Possible workaround if this is not possible: Move local 999 fields to another 99X field.
|
| Comment by Ann-Marie Breaux (Inactive) [ 05/Jan/22 ] |
|
Hi Lisa McColl and Ian Hardy Thank you for writing up this bug. It's definitely a regression because at one point, we were ignoring 999s, so long as their indicators were not ff. (
|
| Comment by Lisa McColl [ 05/Jan/22 ] |
|
Confirming : the indicators of the 999s were not ff. I posted the 999 example in the comment above, in case it helps. They are also in the MARC files attached. |
| Comment by Ann-Marie Breaux (Inactive) [ 26/Jan/22 ] |
|
Ann-Marie Breaux add repro steps to the description and then give to devs |
| Comment by Charlotte Whitt [ 21/Feb/22 ] |
|
From SUPPORT SIG: Ann-Marie Breaux We notice that this is still in OPEN when it's targeted for Lotus. Do you have an update? cc: Lisa McColl |
| Comment by Ann-Marie Breaux (Inactive) [ 21/Feb/22 ] |
|
Hi Charlotte Whitt Yes, we'll be working on it in Sprint 135, possibly 134 if we finish releases early enough. |
| Comment by Ann-Marie Breaux (Inactive) [ 23/Feb/22 ] |
|
Hi Serhii_Nosko Thank you for picking up this ticket. I'll add repro steps, but I can't validate it in current FOLIO since the hosted ref envs are down |
| Comment by Ann-Marie Breaux (Inactive) [ 23/Feb/22 ] |
|
Hi Serhii_Nosko I added repro steps - confirmed in Kiwi BF and the Kiwi demo env that the Lehigh file does not work for Create OR Update. I used a separate file that we used when we fixed this bug the first time (
|
| Comment by Ann-Marie Breaux (Inactive) [ 23/Feb/22 ] |
|
Hi Serhii_Nosko OMG - I think I figured it out! See the attached videos MODSOURCE-435 Part 1.mp4 and MODSOURCE-435 Part 2.mp4, and attached file AMB_999_with_subs_is.mrc I think the reason I was getting different results from Lisa McColl is that her single_local999_test3.mrc file has a subfield s in the 999 field, and FOLIO is trying to interpret that as a UUID. In my original imported file, the 999 field did not have a $s. I edited 1 record from my file to include $s in the 999 (and for good measure, $i also), then tried to import it again, and it failed, with the same error message as Lisa's. All is attached, and I hope the video is clear. I'll add some details to the expected outcomes. Let me know if you want to look at anything together |
| Comment by Aivar Iusupov [ 09/Mar/22 ] |
|
Hi Ann-Marie Breaux! Tested it on folio-snapshot hosted env and everything works as it should. Could we close it as done? |
| Comment by Ann-Marie Breaux (Inactive) [ 13/Mar/22 ] |
|
Hi Aivar Iusupov Tested on folio-snapshot-2 and all looks good. Created the TestRail. Moved to Awaiting release, so that it will get into Lotus Bugfest |
| Comment by Ann-Marie Breaux (Inactive) [ 15/Mar/22 ] |
|
Cloned and created a Morning Glory issue as well, linked to MG feature, and closed the new issue.
|
| Comment by Ann-Marie Breaux (Inactive) [ 06/Apr/22 ] |
|
Hi Aivar Iusupov and Serhii_Nosko One of the SMEs, Leeda Adkins - tested this on Lotus BF on 21 March and passed it, so closing this issue. Thank you! |
| Comment by Lisa McColl [ 04/Jan/23 ] |
|
Ann-Marie Breaux - I'm seeing this bug again in our production version of Morning Glory. Can this bug be reopened or does something else need to be done? Thank you. |