Single MARC Record Integration with OCLC (UXPROD-211)

[UXPROD-976] Import individual MARC record from OCLC within Inventory Created: 27/Jun/18  Updated: 24/May/23  Resolved: 20/Apr/21

Status: Closed
Project: UX Product
Components: None
Affects versions: None
Fix versions: R1 2021
Parent: Single MARC Record Integration with OCLC

Type: New Feature Priority: P3
Reporter: Ann-Marie Breaux (Inactive) Assignee: Mike Gorrell
Resolution: Done Votes: 0
Labels: Q2fromQ1, Showstopper-Cornell, data-import, po-mvp, round_iv
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Attachments: PNG File Single record export into Aleph.png     Zip Archive single record import demo (pt. 1) - OCLC to Aleph.zip     Zip Archive single record import demo (pt. 2) - OCLC to Aleph.zip    
Issue links:
Cloners
is cloned by UXPROD-2804 Import individual MARC record from OC... Closed
Defines
defines UXPROD-211 Single MARC Record Integration with OCLC Closed
is defined by UIIN-1428 Inventory app does not degrade gracef... Closed
is defined by MODCPCT-1 Initialize a module Closed
is defined by MODCPCT-8 Import of record in imports POST call... Closed
is defined by MODCPCT-9 create edge-connexion module Closed
is defined by MODCPCT-15 Add `externalIdentifierType` field to... Closed
is defined by MODCPCT-18 Both the "Create" and "Overlay" singl... Closed
is defined by UIIN-1426 When multiple Z39.50 services are con... Closed
is defined by UIIN-1447 Permissions for Inventory. Get an err... Closed
is defined by UIIN-1452 Record imported via inventory to crea... Closed
is defined by MODCPCT-7 Add UUID to incoming MARC record Closed
is defined by MODCPCT-14 Extend copycat profile to include cre... Closed
is defined by MODCPCT-22 do not set the data import profile name Closed
is defined by UIIN-1401 UI for single-record-import configura... Closed
is defined by UIIN-1414 Enforce new Permission - Inventory: I... Closed
is defined by UIIN-1437 Better settings UI for maintaining co... Closed
is defined by UIIN-1445 In "Z39.50 target profiles" settings,... Closed
is defined by MODCPCT-2 Integrate Z39.50 client functionality... Closed
is defined by MODCPCT-3 Integrate MARC-to-Instance mapping us... Closed
is defined by MODCPCT-4 Provide an API endpoint for importing... Closed
is defined by MODCPCT-5 Provide an API for CRUDing target con... Closed
is defined by MODCPCT-10 Record import - embedded 999ff$i is i... Closed
is defined by MODCPCT-11 Make import return 200 with internalI... Closed
is defined by MODCPCT-12 Does not handle MARC-8 charset. Closed
is defined by MODCPCT-13 Add OCLC WorldCat profile to referenc... Closed
is defined by MODCPCT-16 Update to RMB 33.0.0 pre1 Closed
is defined by MODCPCT-19 Neither import, nor update works Closed
is defined by MODCPCT-20 mod-copycat MUST return error status ... Closed
is defined by MODCPCT-21 Provide unique ID in RawRecordsDto Closed
is defined by MODCPCT-23 Incorrect encoding of record (schema) Closed
is defined by MODCPCT-24 Provide UTF-8 encoded JSON MARC for SRS Closed
is defined by UIIN-1317 Modify Instance Action Menu to add “O... Closed
is defined by UIIN-1318 Modify Inventory Action Menu to add “... Closed
is defined by UIIN-1404 include copycat interfaces and permis... Closed
is defined by UIIN-1424 Modify language of Import Record moda... Closed
is defined by UIIN-1429 Modify language of Settings/Inventory... Closed
is defined by UIIN-1431 disable the Import button until somet... Closed
Relates
relates to UXPROD-905 MARC Bib record - Creation of new bib... Closed
relates to UXPROD-1000 MARCcat - External search for MARC Bibs Closed
relates to UXPROD-2481 MARCcat - External search for MARC Au... Closed
relates to UXPROD-4073 Inventory Single Record Import: Abili... Open
relates to UXPROD-2912 Refinements to OCLC (and other target... Draft
Requires
requires UXPROD-2681 Folijet support work for Single recor... Closed
Potential Workaround: HK: Workaround, Use FOLIO batch import feature to import a single record.
Tiziana: We are evaluating the external sources that the community indicated as important. one of the most popular external source in US is OCLC WorldCat: libraries catalog in the Connexion client or in the Record Manager web app. These tools use TCP/IP to connect to other ILSs. We can suggest to use FOLIO batch import feature to import a single record as temporary workaround.
Epic Link: Single MARC Record Integration with OCLC
Front End Estimate: Large < 10 days
Front-End Confidence factor: Low
Back End Estimate: XL < 15 days
Development Team: Thor
Rank: Chalmers (Impl Aut 2019): R4
Rank: Chicago (MVP Sum 2020): R1
Rank: Cornell (Full Sum 2021): R1
Rank: Duke (Full Sum 2021): R1
Rank: 5Colleges (Full Jul 2021): R1
Rank: FLO (MVP Sum 2020): R1
Rank: GBV (MVP Sum 2020): R2
Rank: Grand Valley (Full Sum 2021): R1
Rank: hbz (TBD): R1
Rank: Hungary (MVP End 2020): R1
Rank: Lehigh (MVP Summer 2020): R2
Rank: Leipzig (Full TBD): R1
Rank: Leipzig (ERM Aut 2019): R2
Rank: MI State-Lib of MI (Sum 2021): R1
Rank: MO State (MVP June 2020): R1
Rank: Spokane Public Library (Jan 2021): R1
Rank: TAMU (MVP Jan 2021): R1
Rank: Trinity College (Jun 2021): R1
Rank: U of AL (MVP Oct 2020): R2

 Description   

Import individual MARC record from external source (e.g. OCLC, LC, other bibliographic databases) to SRS, which will then serve as the basis for a MARCcat bib record, Inventory instance record, quickMARC, or order. Current plan is integrating with (only) Connexion, triggering import from Inventory, and populating the MARC record into SRS. This may not fit with Batch Importer, but it doesn't have any other home Epic for now.

Index Data working on a solution; work will likely be done in summer 2020

This Feature deals specifically with OCLC

See rough outline at https://docs.google.com/document/d/1UIuA_tDdtuCUChGvvABPnVj4AGSljZTo-M8Cfal8RDQ/edit?usp=sharing



 Comments   
Comment by Karen Newbery [ 26/Mar/19 ]

Duke would like automated import of individual MARC records from OCLC as a go-live.

Comment by Ann-Marie Breaux (Inactive) [ 27/Mar/19 ]

Hi Karen Newbery Good to know - if this functionality were available via the MARCcat app, would that satisfy Duke's need?

Comment by Anya [ 29/Mar/19 ]

Comment from the March meeting : Ann-Marie Breaux: Find the MARCcat feature and link this to it

Comment by Ann-Marie Breaux (Inactive) [ 11/Jun/19 ]

A-M checked with Tiziana. Aim to handle via MARCcat, at least for first implementation. Changed the assignee for this feature to Tiziana Possemato and changed the Epic to MARCcat

Comment by Colin Van Alstine [ 12/Aug/19 ]

Tiziana Possemato in today's meeting you asked for examples of systems we want to import from. US libraries use OCLC WorldCat heavily, cataloging in the Connexion client or in the Record Manager web app. These tools use TCP/IP to connect to other ILSs (which is referred to as an OCLC Gateway Export in Connexion documentation).

Comment by Colin Van Alstine [ 11/Sep/19 ]

I'm just catching up on the recording from the 2019-09-09 meeting. I've attached the short videos I made demonstrating this issue in our current ILS. You can also find these in context in the #marccat channel here: https://folio-project.slack.com/archives/CAY94051A/p1562690752063700

Comment by lew235 [ 11/Sep/19 ]

Thanks Colin Van Alstine I thought I remembered you had documented this already!

Comment by Jakub Skoczen [ 13/Sep/19 ]

Ann-Marie Breaux Cate Boerema will the batch importer be able to deal with importing single MARC records into FOLIO?

Comment by Ann-Marie Breaux (Inactive) [ 13/Sep/19 ]

Hi Jakub Skoczen Yes, but it's pretty heavyweight for importing a single record. Basically, the user would be importing a file that just happened to only contain one record. To do that, they'll need to upload the file, assign a job, and import it. Lighter-weight workflow would be able to push a single button in MARCcat and bring the individual record in. But import will be a workaround unless/until something quicker/easier is available.

Comment by Jakub Skoczen [ 19/Sep/19 ]

Ann-Marie Breaux makes sense, could we link the file import feature from batch importer here and mark it as a workaround (until we get marcat individual import record integrated into FOLIO)?

It actually is confusing that this feature links as "defines" into UXPROD-47 Analysis Complete (the batch importer Epic).

Comment by Annalisa Di Sabato [ 24/Sep/19 ]

In MARCcat will be possible to import a single record using the functions that has been described in UXPROD-905 Closed (MARC Bib record - Creation of new bibliographic record in MARCcat APP, starting from file) and UXPROD-1000 Closed (MARCcat - External search).

About the first feature, UXPROD-905 Closed , the cataloger can load a record choosing it from folder present on its pc. The cataloger can import different record formats: MARC21, Unimarc or ONIX. Before the loading, he will indicate the original format of the record. In this way, during the loading process, the system will call the right function to convert that format in MARC21 and load it in the catalogue.

About the second feature, UXPROD-1000 Closed , the cataloger will be able to make search on different external sources. To interrogate these external sources MARCcat will use the Z39.50 protocol or invokes some APIs exposed by the related sources, like VIAF. From the search result list, he will be able to select the desired record and import it in the db. For this feature the UI prototype still missing.

So, to recap, the functions described in the video attached by Colin Van Alstine is not possible to develop in MARCcat in the same way, because it's pretty heavyweight and complex. To make possible the import starting from OCLC WorldCat we need to know if they can be reached via Z39.50 protocol or they expose some APIs that we can invoke/call.

Comment by Tiziana Possemato [ 30/Sep/19 ]

I have splitted this issue into different topics with specific stories for each use case, keeping in mind what happens right now in Aleph - OCLC.Connexion.
This subdivision is useful to better identify what to include in MARCcat and how and what to exclude from MARCcat (and why).

Comment by Mike Gorrell [ 16/Jul/20 ]

Working against this rough outline: https://docs.google.com/document/d/1UIuA_tDdtuCUChGvvABPnVj4AGSljZTo-M8Cfal8RDQ/edit?usp=sharing

Comment by Ann-Marie Breaux (Inactive) [ 30/Nov/20 ]

Hi Mike Gorrell and Adam Dickmeiss Folijet has completed creation of the "Create instance" default import profile. See MODDICONV-148 Closed . I'm not sure that we can test it completely until the Inventory UI adjustments are completed. I've added a note to UIIN-1317 Closed to test MODDICONV-148 Closed when it is completed.

Comment by Mike Taylor [ 27/Jan/21 ]

Quick update ... I have both new-record import and existing-record re-import now working, running agaist the mod-copycat on folio-snapshot. This means in theory that UIIN-1318 Closed and UIIN-1317 Closed could be closed, or at least moved into "In Review".

But the code as it stands is not really ready to go. There is too much duplication between the two cases, which needs moving into a single place; and it needs internationalization. So I'm not going to close any of these yet, although the software could be demoed if necessary.

Comment by Mike Gorrell [ 27/Jan/21 ]

Great news Mike. Thanks!

Comment by Ann-Marie Breaux (Inactive) [ 28/Jan/21 ]

Hi Mike Taylor Thanks for the update! In Review status usually means that the work has been merged to the hosted ref envs and is ready for PO testing/signoff. Since the ref envs are dead right now, I haven't checked. We're still a couple weeks away from the Sprint Review, but it'll be great to see it when it's ready!

Comment by Mike Taylor [ 28/Jan/21 ]

Yes, we're away away from "In Review" in that sense!

Comment by Ann-Marie Breaux (Inactive) [ 15/Mar/21 ]

Mike Taylor Adam Dickmeiss Mike Gorrell Charlotte Whitt I linked up all the MODCPCT and UIIN issues that seem related to this feature, so that the scope was more clear. Only a few that are not completed. If there's anything that will not be finished in Iris, probably best to re-link it to UXPROD-2912 Draft .

Generated at Fri Feb 09 00:11:56 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.