Update SRS MARC Authority records via Data Import

Jira feature UXPROD-2990

• Ann-Marie Breaux (Deactivated)and Khalilah Gambrell
• Then review with Data Import subgroup 8 Dec 2021 
• Likely that Spitfire will do the development work during Lotus dev

Developer research spike details 

Goal is to deliver basic work in Lotus, if possible; otherwise Morning Glory

Problem(s):

• Existing Data Import UI and logic mainly focuses on updating MARC Bibliographic records during Data Import. Review all UI screens and logic to determine what adjustments are needed for updating MARC Authority records via Data Import

UI Screens to review

• Settings
  • Job profiles
    • No changes needed
  • Match profiles
    • What match parameters are needed?
      • 010 $a to 010 $a (to do)
      • 001 to 001 (already in place, but see note below about slashes and spaces; test numeric only matching?)
      • 999 ff $s to 999 ff $s (already in place, but probably won't be used as much as 010)
    • Incoming records:
      • Enable MARC Authority
    • Existing records:
      • Enable MARC Authority
      • Remove FOLIO Authority
    • Make sure the center section of the Incoming and Existing records details fill in with the appropriate MARC type (e.g. when MARC Authority versus MARC Bibliographic is selected, the word "Bibliographic" is replaced with "Authority" in 2 places for Incoming and 2 places for Existing
    • Notes about matching
      • For 010s that have spaces between prefix and number, maybe set up match as numerics only, so that you don't need to account for any punctuation or hard spaces?), e.g. 001  sh\97006185\, vs 010 showing hard spaces
      • Leeda: Authority vendor (Marcive) sends 2 files: Bib records, and then Authority records in a separate file; LCNA is in 010 and 001; Authority file is a mix of updated authority records, plus records that would be new to Duke's catalog; also get a separate delete file 4x/year   
      • Jennifer E: match: 001 to 001; also have a label in bib record's 928 field, flagging records that need to be sent out for authority work; not currently loading authority, but planning to in the future
      • Autumn (Mich State): match on 010, using Backstage for authority work; used a 9xx field to mark Bibs that need to go out for processing; MARC Auth file is a mix of Adds and Updates; not sure if separate delete file or just reports of which records need to be deleted
      • 001 to 001: Marcive includes slashes where there are normally spaces (similar to MARCedit?)
      • 010 to 010
        • for 010, only match on $a? For now, yes; revisit if use case identified for matching on $z
        • spaces between prefix and number; just match on number?, e.g. 001  sh\97006185\, vs 010 showing hard spaces
      • 001 to 010 or 010 to 001: would fail, due to the difference in how spaces and subfields are handled in the two fields
      • 999 ff $s to 999 ff $s: would not really be helpful since external vendor doesn't know about internal library numbers; may be helpful for local ETL export/import
        
      • Note that MARC-MARC only matches on 001 and 999 ff right now

Sample Old Backstage record (courtesy of Mark A.): 

=LDR  00809cz   2200241n  4500
=001  n\\91103388\
=003  DLC
=005  20191130073201.0
=008  911010n|\azannaabn\\\\\\\\\\|a\aaa\\\\\\
=100  1\$aNolen, Jerdine
=400  1\$aNolen-Harold, Jerdine
=400  1\$aHarold, Jerdine Nolen-
=370  \\$cUnited States$2naf
=372  \\$aChildren's literature$2lcsh
=374  \\$aAfrican American women authors$2lcsh
=375  \\$afemale
=377  \\$aeng
=670  \\$aHer Harvey Potter's balloon farm, 1993:$bCIP t.p. (Jerdine Nolen Harold) bk. t.p. (Jerdine Nolen)
=670  \\$aMomma's kitchen, 1994:$bCIP t.p. (Jerdine Nolen) data sheet (Nolen-Harold, Jerdine)
=010  \\$an  91103388
=035  \\$a(OCoLC)oca03038353
=040  \\$aDLC$beng$erda$cDLC$dDLC$dIAhCCS$dOCoLC$dMnMN$dICrlF$dNN
=053  \0$aPS3564.O396

• • Action profiles
    • Permitted actions
      • Create
      • Update
      • NOT Modify - may need to update the MARC text next to this action in the UI
    • Enable MARC Authority
    • Remove Authority (since it will always be implicit when MARC Authority selected)
  • Field mapping profiles
    • Remove Authority (For Lotus, no non-MARC fields in the FOLIO Authority record)
    • MARC Authority
      • MARC Modification: not needed for v1; disable the ability to select this option
        • Notes: 
          • Lisa R/Raegan: made local mods once, but would be very rare
          • Leeda: make a modification to MeSH auth records to manipulate the NLM number to copy from 001 to 016; workaround: ask vendor to change or update in MARCedit
      • MARC Updates: maybe for v1, default so that no individual fields can be selected and no field protection overrides can be selected
        • No need for protected fields in authority records; leave out unless use case identified
          • Would you ever need to update specific fields instead of all fields? No use case identified yet 
          • Maybe keep 644, 645, 646 for series analysis decisions in the future; in the UI, maybe set all the field protections as checked, and then library unchecks the $5 protection?
        • The center section of the headers fill in based on the type of MARC record selected above; make sure it updates appropriately for MARC Authorities
  • File extensions
    • Any additional default file extensions needed? No
  • MARC field protection
    • Any adds/edits to the text? No
• Data Import app
  • Landing page: no changes
  • Choose jobs page: no changes
  • Log view all page: no changes
  • Individual job log summary page: already done
    • Additional Authority column not needed
    • Review the header for the Title column: change to something else? maybe Heading?
    • When click title, opens the tab and shows MARC Authority JSON: already done
    • When click Authority Created/Updated, will not be a separate link to the Authority app record (different from Inventory and Invoices)
    • Maybe MARC column's Created/Updated is a hotlink to the MARC Authority app view of the record?
  • Log JSON detail page for MARC Authority
    • 999 ff $i will need to be added (999 ff $s already exists)
    • Separate tab for Authority is not needed, but already done, so leave in place
• Still need to confirm whether any UI changes needed for
  • Inventory (probably no, since the Inventory authority records do not surface in the Inventory UI)
  • MARC Authority
  • quickMARC

Use Cases & Requirements:

Links 

SME Questions:

Basic workflow

What Backend stories are needed?

What UI stories are needed?

Developer Questions: