Skip to end of banner
Go to start of banner

2022-03-16 Data Import Subgroup meeting

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Recordings are posted Here (2022+) and Here (pre-2022)                   Slack channel for Q&A, discussion between meetings

Requirements details Here                                                                    Additional discussion topics in Subgroup parking lot


Attendees: Ann-Marie Breaux (Deactivated)  

Lotus

Morning Glory

Agenda topics:

Environment for Import/Export/quickMARC Labs - Confirm the following

  • Keep tied to the most recent released version? (e.g. Kiwi with HF1-2)
  • Environment will not exceed ca. 50K records in Inventory
  • Purging will happen on-demand. When purging, purge Inventory and SRS data, Import/Export logs, but DO NOT purge any reference data (including all Import/Export profiles)
  • If SMEs have any issues, start with Ann-Marie Breaux (Deactivated). Dev team managing the environment is Kitfox.

Lotus Bugs

    • Lotus Bugfest:
      • Sign up for tests this week
      • Ann-Marie still retiring tests that have been replaced by Automated end-to-end tests
      • Ann-Marie still writing additional tests that will be available for signup this week and next week
      • Set up your own logon
    • Extend MatchValueLoader implementations to allow filtering according to Qualifiers and MatchCriteria:

    • Identifier matching should allow for qualifiers, compare part, and match criteria

      • Are there any specific match use cases that you want to use that you cannot (NOT MARC-MARC right now; that's next)

      • Any qualifier/begins/contains matches that are not working but that are needed?

    • MARC-MARC matching
      • Lotus: Allows for any field in a MARC record except
      • Are these needed in Morning Glory?
        • Matching for 100-899 fields? (I think they work, but not heavily tested yet)
        • Repeatable fields (e.g. 024, 035)
          • Incoming record: Only first version of the field is considered (doublechecking with the dev on whether it's the first field that has the requested indicator(s) and/or subfield, or just the first field, regardless of indicators/subfield)
          • If it takes Ind 1, Ind 2, Subfield into account (in addition to the data)
          • Does FOLIO need to check all incoming 024s against all 024s in the existing SRS records? Or just the first?
          • Wildcards for Ind 1, Ind 2, Subfield (repeatable or non-repeatable fields)
            • Needed?
    • Create a script for libraries to refresh Instances against an updated MARC-Instance map
      • What kind of result do we expect after script? (current->expected)
      • What should we do about different releases installed for different libraries?
      • Do we need to upgrade script that Ian Walls wrote or we will need to write another one to update many records at a time?
      • What is the scope of the script? All the instances (even updated ones) or just not updated ones?


Chat: 

From Christie Thomas (she/her) to Everyone 01:28 PM
+1 Jenn!

From Jenn Colt to Everyone 01:36 PM
It started in juniper

From Lisa McColl to Everyone 01:47 PM
Same here

From Leeda Adkins to Everyone 01:54 PM
Both of those are very good, common scenarios: modification on create to prepend the proxy, and modification on update to delete incoming extra 856s

From Jenn Colt to Everyone 01:56 PM
We want to move our mods into folio

From Jennifer Eustis (she/her) to Everyone 01:56 PM
We do both - before Aleph and then also in Aleph
One common after modification is that we remove the 856 with our proxy that we put in the holdings record

From Jenn Colt to Everyone 01:58 PM
That second set would be updates not modifications I think?

From Jennifer Eustis (she/her) to Everyone 01:58 PM
You're right Jenn. Removing the 856 from the bib is a global bulk update that we do to the bib records

From Christie Thomas (she/her) to Everyone 01:59 PM
but is it the incoming marc file or the existing marc file?

From Jenn Colt to Everyone 01:59 PM
*documentation wishes*

From Lloyd (Marmot Library Network) to Everyone 01:59 PM
I have to go to another meeting.

From Jennifer Eustis (she/her) to Everyone 02:00 PM
For me here, the Aleph global update is on the existing record that was either created or updated

From Christie Thomas (she/her) to Everyone 02:05 PM
I can add the 856 use case.

From Lisa McColl to Everyone 02:06 PM
slack channel? 

  • No labels