2021-05-19 Data Import Subgroup meeting

Owned by Ann-Marie Breaux (Deactivated)
Last updated: May 19, 2021
3 min read

Recordings are posted Here

Attendees: Ann-Marie Breaux (Deactivated) , Jennifer Eustis , leeda.adkins@duke.edu, Lisa McColl Lloyd Chittenden Monica Arnold Nick Cappadona Timothy Watters Christie Thomas Jenn Colt 

Agenda topics:

  1. Current development status
    1. Sprint 114
    2. Juniper at risk features
      1. POs will be identifying at risk Juniper features and splitting/moving features into Kiwi, so that we can then confirm how much of the pointing exercise features can be brought into Kiwi development
    3. Question from Leeda - local control number in 901 $a - how to add to FOLIO Instance?
      1. Update the default MARC-to-Instance map to include the 901: MARC Mappings Information
      2. If Instances already exist, run Ian Walls' script to update the instances
      3. And after that, the instances will have the local control number and can be used for matching for future imports
      4. And any new future imports will include the local control number in the Instance data automatically, based on the updated default map
  2. Follow up from last week
    1. Using Rancher for testing
      1. Will be setting up a site for Data Import and quickMARC SMEs
      2. Profiles, users, data will stick around instead of being wiped out; will be helpful if folks set up separate users for themselves, so it's easier to tell who is doing what (right now, we all use diku_admin on the hosted sites, so it can get confusing)
    2. Data Import FAQ
      1. A-M to add info about the data elements at the bottom of the SRS MARC record
      2. Add any other questions you think would be helpful
      3. How are MARC Bibs, Holdings, Authorities distinguished in SRS?
      4. When an SRS MARC JSON record is updated, is the raw MARC blob also updated?
  3. Default behaviors (implicit/explicit) - START HERE NEXT WEEK
    1. A-M started a spreadsheet; will this be helpful as a way to make the relationships between the actions clearer?
      1. Added rows for quickMARC edit/create actions and Instances created by POLs
      2. Lehigh MARC program creates SRS MARC for the new orders as well as Instances. In FOLIO, currently POLs only create Instances, not SRS MARCs
    2. HOMEWORK: Is the spreadsheet a good way to organize info, or should we try something different? What should be added or changed? Is there a better way to present this?
    3. Christie question
      1. Re: acq workflow: MARC external program (from Lehigh) creates the order order, which in turn creates Inventory records; creates both Instance and SRS MARC; then have to import and overlay with final shelfready data
      2. POL matchpoint/Vendor system number matchpoint - not currently available for Inventory matching, unless stored as an identifier in the instance. Draft story here
      3. Need to be able to update the Instance without updating the MARC (but this would only be for Instance fields that are not controlled by the underlying MARC); make sure there is a way to transport non-MARC data for updating the instance in a MARC record, without affecting the SRS MARC
        1. Confirm this is what happens when a MARC is only updating a holdings or item, and then make sure we have a way to do this for instances
      4. Per Christie, not sure this will provide what they need long-term; need to be able to manage Instance record data separate from the SRS MARC
      5. Jennifer E: maybe have a small working group on what happens to the versioning, so that we take into account quickMARC and orders; per Ann-Marie there's enough overlap with our subgroup members that we probably don't need a separate subgroup
  4. Data import setup checklist
  5. Surfacing errors in log summaries
    1. Fix column sorting - will help with large results sets
    2. Mockups
    3. Export – only errors? All?
  6. EDIFACT Invoices
    1. Default profiles and EDIFACT Syntax
    2. Some fixes split to a separate Jira – OK to make it lower priority?
    3. Vendors
      1. Already spoken with GOBI, Harrassowitz, EBSCO
      2. Have contact info for WT Cox, Hein; will reach out to them
      3. Any others?
  7. Import job monitoring and alerting e-mails - POSTPONE UNTIL NEXT WEEK
    1. Review proposed implementation
    2. Discuss default e-mail text

Text chat - copy from file after it's posted