2023-01-18 Data Import Subgroup meeting

Owned by Ann-Marie Breaux (Deactivated)
Last updated: Jan 19, 2023
3 min read

Recordings are posted Here (2022+) and Here (pre-2022)                   Slack channel for Q&A, discussion between meetings

Requirements details Here                                                                    Additional discussion topics in Subgroup parking lot


Attendees: Ann-Marie Breaux (Deactivated) Jennifer Eustis Kim Wiljanen leeda.adkins@duke.edu Lisa Smith Jenn Colt Christie Thomas Lynne Fors Monica Arnold Raegan Wiechert Taylor Smith 

Current development (Orchid)

Agenda: 

    • UI Log Subgroup
      • Started meeting yesterday; should have some updates by next week or the following week
        • A-M, Jenn, Jennifer, plus 2 of the DI developers
      • Google Drive folder: https://drive.google.com/drive/folders/1lbs35QwVYnRNPHc-VGP0SMzLQ3QB6F5X 
      • Should be able to document more of why certain things are displaying in the logs right now, based on feedback from the developers, e.g. why are the same record both logged as created and discarded, different log behavior for match/no-match, different branches cause different things to show in the logs
      • Some conv of understanding better what is going on behind the scenes
      • Why sometimes SRS MARC Updated and Instance Created? 
      • Per Christie, performance degrades if log is opened and then continue to do 1000 record batches of ETL
    • Importing to create orders
      • If user is importing, but the order must be approved before being opened, and the user does not have approve permission
        • Creating the order as Open implies that the order has been approved, so seems improper
          • If approval is mainly a formality, this would be OK
        • Create the order as Pending instead of Open?
          • If approval is strict, this would be needed to disallow importers from creating orders as approved and open
          • Will default to this logic for now, unless compelling reason to use one of the other options
        • Disallow the order creation entirely?
          • Least desirable
      • Aim for UAT a couple weeks from now. 
      • A-M will create a UAT folder and outline some sample files/profiles
    • Inventory Single Record Import - Selecting profiles
      • Review current development
      • Add info message about which job profiles can be selected?
        • A-M add Info icon: Only MARC Bibliographic job profiles can be used for Inventory single record imports, not MARC Holdings or MARC Authority job profiles.
          • Jira story created
      • Plan UAT, probably next week - depends on having an available environment
        • Create/edit Z39.50 profiles
        • Create/edit job profiles, and associated match, action, field mapping profiles
        • Import/Create with single target/multiple targets
        • Re-import/Overlay/Upgrade with single target/multiple targets
        • Try some MARC modifications in the profiles
        • Inventory success toast OK? Seems to appear too soon
        • Log - suppress from DI landing page, filterable on View all page (still in progress)
      • Feedback
        • Can no longer edit 001 via MARC modifications; that was really helpful; we have a user story to clean up inconsistent OCLC numbers, but not clear if that will be handled in Orchid
        • Would also be helpful to have a way to clean up ISBNs that have qualifiers in 020 $a
        • Maybe have a mod action that allows a user to delete a tag that has a certain string in it (begins, contains, ends?) see chat comment below
      • A-M will create a UAT form/outline; aim to start UAT next week, as soon as a long-lived environment is available

Upcoming meetings/agenda topics:

  • Creating orders from imported MARC Bibs - E2E review and testing
  • Gather more samples for multiple holdings/items


Chat:

Jennifer Eustis (she/her)  to  Everyone 1:13 PM
The job with the match and were it creates a holdings and item when there is matches and nothing happens for no matches - there are no discards in the summary

Jennifer Eustis (she/her)  to  Everyone 1:41 PM
I like the info icon

Jenn Colt  to  Everyone 1:59 PM
Being able to use Marc mods on update also makes or breaks this for us

Lisa Smith, Mich State  to  Everyone 1:59 PM
cleaning up isbns would be good, too

Jenn Colt  to  Everyone 2:00 PM
Have to go to 2pm. Thank you!

Christie Thomas (she/her)  to  Everyone 2:00 PM
I would also add that we would want to be able to remove the prefix from the 001 before the 035 is built so it does not duplicate what is already there.

Christie Thomas (she/her)  to  Everyone 2:01 PM
We could also do this if we were able to delete a tag that includes a string, but those marc mods are not available. For instance, delete the 035 when ocm|ocn|om|on is present.

Taylor Smith  to  Everyone 2:02 PM
thanks!