2023-03-29 Data Import Subgroup meeting

Owned by Ann-Marie Breaux (Deactivated)
Last updated: Mar 29, 2023
3 min read

Recordings are posted Here (2022+) and Here (pre-2022)                   Slack channel for Q&A, discussion between meetings

Requirements details Here                                                                    Additional discussion topics in Subgroup parking lot


Attendees: Ann-Marie Breaux (Deactivated)  Monica Arnold Christie Thomas Jennifer Eustis Taylor Smith leeda.adkins@duke.edu Lynne Fors Jenn Colt Autumn Faulkner Kim Raegan Wiechert Lisa Smith 

Current development (Orchid)

Agenda: 

  • Announcements
    • Orchid being released next week; so far, all is on track
    • Discussing documentation overhaul at lab tomorrow
  • Bugfest and Orders UAT
    • Check last week's notes for a couple updates
    • We're in good shape to finish the Orchid bug cleanup by the end of the week
  • Log subgroup work
    • Discuss the background slides that we looked at briefly last week; finalize requirements
    • Added a wiki page to collect examples of missing or unhelpful error messages in the log, so that we can continue working on adding and refining them
      • Example: multiple match error messages; is it possible to add info (like UUIDs) for what the multiple matches are?
    • Suggestion: Can we change the SRS MARC column to be - if the MARC record is not retained after the job is complete? (e.g. only creating an order or updating an item) See https://bugfest-orchid.int.aws.folio.org/data-import/job-summary/432f8679-65a3-46cc-aeac-6eecc44a04a4 as an example
    • A-M: Find workgroup notes, and post on Google (if not already there); look for case where match = no action; no match = create; Christie will also test it on Nolana and Orchid BF
    • If I import a MARC Bib and Update SRS MARC, which also triggers an implicit Update instance, both SRS MARC and Instance should show updated
      • Could see in the activity tracker, when there is one
      • Another possibility (Created) or (Updated) in parens if the action was taken implicitly instead of explicitly
      • Figure out how to indicate explicit vs implicit in the log vs both explicit
      • Per Jenn, can BE tell the difference?
      • Maybe something in the counts
      • Maybe add the action profile name (or implicit) at the top of the JSON for that record type?
      • A-M talk with Kimie about implicit/explicit ideas
    • Another suggestion: a link from the log to the batch of records created/updated in Inventory, Orders, Invoices

Upcoming meetings/agenda topics:

  • Misc
    • Discuss/review mockups for MARC updates refinements
    • POL/VRN matching
      • For invoices, we only consider open POs
      • For Instance, Holdings, Items, we currently (Orchid and before) only consider open POs. Should we change the Inventory matching logic to allow matching on closed POs as well?
    • Deleting outdated versions of SRS records
      • Can we define a cutoff date? 90 days ago? 1 year ago?
        • Different for records that are used during import and then not consulted again? (e.g. EDIFACT invoices, MARC bibs that only create/update orders, holdings, items)
      • Effects on the import log
    • OCLC number cleanup
      • Confirm 035 structure, aim for it to be consistent across all FOLIO tenants
    • Downloading log info
      • Lots of interest, especially for errors
      • Including identifiers for everything
      • What would UI look like?
      • What would output look like? 
    • Variation between PTF and production library performance results - why?
    • Revisit use cases for Updating individual MARC fields - what are the most common use cases?

Chat

Christie Thomas (she/her)  to  Everyone 1:05 PM
Where is the Erin plan? I was not at the last session so did not see it.

Jenn Colt  to  Everyone 1:05 PM

Jenn Colt  to  Everyone 1:06 PM
I’ll do a post in slack after this to get everybody the links

Lynne Fors  to  Everyone 1:12 PM
Who reported it? and Date

Jenn Colt  to  Everyone 1:16 PM
Oh I didn’t know that!

Lynne Fors  to  Everyone 1:43 PM
No action was mentioned in the slides when I looked at them earlier

Jenn Colt  to  Everyone 2:05 PM
I wonder how much the backend can tell the difference

Christie Thomas (she/her)  to  Everyone 2:08 PM
+1 Jenn!

Jenn Colt  to  Everyone 2:10 PM
It’s haunted!

Lynne Fors  to  Everyone 2:12 PM
I would love a link from the Data Import log to all the records that were acted on in that particular job in the Inventory app as a group.

Christie Thomas (she/her)  to  Everyone 2:13 PM
Like a linked search?

Lynne Fors  to  Everyone 2:13 PM
Yes
Sometimes its easier to see what happened in Inventory, ie was the stat code applied and can you see it in the filters