2023-03-29 Data Import Subgroup meeting
Recordings are posted Here (2022+) and Here (pre-2022) Slack channel for Q&A, discussion between meetings
Requirements details Here Additional discussion topics in Subgroup parking lot
Attendees: Ann-Marie Breaux (Deactivated) Monica Arnold Christie Thomas Jennifer Eustis Taylor Smith leeda.adkins@duke.edu Lynne Fors Jenn Colt Autumn Faulkner Kim Wiljanen Raegan Wiechert Lisa Smith
Current development (Orchid)
- Orchid planning dashboard
- Orchid timeline
- Folijet Current Development Board
- Folijet (Data import) Bug Dashboard
Agenda:
- Announcements
- Orchid being released next week; so far, all is on track
- Discussing documentation overhaul at lab tomorrow
- Bugfest and Orders UAT
- Check last week's notes for a couple updates
- We're in good shape to finish the Orchid bug cleanup by the end of the week
- Log subgroup work
- Discuss the background slides that we looked at briefly last week; finalize requirements
- Added a wiki page to collect examples of missing or unhelpful error messages in the log, so that we can continue working on adding and refining them
- Example: multiple match error messages; is it possible to add info (like UUIDs) for what the multiple matches are?
- Suggestion: Can we change the SRS MARC column to be - if the MARC record is not retained after the job is complete? (e.g. only creating an order or updating an item) See https://bugfest-orchid.int.aws.folio.org/data-import/job-summary/432f8679-65a3-46cc-aeac-6eecc44a04a4 as an example
- A-M: Find workgroup notes, and post on Google (if not already there); look for case where match = no action; no match = create; Christie will also test it on Nolana and Orchid BF
- If I import a MARC Bib and Update SRS MARC, which also triggers an implicit Update instance, both SRS MARC and Instance should show updated
- Could see in the activity tracker, when there is one
- Another possibility (Created) or (Updated) in parens if the action was taken implicitly instead of explicitly
- Figure out how to indicate explicit vs implicit in the log vs both explicit
- Per Jenn, can BE tell the difference?
- Maybe something in the counts
- Maybe add the action profile name (or implicit) at the top of the JSON for that record type?
- A-M talk with Kimie about implicit/explicit ideas
- Another suggestion: a link from the log to the batch of records created/updated in Inventory, Orders, Invoices
Upcoming meetings/agenda topics:
- Misc
- Discuss/review mockups for MARC updates refinements
- POL/VRN matching
- For invoices, we only consider open POs
- For Instance, Holdings, Items, we currently (Orchid and before) only consider open POs. Should we change the Inventory matching logic to allow matching on closed POs as well?
- Deleting outdated versions of SRS records
- Can we define a cutoff date? 90 days ago? 1 year ago?
- Different for records that are used during import and then not consulted again? (e.g. EDIFACT invoices, MARC bibs that only create/update orders, holdings, items)
- Effects on the import log
- Can we define a cutoff date? 90 days ago? 1 year ago?
- OCLC number cleanup
- Confirm 035 structure, aim for it to be consistent across all FOLIO tenants
- Downloading log info
- Lots of interest, especially for errors
- Including identifiers for everything
- What would UI look like?
- What would output look like?
- Variation between PTF and production library performance results - why?
- Revisit use cases for Updating individual MARC fields - what are the most common use cases?
Chat
Christie Thomas (she/her) to Everyone 1:05 PM
Where is the Erin plan? I was not at the last session so did not see it.
Jenn Colt to Everyone 1:05 PM
Jenn Colt to Everyone 1:06 PM
I’ll do a post in slack after this to get everybody the links
Lynne Fors to Everyone 1:12 PM
Who reported it? and Date
Jenn Colt to Everyone 1:16 PM
Oh I didn’t know that!
Lynne Fors to Everyone 1:43 PM
No action was mentioned in the slides when I looked at them earlier
Jenn Colt to Everyone 2:05 PM
I wonder how much the backend can tell the difference
Christie Thomas (she/her) to Everyone 2:08 PM
+1 Jenn!
Jenn Colt to Everyone 2:10 PM
It’s haunted!
Lynne Fors to Everyone 2:12 PM
I would love a link from the Data Import log to all the records that were acted on in that particular job in the Inventory app as a group.
Christie Thomas (she/her) to Everyone 2:13 PM
Like a linked search?
Lynne Fors to Everyone 2:13 PM
Yes
Sometimes its easier to see what happened in Inventory, ie was the stat code applied and can you see it in the filters