2022-01-13 Metadata Management Meeting notes

Martina Schildt and Laura E Daniels 

• TAMU is live \o/ ... They are using Inventory holdings only, not MARC holdings
  • Reply from Anne H at TAMU: Inventory Holdings only. Yes, it's a bit hectic but not bad so far
• there will be ameeting next week with 2 topics already on the agenda:
  • Madga: talk about holdings record export and
  • update on bulk edit development

Felix Hemme 

2022-01-13 Product Council Meeting notes

• Ranking/Prioritization Group: FOLIO SME's are invited to share their feedback on previous ranking processes on this wiki page: Requirements analysis
  • if people are interested to join the group, please contact Martina Schildt
  • the group is thinking about a new process to prioritize development
• SWOT Analysis revised report: PC members will give feedback till next week (Jan 20th). Then the PC will decide how to move forward.
• the analysis was done by Anya Arnold and Sharon Wiles-Young; community gave feedback of strengths and weaknesses of the product and project
• related word document

MM SIG Release Note & Other Highlights

• Jennifer highlights 2 stories
• Story on deduplicating record identifiers for marc holdings, instances, items, and marc authorities. Release for Lotus R1 2022.
• Story to investigate time to import a single OCLC record when a large import is running. Release for Lotus R1 2022
  • import side: analysis is done; work too large to finish in Lotus; there are only 2 weeks left
  • it's a feature for morning glory now
  • Cornell: 150 single records imports per day
  • no rankings from libraries are neede; this is just gonna get done

Natascha Owens 

• MODQM-127 - Getting issue details... STATUS
• Natascha will talk us through this bug and we can discuss possible workarounds as long as an institution is live on a release prior to Kiwi
• bug is fixed for Kiwi
• Chicago is looking for what they can do until they have Kiwi
• Natascha demos the issue in Folio Inventory
• when editing the SRS record and entering an invalid field, the inventory instance is not updated
• sometimes this may even be just a typo
• corrupt SRS records can be updated after correcting the error outside the systems
• question: Can this bug fix be back ported to Juniper
• answer: no, it cannot be backported
• the SRS record does not seem to validate
• workaround: after editing SRS record, wait a few minutes and try to edit again
• Adam Cottle: experienced a similar issue with data import
• Jenn in chat: One thing that can help reset things with DI is to make sure you remove the 999 when you are trying to reset a record
• A-M: it is important that when updating (not creating a record) that users do not accidentally use a create profile, but an update profile
• Jenn will add a paragraph to the Tipps and Tricks section
• Adam in chat: For reference: for
  SQL [null]; ERROR: insert or update on table "raw_records_lb" violates foreign key constraint "fk_raw_records_records"   Detail: Key (id)=(92a43de3-277b-41f9-b10f-6c3302e917d3) is not present in table "records_lb".
• Felix: is there a way to find the corrupt records?
• Christie: could have a query that identifies where your current SRS is out of sync with your Inventory record → this may not be very effocient
• another not validated idea: search current or active SRS records that do not have a "999" tag → would indicate that the SRS record was corrupt
• A-M in chat: Charlotte - re: your question about identical 999s - I don't think that will be an issue, but I'll add it as a question in the draft Jira I mentioned
• A-M in chat: Here's the Jira that addresses the error that Adam/Skidmore described: MODSOURMAN-660 - Getting issue details... STATUS
• Jenn in chat: We have talked about trying to make a report that would shows relationships between instances and SRS records that don’t look right (ie two actual SRS records
• ID has done soem analysis of the issue; it is not possible to backport the bugfix
• Jacquie in chat: Can we expect that this bug will definitely be addressed in Morning  Glory?
• Felix in chat: @Jackie the quickMARC bug is fixed with Kiwi
• Laura in chat: there are issues with any system/tool: at least with FOLIO our reports of problems are taken seriously!
• Jenn in chat: They are in different fields in LDP so it should still work ok to compare
• a relationship report might help
• A-M in chat: I'll start a draft Jira for a script that would identify relationship problems between SRS and corresponding Inventory records. Then maybe we can fill in details at an upcoming DI subgroup meeting

Chat:

Von Christie Thomas (she/her) an alle 05:51 PM
The Inventory instance is not updated.

Von Laura Daniels an alle 05:51 PM
does it not get updated at all? or is it just slow right now? (we usually have to refresh to see updates)

Von Khalilah Gambrell an alle 05:51 PM
Due to the error the change never flows to Inventory instance record.

Von Charlotte Whitt an alle 05:52 PM
Then there should not be a green success toast

Von Jenn Colt an alle 05:52 PM
Oh no!

Von Ann-Marie Breaux an alle 05:52 PM
I think that's why there was a bugfix, Charlotte
Von Laura Daniels an alle 05:53 PM
big ouch

Von Charlotte Whitt an alle 05:53 PM
Can this bug fix be back ported to Juniper

I do affect all libraries
It … :-)

Von Jenn Colt an alle 05:59 PM
One thing that can help reset things with DI is to make sure you remove the 999 when you are trying to reset a record

Von Jennifer Eustis (she/her) an alle 05:59 PM
We talked about the marc modification issues in Data Import lab last week. Christie - did you create that jira?

Von Adam Cottle an alle 06:02 PM
For 
SQL [null]; ERROR: insert or update on table "raw_records_lb" violates foreign key constraint "fk_raw_records_records"   Detail: Key (id)=(92a43de3-277b-41f9-b10f-6c3302e917d3) is not present in table "records_lb".

Von Ann-Marie Breaux an alle 06:05 PM
Here's the Jira that addresses the error that Adam/Skidmore described: MODSOURMAN-660 - Getting issue details... STATUS

Von Jenn Colt an alle 06:06 PM
We have talked about trying to make a report that would shows relationships between instances and SRS records that don’t look right (ie two actual SRS records

Von Christie Thomas (she/her) an alle 06:07 PM
that is a good idea, Jenn.

Von Jacquie Samples an alle 06:09 PM
Can we expect that this bug will

Von Felix Hemme (ZBW) an alle 06:09 PM
@Jackie the quickMARC bug is fixed with Kiwi
Sorry -- Jacquie

Von Charlotte Whitt an alle 06:09 PM
Will the identical 999 ff $i and $s make it impossible to do that comparison across Inventory, instances and SRS?

Von Ann-Marie Breaux an alle 06:24 PM
Charlotte - re: your question about identical 999s - I don't think that will be an issue, but I'll add it as a question in the draft Jira I mentioned

Von Laura Daniels an alle 06:10 PM
there are issues with any system/tool: at least with FOLIO our reports of problems are taken seriously!

Von Jenn Colt an alle 06:11 PM
They are in different fields in LDP so it should still work ok to compare

Von Jennifer Eustis (she/her) an alle 06:11 PM
It would be great to have alternatives ways to do this beyond the LDP as not everyone has access to that tool

Von Jenn Colt an alle 06:11 PM
Started the list for recovering from errors here if others have things to add: Miscellaneous Tips for Data Import

Von Ann-Marie Breaux an alle 06:13 PM
Jenn - that relationship report sounds like a great idea. Slowly but surely, we are building up scripts to check for these types of problems, or bits of cleanup - that can be run on an ad hoc basis.

Von Ann-Marie Breaux an alle 06:14 PM
I'll start a draft Jira for a script that would identify relationship problems between SRS and corresponding Inventory records. Then maybe we can fill in details at an upcoming DI subgroup meeting

Charlotte Whitt 

Get volunteers who will help working on Bugfest Test Rail tickets for Inventory

1. review and update existing test Rail tickets (in time before Lotus Bugfest test start)
2. add new test rail tickets for all new work added by Lotus 

• this will be work to be done outside the MM SIG meetings
• this might be helpful for tickets related to other apps as well
• Khalilah would be grateful for volunteers sisstance as well 
• please send Charlotte a Slack message if you would like to help
• it is a good way to get to know the system, especially if new to Folio
• as we start to automate end-to-end tests, we can retire some of the manual test; and concentrate on the new and more complicated ones

• link to the overview:
• link to the related wiki page with a high level overview list: High Level - MARC Features List
• there is also some information on different documentations

Lotus release - dev freeze Jan 28th - release date April 4th

Link to the presentation of the development for Lotus

• Khalilah presents the slides and then demos the functionality in Folio that has been developed for Lotus

Authorities demo:

• • importing authority records (default profile only)
  • searching
  • sorting results display
  • filters, including exclude references (4xx/5xx) or date created/updated
  • facet: type of heading
  • edit (quickMARC interface, same as for editing other MARC record types)
  • 999 $s is uuid for source record, $i is for the same record in inventory – record is stored there, but there is no UI to view or interact with it (it's stored there to enable search, but may also be useful for future entity management work)
  • some keyboard shortcuts
  • link to documentation (Library of Congress)

No connection yet between Authority records and records in Inventory

Q: can MARC tags be displayed in results along with "Authorized, Reference, Auth/Ref"?

In mock-ups $w is displaying – this will be changed

In results, a 1xx that is in a 5xx in another record will display twice in the list, once as "Authorized" and once as "Auth/Ref"

Not demoed: advanced search, browse (see slide deck for more info)

Holdings demo:

• • New Actions menu options:
    • Edit MARC bibliographic record, Add MARC holdings record
  • Leader and 004 are prepopulated when new MARC holdings created
  • 852 is required
  • When a MARC holdings record exists, can view source and edit in quickMARC; cannot edit fields in Inventory that are mapped to source MARC (same as with bib/Instance records)
  • No way to convert existing source=FOLIO holdings to source=MARC in the UI (future feature?)
  • No way to create new MARC holdings via batch import yet either

Lotus User Acceptance testing Jan 19-Jan 26, more details next week (Authorities and/or Holdings)

Anyone is welcome to participate https://metadata.ci.folio.org - this is separate from the user acceptance testing Charlotte is doing

quickMARC subgroup is voting on feature for Morning Glory: https://www.menti.com/a5huq45xgc

Felix Hemme

Theodor Tolstoy