2024-10-29 Better Sample Data Meeting notes

1. Letter to Risk Office at Michigan State University Libraries

2. Stanford is working on sample authority data to be ready soon for the snapshot environment.

2. Follow up on activities since last meeting:

   1. Update on - Golden copy for Bugfest environment.

   2. Update on - Work on a small data set for FOLIO Snapshot.

   3. Update on POC findings - write robust data anonymization scripts

Finalize the letter for the MSU dean.

The topic was on the agenda for today’s meeting with the OLF Officers. The plan was to attend and present the purpose of the letter and our draft document.

We missed it - Autumn Faulkner is to forward the letter to Simeon Warner and then we will have the conversation on Slack in stead.

Kristin sent Folio and OLF images for the letterhead.

Autumn Faulkner- We need to finalize the Google Doc with the revised version of the letter to be brought to the

Identified MARC formatted holding records; we still need an instance to go with it. We discussed the letter, Autumn has everything she needs and will forward the letter to the dean.

a. Golden Copy / Yogesh Kumar

The environment was created by the Kitfox team and updated by QA. The Kitfox team is now working on fixing the issues listed here /wiki/spaces/DQA/pages/203685917

All work is done by now. Cleaning duplicate scripts is not easy, and teams are busy wrapping up Ramsons' features. Writing such scripts may be possible in the sunflower release. For Ramson, we will have to manually clean it, if needed.

Charlotte can check with Charles Ledvina, how he would recommend to identify duplicates.
Update: Charles Ledvina dedupe records based on the legacy systems control number.  In other words, since I use the legacy control number as HRID, if the HRID has already been seen, then the record gets rejected.

In Bugfest - depending on the source of the records - then most likely, the legacy control number would be the OCLC number. Can we do dedupe OCLC number?

b. Snapshot environment. Update from Charlotte Whitt: Still waiting for the environment - monthly build environment: https://folio-quesnelia.dev.folio.org/ to be built.

Update: Charlotte are trying to get this to move. Status is the work is still Open (To do).

Recruit members from MM-SIG - extra eyes, review the records updated in FOLIO Instance = FOLIO - Still waiting on env.

Status:

Autumn has provided sample data for music records and serials records with multiple holds and multiple items. Holdings statements to be added.

These records are loaded to this groups shared drive.

Write up Data Import Job profiles - Kristin Martin?

Data Import Job Profile which can import ~ 100 bibs in MARC 21 and create instance, holdings, item (corresponding to the locations we have set up). MM-SIG eyes on the 100 bibs. That these records has the right mix of misc. types, to cover the basic; incl. bound-with.

Stanford has MFHD-formed holdings data in the current export workflow. Alissa Hafele mentioned that Stanford could probably provide these data. Maybe ~25-50 examples—In progress.

Then later we can move on to Order/Order lines data. We will ask the Acquisition SIG (Kristin Martin will take the lead on this), the ERM-SIG to review the entered data - waiting for initial env. and data to be added.

c. Anonymization script

Update: from Lee Braginsky

Right now, we have a POC. Lee is requesting that 2 developers from the community help right a Java/SQL and folio schema tool to anonymize the data for 2 sprints.

Tod suggests publicizing developers' requirements in the #folio-implementers slack channel.

When Stanford is ready to deliver data, Yogesh and Lee can set up a meeting. Alissa will check with her colleagues.

Lee Braginsky Can we make the anonymized POC slide deck available in the WG folders? Is the POC code in Github? Yogesh to follow up.

2. Review timeline document

• Draft - timeline document -

We will split it up the the three tracks as listed above.

Yogesh will update the Golden copy (Bugfest) section.

Charlotte will update the FOLIO Snapshot section (stuck until we get the environment up and running)

Lee will update the time line doc for his work on anonymization scripts.

3. Other topics

?