2023-02-16 Reporting SIG Meeting notes

Arthur Aguilera

University of Colorado, Boulder

Eliana Lima

Fenway Library Organization

Sharon Beltaine

Cornell University

Eric Luhrs

Lehigh University

Erin Block

University of Colorado, Boulder

Linda Miller

Cornell University

Nancy Bolduc

Cornell University

Nassib Nassar

Index Data

Shannon Burke

Texas A&M

Elena O'Malley

Emerson

Suzette Caneda

Stanford University

Tod Olson

University of Chicago

Lloyd Chittenden

Marmot

Jean Pajerek

Cornell University

Tim Dannay

Mount Holyoke College

Michael Patrick

The University of Alabama

Axel Doerrer

University Mainz

Eric Pennington

Texas A&M

Shelley Doljack

Stanford University

Scott Perry

University of Chicago

Stefan Dombek

Leipzig University

Natalya Pikulik

Cornell University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Bob Scheier

Holy Cross

Lynne Fors

Wellesley College

Vandana Shah

Cornell University

Lisa Furubotten

Texas A&M

Linnea Shieh

Stanford University

Alissa Hafele

Stanford University

Clare Spitzer

Stanford University

Kara Hart

Wellesley College

Amelia Sutton

U. Massachusetts

Corrie Hutchinson

Index Data

Simona Tabacaru

Texas A&M

Jamie Jesanis

Wellesley College

Huey-Ning Tan

Stanford University

Jeanette Kalchik

Stanford University

Vitus Tang

Stanford University

Kevin Kishimoto

Stanford University

Irina Trapido

Stanford University

Ingolf Kuss

hbz

Catherine Tuohy

Emmanuel College

Alexander Lao

Stanford University

Kevin Walker

The University of Alabama

Joanne Leary

Cornell University

Angela Zoss

Duke University

Attendance & Notes

Sharon

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• Today's note-takers:  Team Leads for project updates

Announcements /
Reminders

Sharon

Reminder: Join our Review Board

• Great way to start learning to run LDP1 and Metadb queries, get comfortable with GitHub

• No experience required! We will offer training.

• We have three now, but we would love four!

• Contact @Sharon Markus or @Angela Zoss (Old) if you have questions or would like to volunteer

FOLIO Forum

Forum Title: FOLIO Reporting in Practice

• Time: Wednesday, February 22, 2023 at 11:00am Eastern U.S. time

• To Register: https://openlibraryfoundation.zoom.us/webinar/register/WN_O0-8c003R-eDOyXlQKzvVg

• Description:
  Librarians will discuss real-world applications and experiences of FOLIO Reporting with the open-source LDP software:

  • How LDP1 is used to improve inventory data quality

  • Helping new implementors get up and running with FOLIO Reporting

  • What Cornell did to prepare for implementing LDP1 and reporting support services

  • How Tableau dashboards are being used to provide interactive visualizations of LDP1 data

• Presenters:

  • Jenn Colt, Cornell University

  • Angela Zoss, Duke University

  • Sharon Beltaine, Cornell University

  • Vandana Shah, Cornell University

Upcoming meeting topics

• Feb 27: Update on derived table documentation (draft script)

• Mar 2: presentation on how to use primary entries for contributors to filter and aggregate (Joanne Leary, Jean Pajerek, and Sharon Beltaine)

Any new members?

• Welcome/introductions

• Would anyone like a buddy? Like to be a buddy?

How to find our latest recordings

• Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

(Always) Recruiting New Query Developers

• The Reporting SIG is always on the look-out for new query developers. Please let us know if you are interested in doing query development or if there are others at your institution who might be a good fit.

Progress Update: LDP1 Hosting Discussion Summary

Angela

LDP1 Hosting - Experiences and Strategies from Users/DevOps Providers

• This document summarizes a discussion in the SysOps and Management SIG

• It has been posted and is available for sharing

Review and discussion: Reporting SIG survey results

Angela

Reporting SIG Survey 2023 - Results Summary

• Thoughts? Questions?

  • look into whether responses were different based on time in SIG

  • I cannot remember, why did the slack for reporting move from the FOLIO project to it's own project?

    • Metadb/LDP Slack 

      • this slack space is specific to the software applications maintained by Index Data and helps them monitor just one space for both FOLIO and ReShare customers

      • Angela tries to duplicate SIG-only material in both FOLIO and Metadb Slack

• Possible next steps

  • proactive with buddies/mentors

  • reviewing onboarding steps, collaborating with other conveners

  • maybe spin up a wiki working group

  • would it make sense to have a list of buddies available and a couple of sentences about what the buddy is good at doing? maybe new people would be more comfortable reaching out that way?

    • possibility: build out the wiki pages so that they include more information about development subteams and who might be a good person to contact on those teams

  • What works best for onboarding?

    • smaller subgroup meetings

    • Slack is useful; recognize people's names, can reach out to individuals directly; can feel a bit like cold-calling the first time

    • do like the idea of small, defined tasks for a beginner; felt overwhelmed by something big like a review board, but maybe a small task would get someone hooked

    • agree, small group meetings, initial training on things like SQL

  • What do we think about development team meetings as a small group?

    • enjoy those, feel like they are welcoming; it's nice and it's a small group. still don't understand, but keep trying. 

Review of In-Progress Projects (Recurring)

• Build a directory of extracted and derived tables

  • update coming (Feb 27)

• Build Metadb query cookbook-style documentation

  • has been opened and sent to the development teams for planning/prioritization

  • haven't settled on a style exactly, but have some examples

• Build Training Program for FOLIO Data Model

  • expecting ACQ/ERM presentation in March

• Port LDP1 derived tables to Metadb

  • expecting to finish for Orchid release

• Recruit from new institutions not represented

  • waiting to see about FOLIO-wide onboarding efforts

  • recommend that the development teams reach out to SIGs for an update, invite new members

Review the release notes for FOLIO Analytics, LDP1, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

• LDP1 release notes

• Metadb release notes (via tags)

• LDLite release notes (via tags)

• ldpmarc release notes

• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)

• FOLIO Analytics release notes 

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

RA/UM Working Group

• Meetings have become more of a lab session, working through specific problems

• Contact Angela if you would like to join these meetings; second Tuesdays at 1pm Eastern

• Context

  • Meeting notes: https://docs.google.com/document/d/1UnzG64tl917LOH2FtWhCEPlSOsnJWKL-0eu88Ouo1DU/edit

  • Current status of RA/UM issues: https://github.com/folio-org/folio-analytics/issues?q=is%3Aissue+is%3Aopen+RA%2FUM

  • Status of LDP1 → Metadb querying porting: https://docs.google.com/spreadsheets/d/1efLc6QMJyGuXyQM26pZbti-B6wFhJuZt7s7FJbhdXYo/edit#gid=0

MM Working Group

• Meetings are 1st Tuesday of the month, 12-1pm ET via zoom using the usual FOLIO password. Our lab sessions are open to everyone. Please bring your questions, examples, and comments about reporting and metadata. MM notes

• We have begun working on the MM Data Model for folio. We are using as a these slides for our work.

• We are looking for a convenor for the group. If interested, contact Jennifer Eustis on LDP/Metadb slack.

ERM Working Group

• FOLIO Data Model Training (in progress)

• ERM Query Development Status

• Open Access

  • Report requests are being collected in the OA SIG Link (in progress)

  • The test environment from the SIG Reporting will get the app OA (in progress)

  • Test data will imported

  • Recent FOLIO Forum on Open Access App

• Meetings are bi-weekly on tuesdays 11am ET alternating with RM Working Group

  • Next meeting will be at 28th, Feb

  • Contact @Stefan Dombek if you would like to get a calendar invitation

ACQ Working Group

• group is working with ERM group on ACQ-ERM FOLIO Data Model Training 

• group is working on ACQ-related (Acquisitions) derived tables for the next Folio-Analytics release 

  • see ACQ Derived Tables to Convert from LDP1 to Metadb

• for latest query development updates, see RM Prototype and Query Development Status

• Meetings are biweekly on Tuesdays 11am-noon ET; contact @Sharon Markus if you would like a calendar invitation

• Meeting Recordings are here: FOLIO ERM-RM Report Dev Teams

Reporting SIG Documentation Subgroup

• Morning Glory documentation is live on https://docs.folio.org/docs/

• Nolana documentation is in review

• Orchid documentation will be in progress soon, and plans are underway to include beta-level documentation for Metadb

• Additional Context

  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

External Statistics Working Group

• no updates currently

• new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository

• New organizational structure for External Statistics reports

  • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas

  • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository

  • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues

  • each reporting development team will take responsibility for the queries in their area for the external statistics clusters

Product Council

• (December 8 meeting) PC shared a report of the SIG check-ins

• would love for PC to check-in yearly

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main