2024-03-25 Reporting SIG Meeting notes

Arthur Aguilera

University of Colorado, Boulder

Eliana Lima

Fenway Library Organization

Sharon Beltaine

Cornell University

Eric Luhrs

Lehigh University

Erin Block

University of Colorado, Boulder

Lisa McColl

Lehigh University

Kathleen Moore

Linda Miller

Cornell University

Shannon Burke

Texas A&M

Nassib Nassar

Index Data

Suzette Caneda

Stanford University

Elena O'Malley

Emerson

Dung-Lan Chen

Skidmore College

Tod Olson

University of Chicago

Lloyd Chittenden

Marmot

Jean Pajerek

Cornell University

Tim Dannay

Mount Holyoke College

Kimberly Pamplin

Texas A&M University 

Axel Doerrer

University Mainz

Scott Perry

University of Chicago

Shelley Doljack

Stanford University

Natalya Pikulik

Cornell University

Stefan Dombek

Leipzig University

Emily Sanford

Michigan State University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Bob Scheier

Holy Cross

Lynne Fors

Wellesley College

Vandana Shah

Cornell University

Lisa Furubotten

Texas A&M

Linnea Shieh

Stanford University

Alissa Hafele

Stanford University

Susie Skowronek

Oakland University

Kara Hart

Wellesley College

Kimberly Smith

Middle Tennessee State University

Corrie Hutchinson

Index Data

Clare Spitzer

Stanford University

Jamie Jesanis

MCPHS

Amelia Sutton

U. Massachusetts

Jeanette Kalchik

Stanford University

Simona Tabacaru

Texas A&M

Harry Kaplanian

Ebsco

Huey-Ning Tan

Stanford University

Tim Kiser

Michigan State University

Vitus Tang

Stanford University

Kevin Kishimoto

Stanford University

Christie Thomas

University of Chicago

Ingolf Kuss

hbz

Irina Trapido

Stanford University

Alexander Lao

Stanford University

Catherine Tuohy

Emmanuel College

Joanne Leary

Cornell University

Patrick Waite

U. Mass Amherst

Joseph Molloy

Spokane Public Library

Jenn Colt

Cornell University

Attendance & Notes

Scott

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• Today's note-takers:  Team Leads for project updates

Announcements/Reminders

Scott

Changes in Reporting SIG Meetings

• "Workshopping your queries" - part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have

Impacts of New Fields and Features (Sharon)

• Are there any new fields or features we should know about from any of the functional areas that may impact reporting?

• Review and update the Impacts of New Fields and Features on Reporting grid 

Summary of MetaDB Development Meetings (Corrie and others)

• Issue 826 & 827 (in GitHub) were discussed and volunteers solicited.

• Nassib encouraged using functions.  Necessary for reports that will be run using the 'Run reports' functionality in the Reporting app.

  • Questions : why use functions instead of a saved query?  Do they impact performance? 

• Nassib raised the issue of future plans for derived tables, but no roadmap was given or discussed.

  • Questions: what are the plans for derived tables in Metadb?  Advice on how to port needs from LDP to Metadb (when derived tables were employed in LDP reports)?

• Action steps : 

  • Corrie to take questions to Nassib 

  • Possibly having Nassib come to train on using functions?

Upcoming meeting topics (tentative)

• LDP to Metadb Transition Overview

Any new members?

• Welcome/introductions

How to find our latest recordings

• Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to @Scott Perry  or @Sharon Markus with any questions.

• Representative for the Documentation Working Group 

  • urgently needed

  • work with reporting documentation team to  update Reporting section of FOLIO documentation for each FOLIO software release 

  • see https://docs.folio.org/docs/reporting/

• Query developers

  • ongoing need

  • work on derived tables and report queries for the FOLIO Analytics repository and to support Metadb

  • see https://github.com/folio-org/folio-analytics

Open Refine Presentation

Jenn Colt

https://drive.google.com/file/d/1fpJfpD18Fxvh_-oCsovmGPPqBbZgbKXr/view?usp=sharing

Quesnelia Bugest Testing for the Reporting App

Corrie

Mostly to verify we didn't break anything.

WOLFCon 2024

Sharon, Scott

Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:

• Location and Dates: Senate House, University of London, September 24-26, 2024

• Call for Proposals Now Open: Got ideas about open-source to share? Talk about it at WOLFcon. Submit a presentation, panel, short talk, or pre-conference workshop. The deadline for submissions is March 31, 2024. Submit a session here.

• Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.

• Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.

Reporting SIG Planning for WOLFCon 2024 (deadline extended beyond 3/31, but no definite date yet):

• Please help us with topics and ideas for reporting at the WOLFCon 2024 conference! 

• See ideas we have so far at  WolfCon 2024 Planning

Workshopping Queries

Christie

Bring your questions on queries written for the LDP or Metadb so we can "workshop" them!

Q: How can a user on the fly add ordinality to a derived table where it is not present? Example is the folio_derived.holdings_ext table which does not include ordinality. No solution was presented in the session. It was suggested that ordinality could be added to the derived holdings_ext and item_ext tables. 

FOLIO Product Council Update

Jennifer Eustis

2024-03-21 Product Council Meeting Notes (8pm ET, quarterly Asia Pacific Friendly time). The first PC Asia Pacific friendly time brought together over 20 individuals. We heard an update from the Applications Formalization Review which is outlined in this presentation:

Review of In-Progress Projects (Recurring)

• Build a directory of extracted and derived tables

  • Beta version available.

• Build Metadb query cookbook-style documentation

  • ongoing project

  • The first cookbooks are available and are being expanded. See https://github.com/folio-org/folio-analytics/wiki#cookbooks

• Build Training Program for FOLIO Data Model

  • ACQ/ERM drafts have been presented and will be updated

• Port LDP derived tables to Metadb

  • possibly done??

• Recruit from new institutions not represented

  • recommend that the development teams reach out to SIGs for an update, invite new members

Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

• LDP release notes

• Metadb release notes (via tags)

• LDLite release notes (via tags)

• ldpmarc release notes

• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)

• FOLIO Analytics release notes 

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

• The working group D-Reporting is planning its own repository on GitHub.

  • Special requirements require a separate repository for the German community.

  • Content of this repository

    • SQL files for DBS (FOLIO database + Metadb)

    • Files for the FOLIO App Reporting. Special reports are created here for the German community. These are usually reports that are desired as in-app reports but are not implemented in the apps.

    • SQL files for views for querying in the FOLIO database

    • Scripts for API calls, automation, Jupyter notebooks ...

    • Wiki

• Ongoing topics

  • Workshopping

  • DBS statistics

    • JIRA-Issues, Rpt-Clusters

    • Gap analysis to statistic codes, user counts etc.

    • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO

• Meetings

  • Contact @Stefan Dombek if you would like to get a calendar invitation

Metadb FOLIO User Group

• Meetings

  • Contact @Nassib Nassar if you would like to get a calendar invitation

Product Council

• (December 8 meeting) PC shared a report of the SIG check-ins

• would love for PC to check-in yearly

Reporting SIG Documentation Subgroup

• Orchid documentation is live on https://docs.folio.org/docs/

• Poppy documentation is in development

• Additional Context

  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main