2025-03-24 Reporting SIG Meeting notes

Attendance

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• See attendance list at bottom of page
  
  

Announcements and Reminders

Sharon

Announcements:

This may be relevant. Renaming of Slack channels. https://openlibraryfoundation.atlassian.net/wiki/spaces/TECHSUPPORT/pages/3498180609/Migration+of+Slack+Workspace+from+FOLIO+to+Open+Library+Foundation

• About the Reporting SIG meeting schedule

  • Meetings are held on the first 4 Mondays of each month at 11:00 am Eastern U.S. time (see this time in your time zone). The first and third Mondays focus on Reporting Development topics, and the second and fourth Mondays focus on Reporting Business topics. 

  • "business" means topics like presentations on reporting functionality and new features, new reporting applications, surveys and studies on reporting, etc.

  • "development" means working on derived tables and report queries for the folio-analytics GitHub repository

  • "workshopping" queries could be scheduled during any of these meetings, and it would be great to have topics and/or questions in advance so we can prepare to walk through the answers/approaches, such as "how to I fix this inventory query to get rid of the duplicates?" or "what is the best way to calculate totals in this finance query?" 
    
    

• Important Upcoming Changes to LDP software support:

  • end of support is end of May 2025

    • see Mike Gorrell at Index Data for questions

    • institutions running LDP on a reporting database are encouraged to move to running Metadb software
      
      

Ongoing Topics:

• Impacts of New Fields and Features (Sharon)

  • Are there any new fields or features we should know about from any of the functional areas that may impact reporting?

  • Review and update the Impacts of New Fields and Features on Reporting grid 

• Upcoming Reporting SIG meeting topics (tentative)

  • D-Reporting group updates

  • Linked Data group updates

  • Annual Statistics demo and discussion

  • Lists App updates

• Any new members?

  • Welcome/introductions

• How to find our latest recordings

  • Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

SIG Recruitment:

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Please reach out to @Scott Perry or @Sharon Markus with any questions.

• Representative for the Documentation Working Group 

  • urgently needed

  • work with reporting documentation team to  update Reporting section of FOLIO documentation for each FOLIO software release 

  • see https://docs.folio.org/docs/reporting/

• Query developers

  • ongoing need

  • work on derived tables and report queries for the FOLIO Analytics repository and to support Metadb

  • see https://github.com/folio-org/folio-analytics

Next Steps for Metadb version 1.4 Data Array Extraction

Mike Gorrell

Mike Gorrell update on prioritizing derived tables for data array extraction for Metadb software version 1.4.

Metadb 1.4:

• We have automated the creation of the Mapping commands. This means this group will not have to do the initial mapping of JSON objects to be extracted.

• This month we’ll be testing the impact on performance (normal operation and resync)

• Will need to determine which mappings are done automatically going forward. There are some derived tables that are not used. See this usage data for CU Boulder and Chicago). We don’t want to waste cycles.

Automatic Mappings

• institutions should be ready to talk about which derived tables are priorities for them

• pg_stats gathers statistics on the number of times tables are used, but disappears each day, so needs to be captured by another job

• Metadb Log captures information on table creation duration (See https://metadb.dev/doc/ )

Review of In-Progress Projects (Recurring)

• Build a directory of extracted and derived tables

  • Beta version available.

• Build Metadb query cookbook-style documentation

  • ongoing project

  • The first cookbooks are available and are being expanded. See https://github.com/folio-org/folio-analytics/wiki#cookbooks

• Build Training Program for FOLIO Data Model

  • ACQ/ERM drafts have been presented and will be updated

• Recruit from new institutions not represented

  • recommend that the development teams reach out to SIGs for an update, invite new members

Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, marct, Metadb Projects (Recurring)

• LDP release notes

• Metadb release notes (via tags) - (includes marct for MARC data ETL)

• LDLite release notes (via tags)

• ldpmarc release notes

• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)

• FOLIO Analytics release notes 

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

• Ongoing topics: Workshopping, DBS statistics

• Meetings: Contact @Stefan Dombek if you would like to get a calendar invitation

Reporting SIG Documentation Subgroup

• Quesnelia documentation is live on https://docs.folio.org/docs/

• Ramsons documentation is in development

• Additional Context

  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main

Arthur Aguilera

University of Colorado, Boulder

Erin Block

University of Colorado, Boulder

Shannon Burke

Texas A&M University

Suzette Caneda

Stanford University

Mark Canney

Lehigh University

Dung-Lan Chen

Skidmore College

Lloyd Chittenden

Marmot

Ann Crowley

Cornell University

Tim Dannay

Mount Holyoke College

Danielle Dempsey

Villanova University

Axel Doerrer

University Mainz

Claire Dolan

?

Shelley Doljack

Stanford University

Stefan Dombek

Leipzig University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Lynne Fors

Wellesley College

Vanessa French

Lehigh University

Lisa Furubotten

Texas A&M University

Mike Gorrell

Index Data

Alissa Hafele

Stanford University

Lucy Harrison

GALILEO

Kara Hart

Wellesley College

Andrew Henryson

Texas A&M University

Corrie Hutchinson

Index Data

Jamie Jesanis

MCPHS

Jeanette Kalchik

Stanford University

Harry Kaplanian

EBSCO

Sarah Kasten

University of Chicago

Tim Kiser

Michigan State University

Kevin Kishimoto

Stanford University

Ingolf Kuss

HBZ

Natalie Koziar

?

Joshua Lambert

Missouri State University

Alexander Lao

Stanford University

Joanne Leary

Cornell University

Eliana Lima

Fenway Library Organization

Eric Luhrs

Lehigh University

Sharon Markus

Cornell University

Kathy McCarthy

EBSCO

Lisa McColl

Lehigh University

Linda Miller

Cornell University

Joseph Molloy

Spokane Public Library

Kathleen Moore

EBSCO

Nassib Nassar

Index Data

Elena O'Malley

Emerson

Tod Olson

University of Chicago

Jean Pajerek

Cornell University

Kimberly Pamplin

Texas A&M University 

Scott Perry

University of Chicago

Natalya Pikulik

Cornell University

Katie Rahman

University of Missouri

Emily Sanford

Michigan State University

Bob Scheier

Holy Cross

Lauren Schiller

University of Chicago

Lauren Seney

Index Data

Vandana Shah

Cornell University

Linnea Shieh

Stanford University

Rebekah Silverstein

Oklahoma State University

Susie Skowronek

Oakland University

Ken Smith

Valdosta State University

Kimberly Smith

Middle Tennessee State University

Clare Spitzer

Stanford University

Amelia Sutton

U. Massachusetts

Simona Tabacaru

Texas A&M University

Huey-Ning Tan

Stanford University

Vitus Tang

Stanford University

Christie Thomas

University of Chicago

Irina Trapido

Stanford University

Catherine Tuohy

Emmanuel College

Patrick Waite

U. Mass Amherst

Visitors:

Aj

?

Katherine Bargar

Five Colleges Inc.

Corrie

?

Isaac Faleh

?

Lili Knutson

?

John Malconian

Index Data

Robert Pleshar

University of Chicago

Julie Stauffer

University of Chicago