2024-04-15 Reporting SIG Meeting notes









Arthur AguileraUniversity of Colorado, Boulder
Eliana LimaFenway Library Organization

Sharon BeltaineCornell University
Eric LuhrsLehigh University

Erin BlockUniversity of Colorado, Boulder
Lisa McCollLehigh University

Kathleen Moore

Linda MillerCornell University

Shannon BurkeTexas A&M
Nassib NassarIndex Data

Suzette CanedaStanford University
Elena O'MalleyEmerson

Dung-Lan ChenSkidmore College
Tod OlsonUniversity of Chicago

Lloyd ChittendenMarmot
Jean PajerekCornell University

Tim DannayMount Holyoke College
Kimberly PamplinTexas A&M University 

Axel DoerrerUniversity Mainz
Scott PerryUniversity of Chicago

Shelley DoljackStanford University
Natalya PikulikCornell University

Stefan DombekLeipzig University
Emily SanfordMichigan State University

Jennifer EustisU. Massachusetts Amherst / Five College
Bob ScheierHoly Cross

Lynne ForsWellesley College
Vandana ShahCornell University

Lisa FurubottenTexas A&M
Linnea ShiehStanford University

Alissa HafeleStanford University
Susie SkowronekOakland University

Kara HartWellesley College
Kimberly SmithMiddle Tennessee State University

Corrie HutchinsonIndex Data
Clare SpitzerStanford University

Jamie JesanisMCPHS
Amelia SuttonU. Massachusetts

Jeanette KalchikStanford University
Simona TabacaruTexas A&M

Harry KaplanianEbsco
Huey-Ning Tan

Stanford University

Tim KiserMichigan State University
Vitus TangStanford University

Kevin KishimotoStanford University
Christie ThomasUniversity of Chicago

Ingolf Kusshbz
Irina TrapidoStanford University

Alexander LaoStanford University
Catherine TuohyEmmanuel College

Joanne LearyCornell University
Patrick WaiteU. Mass Amherst

Joseph MolloySpokane Public Library

Jenn ColtCornell University

Discussion Items




Attendance & NotesScott

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)
  • Today's note-takers:  Team Leads for project updates



Changes in Reporting SIG Meetings

  • "Workshopping your queries" - part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have

Impacts of New Fields and Features (Sharon)

Summary of Metadb Development Meetings (Corrie and others)

  • Issue 826 & 827 (in GitHub) were discussed and volunteers solicited.
  • Nassib encouraged using functions.  Necessary for reports that will be run using the 'Run reports' functionality in the Reporting app.
    • Questions : why use functions instead of a saved query?  Do they impact performance? 
  • Nassib raised the issue of future plans for derived tables, but no roadmap was given or discussed.
    • Questions: what are the plans for derived tables in Metadb?  Advice on how to port needs from LDP to Metadb (when derived tables were employed in LDP reports)?
  • Action steps : 
    • Corrie to take questions to Nassib 
    • Possibly having Nassib come to train on using functions?

Upcoming meeting topics (tentative)

  • next topic

Any new members?

  • Welcome/introductions

How to find our latest recordings

SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to Scott Perry  or Sharon Beltaine with any questions.

  • Representative for the Documentation Working Group 
  • Query developers

Open Refine PresentationJenn Colt


Quesnelia Bugest Testing for the Reporting AppCorrieMostly to verify we didn't break anything.
WOLFCon 2024Sharon, Scott

Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:

  • Location and Dates: Senate House, University of London, September 24-26, 2024
  • Call for Proposals Now Open: Got ideas about open-source to share? Talk about it at WOLFcon. Submit a presentation, panel, short talk, or pre-conference workshop. The deadline for submissions has been extended to April 30, 2024. Submit a session here.
  • Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.
  • Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.

Reporting SIG Planning for WOLFCon 2024:

  • Please help us with topics and ideas for reporting at the WOLFCon 2024 conference! 
  • See ideas we have so far at  WolfCon 2024 Planning

Moving from LDP to MetadbNatalya Pikulik, Sharon Markus

Cornell is in the process of moving from an LDP to a Metadb reporting database system for FOLIO reporting. Natalya and Sharon will offer a presentation called "Moving from LDP to Metadb" to share key topics from what they've learned so far in helping Cornell Library staff make this transition:

  • What is Metadb?
    • LDP versus Metadb: Overview
    • LDP versus Metadb: Data Refresh
    • Metadb Rollout Plans for the Cornell Library
    • LDP and Metadb Schema Structures
  • More about LDP and Metadb Schema Structures
    • Writing and Revising SQL queries for Metadb
    • Examples

This presentation is packed with information, so we may need to divide it into 2 parts. We'll see how it goes! 

Workshopping Queries


Bring your questions on queries written for the LDP or Metadb so we can "workshop" them!

Q: How can a user on the fly add ordinality to a derived table where it is not present? Example is the folio_derived.holdings_ext table which does not include ordinality. No solution was presented in the session. It was suggested that ordinality could be added to the derived holdings_ext and item_ext tables. 

Recurring Items (Updated weekly, but not always discussed in meeting)

Review of In-Progress Projects (Recurring)
Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)
Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

  • The working group D-Reporting is planning its own repository on GitHub.
    • Special requirements require a separate repository for the German community.
    • Content of this repository
      • SQL files for DBS (FOLIO database + Metadb)
      • Files for the FOLIO App Reporting. Special reports are created here for the German community. These are usually reports that are desired as in-app reports but are not implemented in the apps.
      • SQL files for views for querying in the FOLIO database
      • Scripts for API calls, automation, Jupyter notebooks ...
      • Wiki
  • Ongoing topics
    • Workshopping
    • DBS statistics
      • JIRA-Issues, Rpt-Clusters
      • Gap analysis to statistic codes, user counts etc.
      • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO
  • Meetings
    • Contact Stefan Dombek if you would like to get a calendar invitation

Metadb FOLIO User Group

  • Meetings
    • Contact Nassib Nassar if you would like to get a calendar invitation

Product Council

Reporting SIG Documentation Subgroup

  • Orchid documentation is live on https://docs.folio.org/docs/
  • Poppy documentation is in development
  • Additional Context
    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

For all recent work on FOLIO Reporting SQL development: