2024-05-13 Reporting SIG Meeting notes









Arthur AguileraUniversity of Colorado, Boulder
Eliana LimaFenway Library Organization
xSharon BeltaineCornell University
Eric LuhrsLehigh University

Erin BlockUniversity of Colorado, Boulder
Lisa McCollLehigh University

Kathleen Moore
xLinda MillerCornell University

Shannon BurkeTexas A&M
Nassib NassarIndex Data

Suzette CanedaStanford UniversityxElena O'MalleyEmerson

Dung-Lan ChenSkidmore College
Tod OlsonUniversity of Chicago

Lloyd ChittendenMarmotxJean PajerekCornell University

Tim DannayMount Holyoke College
Kimberly PamplinTexas A&M University 
xAxel DoerrerUniversity MainzxScott PerryUniversity of Chicago

Shelley DoljackStanford UniversityxNatalya PikulikCornell University

Stefan DombekLeipzig University
Emily SanfordMichigan State University

Jennifer EustisU. Massachusetts Amherst / Five College
Bob ScheierHoly Cross

Lynne ForsWellesley College
Vandana ShahCornell University

Lisa FurubottenTexas A&M
Linnea ShiehStanford University

Alissa HafeleStanford University
Susie SkowronekOakland University
xKara HartWellesley CollegexKimberly SmithMiddle Tennessee State University
xCorrie HutchinsonIndex Data
Clare SpitzerStanford University

Jamie JesanisMCPHS
Amelia SuttonU. Massachusetts

Jeanette KalchikStanford University
Simona TabacaruTexas A&M

Harry KaplanianEbsco
Huey-Ning Tan

Stanford University

Tim KiserMichigan State University
Vitus TangStanford University
xKevin KishimotoStanford University
Christie ThomasUniversity of Chicago

Ingolf Kusshbz
Irina TrapidoStanford University

Alexander LaoStanford University
Catherine TuohyEmmanuel College

Joanne LearyCornell University
Patrick WaiteU. Mass Amherst

Mike GorrellIndex Data
Joseph MolloySpokane Public Library

Jenn ColtCornell University

Augusto Consing

xKlaus Hoverath, presenterTriangle Solutions

xAnn Crowley, visitorCornell University

Discussion Items




Attendance & NotesScott

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)
  • Today's note-takers:  Team Leads for project updates



Reporting SIG Meeting on May 27 (Memorial Day in US) is Cancelled

Ongoing Topics

  • "Workshopping your queries" - part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have

Impacts of New Fields and Features (Sharon)

Summary of Metadb Development Meetings (Corrie and others)

  • Issue 826 & 827 (in GitHub) were discussed and volunteers solicited.
  • Nassib encouraged using functions.  Necessary for reports that will be run using the 'Run reports' functionality in the Reporting app.
    • Questions : why use functions instead of a saved query?  Do they impact performance? 
  • Nassib raised the issue of future plans for derived tables, but no roadmap was given or discussed.
    • Questions: what are the plans for derived tables in Metadb?  Advice on how to port needs from LDP to Metadb (when derived tables were employed in LDP reports)?
  • Action steps : 
    • Corrie to take questions to Nassib 
    • Possibly having Nassib come to train on using functions?

Upcoming meeting topics (tentative)

  • Reporting SIG and Reporting Development meeting structure
    • focus on derived table development, support, maintenance
  • LDP to Metadb Training Part 2

Any new members?

  • Welcome/introductions

How to find our latest recordings

SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to Scott Perry  or Sharon Beltaine with any questions.

  • Representative for the Documentation Working Group 
  • Query developers

BibControl – Business Intelligence for libraries

Klaus Hoverrath

This will be a presentation on the BibControl reporting application by Klaus Hoverrath

  • The BibControl system integrate, convert, filter, and standardise raw data from FOLIO  for ETL into your data warehouse
  • automatic, event-driven import and mapping of all data
  • OLAP allows modularizing areas of reporting, e.g., invoices
  • automatic, event driven creation and distribution of reports and analysis
  • Business Intelligence features include MIS, enterprise reporting, OLAP, data mining, and has an application builder
  • "Online cockpit" is a web portal where you can publish all your reports and statistics
  • "Report Viewer" is a standalone report viewer
  • Email dispatch for reports
  • Is this product open source software? NO, Bibcontrol is the vendor
  • What institutions are using BibControl with FOLIO data? GBV, HBZ
  • Bibcontrol has been using/testing LDP since 2020 and Metadb since 2022
  • ETL for MARC data is supported
  • Association with OCLC
  • Data structure is in a star schema
  • Need to create OLAP cubes for your data in various functional areas, e.g., inventory
  • You can download data via Excel or PDF
  • Dashboards can be created with graphs, charts, and interactive data points
  • Data Viewer shows the data fields, columns, tables
  • Windows platform needed to build reports, but web portal accessible on other platforms, e.g. Mac

LDP/Metadb Project Updates

Mike, Corrie

Bring questions and feedback about the new LDP/Metadb support structure for Mike Gorrell and Corrie Hutchinson

  • Metadb Users Group meetings to be cancelled
  • The needs for support from those meetings to be addressed in other ways as we transition to a new support structure for LDP/Metadb

WOLFCon 2024Sharon, Scott

Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:

  • Location and Dates: Senate House, University of London, September 24-26, 2024
  • Call for Proposals Now Open: Got ideas about open-source to share? Talk about it at WOLFcon. Submit a presentation, panel, short talk, or pre-conference workshop. The deadline for submissions has been extended to April 30, 2024. Submit a session here.
  • Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.
  • Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.

Reporting SIG Planning for WOLFCon 2024:

  • Several sessions proposed for the WOLFCon 2024 conference! 
  • See ideas we have submitted so far at  WolfCon 2024 Planning

Workshopping Queries 


*This is a standing Reporting SIG meeting topic. We don't expect to have time for this topic during the 5/13/24 meeting, so we'll pick it up again at future meetings

Bring your questions on queries written for the LDP or Metadb so we can "workshop" them!

Q: How can a user on the fly add ordinality to a derived table where it is not present? Example is the folio_derived.holdings_ext table which does not include ordinality. No solution was presented in the session. It was suggested that ordinality could be added to the derived holdings_ext and item_ext tables. 

Recurring Items (Updated weekly, but not always discussed in meeting)

Review of In-Progress Projects (Recurring)
Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)
Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

  • The working group D-Reporting is planning its own repository on GitHub.
    • Special requirements require a separate repository for the German community.
    • Content of this repository
      • SQL files for DBS (FOLIO database + Metadb)
      • Files for the FOLIO App Reporting. Special reports are created here for the German community. These are usually reports that are desired as in-app reports but are not implemented in the apps.
      • SQL files for views for querying in the FOLIO database
      • Scripts for API calls, automation, Jupyter notebooks ...
      • Wiki
  • Ongoing topics
    • Workshopping
    • DBS statistics
      • JIRA-Issues, Rpt-Clusters
      • Gap analysis to statistic codes, user counts etc.
      • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO
  • Meetings
    • Contact Stefan Dombek if you would like to get a calendar invitation

Metadb FOLIO User Group

  • Meetings
    • Contact Nassib Nassar if you would like to get a calendar invitation

Product Council

Reporting SIG Documentation Subgroup

  • Orchid documentation is live on https://docs.folio.org/docs/
  • Poppy documentation is in development
  • Additional Context
    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

For all recent work on FOLIO Reporting SQL development: