2024-05-13 Reporting SIG Meeting notes

Arthur Aguilera

University of Colorado, Boulder

Eliana Lima

Fenway Library Organization

Sharon Beltaine

Cornell University

Eric Luhrs

Lehigh University

Erin Block

University of Colorado, Boulder

Lisa McColl

Lehigh University

Kathleen Moore

Linda Miller

Cornell University

Shannon Burke

Texas A&M

Nassib Nassar

Index Data

Suzette Caneda

Stanford University

Elena O'Malley

Emerson

Dung-Lan Chen

Skidmore College

Tod Olson

University of Chicago

Lloyd Chittenden

Marmot

Jean Pajerek

Cornell University

Tim Dannay

Mount Holyoke College

Kimberly Pamplin

Texas A&M University 

Axel Doerrer

University Mainz

Scott Perry

University of Chicago

Shelley Doljack

Stanford University

Natalya Pikulik

Cornell University

Stefan Dombek

Leipzig University

Emily Sanford

Michigan State University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Bob Scheier

Holy Cross

Lynne Fors

Wellesley College

Vandana Shah

Cornell University

Lisa Furubotten

Texas A&M

Linnea Shieh

Stanford University

Alissa Hafele

Stanford University

Susie Skowronek

Oakland University

Kara Hart

Wellesley College

Kimberly Smith

Middle Tennessee State University

Corrie Hutchinson

Index Data

Clare Spitzer

Stanford University

Jamie Jesanis

MCPHS

Amelia Sutton

U. Massachusetts

Jeanette Kalchik

Stanford University

Simona Tabacaru

Texas A&M

Harry Kaplanian

Ebsco

Huey-Ning Tan

Stanford University

Tim Kiser

Michigan State University

Vitus Tang

Stanford University

Kevin Kishimoto

Stanford University

Christie Thomas

University of Chicago

Ingolf Kuss

hbz

Irina Trapido

Stanford University

Alexander Lao

Stanford University

Catherine Tuohy

Emmanuel College

Joanne Leary

Cornell University

Patrick Waite

U. Mass Amherst

Mike Gorrell

Index Data

Joseph Molloy

Spokane Public Library

Jenn Colt

Cornell University

Augusto Consing

Klaus Hoverath, presenter

Triangle Solutions

Ann Crowley, visitor

Cornell University

Attendance & Notes

Scott

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• Today's note-takers:  Team Leads for project updates

Announcements/Reminders

Scott

Reporting SIG Meeting on May 27 (Memorial Day in US) is Cancelled

Ongoing Topics

• "Workshopping your queries" - part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have

Impacts of New Fields and Features (Sharon)

• Are there any new fields or features we should know about from any of the functional areas that may impact reporting?

• Review and update the Impacts of New Fields and Features on Reporting grid 

Summary of Metadb Development Meetings (Corrie and others)

• Issue 826 & 827 (in GitHub) were discussed and volunteers solicited.

• Nassib encouraged using functions.  Necessary for reports that will be run using the 'Run reports' functionality in the Reporting app.

  • Questions : why use functions instead of a saved query?  Do they impact performance? 

• Nassib raised the issue of future plans for derived tables, but no roadmap was given or discussed.

  • Questions: what are the plans for derived tables in Metadb?  Advice on how to port needs from LDP to Metadb (when derived tables were employed in LDP reports)?

• Action steps : 

  • Corrie to take questions to Nassib 

  • Possibly having Nassib come to train on using functions?

Upcoming meeting topics (tentative)

• Reporting SIG and Reporting Development meeting structure

  • focus on derived table development, support, maintenance

• LDP to Metadb Training Part 2

Any new members?

• Welcome/introductions

How to find our latest recordings

• Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to @Scott Perry  or @Sharon Markus with any questions.

• Representative for the Documentation Working Group 

  • urgently needed

  • work with reporting documentation team to  update Reporting section of FOLIO documentation for each FOLIO software release 

  • see https://docs.folio.org/docs/reporting/

• Query developers

  • ongoing need

  • work on derived tables and report queries for the FOLIO Analytics repository and to support Metadb

  • see https://github.com/folio-org/folio-analytics

BibControl – Business Intelligence for libraries

Klaus Hoverrath

This will be a presentation on the BibControl reporting application by Klaus Hoverrath

• The BibControl system integrate, convert, filter, and standardise raw data from FOLIO  for ETL into your data warehouse

• automatic, event-driven import and mapping of all data

• OLAP allows modularizing areas of reporting, e.g., invoices

• automatic, event driven creation and distribution of reports and analysis

• Business Intelligence features include MIS, enterprise reporting, OLAP, data mining, and has an application builder

• "Online cockpit" is a web portal where you can publish all your reports and statistics

• "Report Viewer" is a standalone report viewer

• Email dispatch for reports

• Is this product open source software? NO, Bibcontrol is the vendor

• What institutions are using BibControl with FOLIO data? GBV, HBZ

• Bibcontrol has been using/testing LDP since 2020 and Metadb since 2022

• ETL for MARC data is supported

• Association with OCLC

• Data structure is in a star schema

• Need to create OLAP cubes for your data in various functional areas, e.g., inventory

• You can download data via Excel or PDF

• Dashboards can be created with graphs, charts, and interactive data points

• Data Viewer shows the data fields, columns, tables

• Windows platform needed to build reports, but web portal accessible on other platforms, e.g. Mac

LDP/Metadb Project Updates

Mike, Corrie

Bring questions and feedback about the new LDP/Metadb support structure for Mike Gorrell and Corrie Hutchinson

• Metadb Users Group meetings to be cancelled

• The needs for support from those meetings to be addressed in other ways as we transition to a new support structure for LDP/Metadb

WOLFCon 2024

Sharon, Scott

Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:

• Location and Dates: Senate House, University of London, September 24-26, 2024

• Call for Proposals Now Open: Got ideas about open-source to share? Talk about it at WOLFcon. Submit a presentation, panel, short talk, or pre-conference workshop. The deadline for submissions has been extended to April 30, 2024. Submit a session here.

• Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.

• Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.

Reporting SIG Planning for WOLFCon 2024:

• Several sessions proposed for the WOLFCon 2024 conference! 

• See ideas we have submitted so far at  WolfCon 2024 Planning

Workshopping Queries 

Christie

*This is a standing Reporting SIG meeting topic. We don't expect to have time for this topic during the 5/13/24 meeting, so we'll pick it up again at future meetings

Bring your questions on queries written for the LDP or Metadb so we can "workshop" them!

Q: How can a user on the fly add ordinality to a derived table where it is not present? Example is the folio_derived.holdings_ext table which does not include ordinality. No solution was presented in the session. It was suggested that ordinality could be added to the derived holdings_ext and item_ext tables. 

Review of In-Progress Projects (Recurring)

• Build a directory of extracted and derived tables

  • Beta version available.

• Build Metadb query cookbook-style documentation

  • ongoing project

  • The first cookbooks are available and are being expanded. See https://github.com/folio-org/folio-analytics/wiki#cookbooks

• Build Training Program for FOLIO Data Model

  • ACQ/ERM drafts have been presented and will be updated

• Port LDP derived tables to Metadb

  • possibly done??

• Recruit from new institutions not represented

  • recommend that the development teams reach out to SIGs for an update, invite new members

Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

• LDP release notes

• Metadb release notes (via tags)

• LDLite release notes (via tags)

• ldpmarc release notes

• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)

• FOLIO Analytics release notes 

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

• The working group D-Reporting is planning its own repository on GitHub.

  • Special requirements require a separate repository for the German community.

  • Content of this repository

    • SQL files for DBS (FOLIO database + Metadb)