2024-02-12 Reporting SIG Meeting notes

Arthur Aguilera

University of Colorado, Boulder

Eliana Lima

Fenway Library Organization

Sharon Beltaine

Cornell University

Eric Luhrs

Lehigh University

Erin Block

University of Colorado, Boulder

Lisa McColl

Lehigh University

Kathleen Moore

Linda Miller

Cornell University

Shannon Burke

Texas A&M

Nassib Nassar

Index Data

Suzette Caneda

Stanford University

Elena O'Malley

Emerson

Dung-Lan Chen

Skidmore College

Tod Olson

University of Chicago

Lloyd Chittenden

Marmot

Jean Pajerek

Cornell University

Tim Dannay

Mount Holyoke College

Kimberly Pamplin

Texas A&M University 

Axel Doerrer

University Mainz

Scott Perry

University of Chicago

Shelley Doljack

Stanford University

Natalya Pikulik

Cornell University

Stefan Dombek

Leipzig University

Emily Sanford

Michigan State University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Bob Scheier

Holy Cross

Lynne Fors

Wellesley College

Vandana Shah

Cornell University

Lisa Furubotten

Texas A&M

Linnea Shieh

Stanford University

Alissa Hafele

Stanford University

Susie Skowronek

Oakland University

Kara Hart

Wellesley College

Kimberly Smith

Middle Tennessee State University

Corrie Hutchinson

Index Data

Clare Spitzer

Stanford University

Jamie Jesanis

MCPHS

Amelia Sutton

U. Massachusetts

Jeanette Kalchik

Stanford University

Simona Tabacaru

Texas A&M

Harry Kaplanian

Ebsco

Huey-Ning Tan

Stanford University

Tim Kiser

Michigan State University

Vitus Tang

Stanford University

Kevin Kishimoto

Stanford University

Christie Thomas

University of Chicago

Ingolf Kuss

hbz

Irina Trapido

Stanford University

Alexander Lao

Stanford University

Catherine Tuohy

Emmanuel College

Joanne Leary

Cornell University

Patrick Waite

U. Mass Amherst

Joseph Molloy

Spokane Public Library

Attendance & Notes

Sharon

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• Today's note-takers:  Team Leads for project updates

Announcements/Reminders

Sharon

Changes in Reporting SIG Meetings

• Reporting SIG meetings will take place at 11am ET on the 2nd and 4th Mondays of the month only starting Monday February 12, 2024

• "Workshopping your queries" - part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have

Impacts of New Fields and Features (Sharon)

• Are there any new fields or features we should know about from any of the functional areas that may impact reporting?

• Review and update the Impacts of New Fields and Features on Reporting grid 

FOLIO Analytics Update

• Poppy and FOLIO Analytics 1.7 were both released in December.

Upcoming meeting topics (tentative)

• Lehigh's use of the Reporting App, Lisa McColl - Feb 26

• Metadb Updates, Nassib Nassar - March 11

Any new members?

• Welcome/introductions

How to find our latest recordings

• Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to @Scott Perry  or @Sharon Markus with any questions.

• Representative for the Documentation Working Group 

  • urgently needed

  • work with reporting documentation team to  update Reporting section of FOLIO documentation for each FOLIO software release 

  • see https://docs.folio.org/docs/reporting/

• Query developers

  • ongoing need

  • work on derived tables and report queries for the FOLIO Analytics repository and to support Metadb

  • see https://github.com/folio-org/folio-analytics

Workshopping Queries

Christie

Bring your questions on queries written for the LDP or Metadb so we can "workshop" them! 

• Working with the calendar tables in metadb. Exceptions and normal hours.

  • How to merge queries for the exception and normal hours. 

  • A similar report was tried in one of the subgroups that was able to extract interval times. 

    • S. Dombek provided an description of how this was done and the limitations of this solution. An example was provided.

• What is the schedule of the derived table updates and what are the issues?

  • Comments about

    • performance querying on the main tables - queries are timing out. performance on the derived tables is much more acceptable.

    • concern about mixing data between the static derived tables and the more real-time data of the main tables. 

    • more secure to use derived tables for dashboards, etc, because only limited permissions are required.

• How do we get data between the receiving app and orders? 

  • Has been forwarded to Nassib to discuss in the MetaDB users group.

• Has someone experience with sequence querying? 

  • How to create diagrams illustrating the difference between loans during the last year and distributions within the year. 

  • Could be a first good example for a sequence for historic data.

• How to add ordinality to an existing table?

  • Will post in SQL channel since no time. 

Next Tasks for Reporting SIG: Consortia SIG and DBS reports

Corrie, Stefan

Consortia SIG and the DBS reports for D-Reporting are the next big task for the Reporting SIG

• Check overlaps between the reports from Consortia SIG and D-Reporting

• It is crucial to find the right method

  • Collect requirements via JIRA. Some missing features may still need to be implemented. The implementations should be via FOLIO rather than LDP. Example: Statistic codes

  • The data is stored very differently

  • Distribution type: Cookbooks, Scripts etc. with the possibility to set parameters

PC Updates

Jennifer Eustis

2024-02-08 Product Council Agenda and Meeting Notes. We discussed the evaluation process for new functionality and the role of the PC in relation to the Community Council and Technical Council.

Review of In-Progress Projects (Recurring)

• Build a directory of extracted and derived tables

• Build Metadb query cookbook-style documentation

  • has been opened and sent to the development teams for planning/prioritization

  • haven't settled on a style exactly, but have some examples

• Build Training Program for FOLIO Data Model

  • ACQ/ERM drafts have been presented and will be updated

• Port LDP derived tables to Metadb

  • possibly done??

• Recruit from new institutions not represented

  • recommend that the development teams reach out to SIGs for an update, invite new members

Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

• LDP release notes

• Metadb release notes (via tags)

• LDLite release notes (via tags)

• ldpmarc release notes

• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)

• FOLIO Analytics release notes 

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

• Feb 5th, 2024: Presentation of the BibControl software from Triangle Solutions GmbH

• Ongoing topics

  • DBS statistics

    • JIRA-Issues, Rpt-Clusters

    • Gap analysis to statistic codes, user counts etc.

    • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO

• Meetings

  • Contact @Stefan Dombek if you would like to get a calendar invitation

Metadb FOLIO User Group

• Meetings

  • Contact @Nassib Nassar if you would like to get a calendar invitation

Product Council

• (December 8 meeting) PC shared a report of the SIG check-ins

• would love for PC to check-in yearly

Reporting SIG Documentation Subgroup

• Orchid documentation is live on https://docs.folio.org/docs/

• Poppy documentation is in development

• Additional Context

  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main