2024-05-13 Reporting SIG Meeting notes

Stanford University

Announcements/Reminders

Reporting SIG Meeting on May 27 (Memorial Day in US) is Cancelled

Ongoing Topics

• "Workshopping your queries" - part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have

Impacts of New Fields and Features (Sharon)

• Are there any new fields or features we should know about from any of the functional areas that may impact reporting?
• Review and update the Impacts of New Fields and Features on Reporting grid 

Summary of Metadb Development Meetings (Corrie and others)

• Issue 826 & 827 (in GitHub) were discussed and volunteers solicited.
• Nassib encouraged using functions.  Necessary for reports that will be run using the 'Run reports' functionality in the Reporting app.
  • Questions : why use functions instead of a saved query?  Do they impact performance? 
• Nassib raised the issue of future plans for derived tables, but no roadmap was given or discussed.
  • Questions: what are the plans for derived tables in Metadb?  Advice on how to port needs from LDP to Metadb (when derived tables were employed in LDP reports)?
• Action steps : 
  • Corrie to take questions to Nassib 
  • Possibly having Nassib come to train on using functions?

Upcoming meeting topics (tentative)

• Reporting SIG and Reporting Development meeting structure
  • focus on derived table development, support, maintenance
• LDP to Metadb Training Part 2

Any new members?

• Welcome/introductions

• Representative for the Documentation Working Group 
  • urgently needed
  • work with reporting documentation team to  update Reporting section of FOLIO documentation for each FOLIO software release 
  • see https://docs.folio.org/docs/reporting/
• Query developers
  
  • ongoing need
  • work on derived tables and report queries for the FOLIO Analytics repository and to support Metadb
  • see https://github.com/folio-org/folio-analytics

BibControl – Business Intelligence for libraries

This will be a presentation on the BibControl reporting application by Klaus Hoverrath

• The BibControl system integrate, convert, filter, and standardise raw data from FOLIO  for ETL into your data warehouse
• automatic, event-driven import and mapping of all data
• OLAP allows modularizing areas of reporting, e.g., invoices
• automatic, event driven creation and distribution of reports and analysis
• Business Intelligence features include MIS, enterprise reporting, OLAP, data mining, and has an application builder
• "Online cockpit" is a web portal where you can publish all your reports and statistics
• "Report Viewer" is a standalone report viewer
• Email dispatch for reports
• Is this product open source software? NO, Bibcontrol is the vendor
• What institutions are using BibControl with FOLIO data? GBV, HBZ
• Bibcontrol has been using/testing LDP since 2020 and Metadb since 2022
• ETL for MARC data is supported
• Association with OCLC
• Data structure is in a star schema
• Need to create OLAP cubes for your data in various functional areas, e.g., inventory
• You can download data via Excel or PDF
• Dashboards can be created with graphs, charts, and interactive data points
• Data Viewer shows the data fields, columns, tables
• Windows platform needed to build reports, but web portal accessible on other platforms, e.g. Mac

LDP/Metadb Project Updates

Bring questions and feedback about the new LDP/Metadb support structure for Mike Gorrell and Corrie Hutchinson

• Metadb Users Group meetings to be cancelled
• The needs for support from those meetings to be addressed in other ways as we transition to a new support structure for LDP/Metadb

Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:

• Location and Dates: Senate House, University of London, September 24-26, 2024
• Call for Proposals Now Open: Got ideas about open-source to share? Talk about it at WOLFcon. Submit a presentation, panel, short talk, or pre-conference workshop. The deadline for submissions has been extended to April 30, 2024. Submit a session here.
• Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.
• Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.

Reporting SIG Planning for WOLFCon 2024:

• Several sessions proposed for the WOLFCon 2024 conference! 
• See ideas we have submitted so far at  WolfCon 2024 Planning

Workshopping Queries 

*This is a standing Reporting SIG meeting topic. We don't expect to have time for this topic during the 5/13/24 meeting, so we'll pick it up again at future meetings

Bring your questions on queries written for the LDP or Metadb so we can "workshop" them!

Q: How can a user on the fly add ordinality to a derived table where it is not present? Example is the folio_derived.holdings_ext table which does not include ordinality. No solution was presented in the session. It was suggested that ordinality could be added to the derived holdings_ext and item_ext tables. 

• Build a directory of extracted and derived tables
  • Beta version available.
• Build Metadb query cookbook-style documentation
  • ongoing project
  • The first cookbooks are available and are being expanded. See https://github.com/folio-org/folio-analytics/wiki#cookbooks
• Build Training Program for FOLIO Data Model
  • ACQ/ERM drafts have been presented and will be updated
• Port LDP derived tables to Metadb
  • possibly done??
• Recruit from new institutions not represented
  • recommend that the development teams reach out to SIGs for an update, invite new members

• LDP release notes
• Metadb release notes (via tags)
• LDLite release notes (via tags)
• ldpmarc release notes
• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)
• FOLIO Analytics release notes 

Metadb FOLIO User Group

• Meetings
  • Contact Nassib Nassar if you would like to get a calendar invitation

Product Council

• (December 8 meeting) PC shared a report of the SIG check-ins
• would love for PC to check-in yearly

Reporting SIG Documentation Subgroup

• Orchid documentation is live on https://docs.folio.org/docs/
• Poppy documentation is in development
• Additional Context
  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main