2024-04-22 Reporting SIG Meeting notes

Date

Attendees

Present?

Name

Organization

Present?

Name

Organization


Arthur AguileraUniversity of Colorado, BoulderxEliana LimaFenway Library Organization
xSharon BeltaineCornell University
Eric LuhrsLehigh University

Erin BlockUniversity of Colorado, BoulderxLisa McCollLehigh University

Kathleen Moore
xLinda MillerCornell University

Shannon BurkeTexas A&M
Nassib NassarIndex Data

Suzette CanedaStanford University
Elena O'MalleyEmerson

Dung-Lan ChenSkidmore College
Tod OlsonUniversity of Chicago

Lloyd ChittendenMarmotxJean PajerekCornell University

Tim DannayMount Holyoke CollegexKimberly PamplinTexas A&M University 

Axel DoerrerUniversity MainzxScott PerryUniversity of Chicago


Shelley DoljackStanford UniversityxNatalya PikulikCornell University
xStefan DombekLeipzig UniversityxEmily SanfordMichigan State University

Jennifer EustisU. Massachusetts Amherst / Five CollegexBob ScheierHoly Cross

Lynne ForsWellesley CollegexVandana ShahCornell University

Lisa FurubottenTexas A&M
Linnea ShiehStanford University

Alissa HafeleStanford University
Susie SkowronekOakland University

Kara HartWellesley CollegexKimberly SmithMiddle Tennessee State University
xCorrie HutchinsonIndex Data
Clare SpitzerStanford University

Jamie JesanisMCPHS
Amelia SuttonU. Massachusetts

Jeanette KalchikStanford University
Simona TabacaruTexas A&M

Harry KaplanianEbsco
Huey-Ning Tan

Stanford University


Tim KiserMichigan State University
Vitus TangStanford University
xKevin KishimotoStanford UniversityxChristie ThomasUniversity of Chicago

Ingolf Kusshbz
Irina TrapidoStanford University

Alexander LaoStanford University
Catherine TuohyEmmanuel College

Joanne LearyCornell University
Patrick WaiteU. Mass Amherst
xMike GorrellIndex Data
Joseph MolloySpokane Public Library




Jenn ColtCornell University



xAugusto Consing

Discussion Items

Item

Who

Notes

Attendance & NotesScott

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)
  • Today's note-takers:  Team Leads for project updates


Announcements/Reminders

Scott

Changes in Reporting SIG Meetings

  • "Workshopping your queries" - part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have

Impacts of New Fields and Features (Sharon)


Summary of Metadb Development Meetings (Corrie and others)

  • Issue 826 & 827 (in GitHub) were discussed and volunteers solicited.
  • Nassib encouraged using functions.  Necessary for reports that will be run using the 'Run reports' functionality in the Reporting app.
    • Questions : why use functions instead of a saved query?  Do they impact performance? 
  • Nassib raised the issue of future plans for derived tables, but no roadmap was given or discussed.
    • Questions: what are the plans for derived tables in Metadb?  Advice on how to port needs from LDP to Metadb (when derived tables were employed in LDP reports)?
  • Action steps : 
    • Corrie to take questions to Nassib 
    • Possibly having Nassib come to train on using functions?


Upcoming meeting topics (tentative)

  • Bibcontrol presentation by Klaus Hoverrath (May 13)


Any new members?

  • Welcome/introductions


How to find our latest recordings


SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to Scott Perry  or Sharon Beltaine with any questions.

  • Representative for the Documentation Working Group 
  • Query developers


Changes to the LDP/Metadb ProjectMike Gorrell

ID providing multiple people to make the support more scalable–will be ;

Corrie providing role of the product owner;

Nassib is moving off to another role;

Likely to move out to a Jira environment rather than Github 

More announcements over the coming weeks

Formally applying to OLF for inclusion in FOLIO

More timelines and goals.

Nassib will be less visible, but still involved

Running through Corrie or others but likely less direct access to Nassib

Quesnelia Bugest Testing for the Reporting AppCorrieMostly to verify we didn't break anything.
WOLFCon 2024Sharon, Scott

Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:

  • Location and Dates: Senate House, University of London, September 24-26, 2024
  • Call for Proposals Now Open: Got ideas about open-source to share? Talk about it at WOLFcon. Submit a presentation, panel, short talk, or pre-conference workshop. The deadline for submissions has been extended to April 30, 2024. Submit a session here.
  • Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.
  • Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.

Reporting SIG Planning for WOLFCon 2024:

  • Several sessions proposed for the WOLFCon 2024 conference! 
  • See ideas we have submitted so far at  WolfCon 2024 Planning


Moving from LDP to MetadbNatalya Pikulik, Sharon Markus

Cornell is in the process of moving from an LDP to a Metadb reporting database system for FOLIO reporting. Natalya and Sharon will offer a presentation called "Moving from LDP to Metadb" to share key topics from what they've learned so far in helping Cornell Library staff make this transition:

  • What is Metadb?
    • LDP versus Metadb: Overview
    • LDP versus Metadb: Data Refresh
    • Metadb Rollout Plans for the Cornell Library
    • LDP and Metadb Schema Structures
  • More about LDP and Metadb Schema Structures
    • Writing and Revising SQL queries for Metadb
    • Examples

This presentation is packed with information, so we may need to divide it into 2 parts. We'll see how it goes! 


Workshopping Queries

Christie

Bring your questions on queries written for the LDP or Metadb so we can "workshop" them!

Q: How can a user on the fly add ordinality to a derived table where it is not present? Example is the folio_derived.holdings_ext table which does not include ordinality. No solution was presented in the session. It was suggested that ordinality could be added to the derived holdings_ext and item_ext tables. 



Recurring Items (Updated weekly, but not always discussed in meeting)

ItemWhoNotes
Review of In-Progress Projects (Recurring)
Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)
Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

  • The working group D-Reporting is planning its own repository on GitHub.
    • Special requirements require a separate repository for the German community.
    • Content of this repository
      • SQL files for DBS (FOLIO database + Metadb)
      • Files for the FOLIO App Reporting. Special reports are created here for the German community. These are usually reports that are desired as in-app reports but are not implemented in the apps.
      • SQL files for views for querying in the FOLIO database
      • Scripts for API calls, automation, Jupyter notebooks ...
      • Wiki
  • Ongoing topics
    • Workshopping
    • DBS statistics
      • JIRA-Issues, Rpt-Clusters
      • Gap analysis to statistic codes, user counts etc.
      • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO
  • Meetings
    • Contact Stefan Dombek if you would like to get a calendar invitation


Metadb FOLIO User Group

  • Meetings
    • Contact Nassib Nassar if you would like to get a calendar invitation


Product Council


Reporting SIG Documentation Subgroup

  • Orchid documentation is live on https://docs.folio.org/docs/
  • Poppy documentation is in development
  • Additional Context
    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)


For all recent work on FOLIO Reporting SQL development: