2022-07-07 Reporting SIG Meeting notes









Arthur AguileraUniversity of Colorado, Boulder
Linda MillerCornell University

Sharon BeltaineCornell University
Nassib NassarIndex Data

Erin BlockUniversity of Colorado, BoulderxElena O'MalleyEmerson

Nancy BolducCornell University
Tod OlsonUniversity of Chicago
xSuzette CanedaStanford University
Jean PajerekCornell University

Lloyd ChittendenMarmot
Michael PatrickThe University of Alabama

Tim DannayMount Holyoke College
Eric PenningtonTexas A&M

Axel DoerrerUniversity Mainz
Scott PerryUniversity of Chicago

Shelley DoljackStanford UniversityxNatalya PikulikCornell University

Stefan DombekLeipzig University
Vandana ShahCornell University

Jennifer EustisU. Massachusetts Amherst / Five College
Linnea ShiehStanford University
xAlissa HafeleStanford University
Clare SpitzerStanford University
xJeanette KalchikStanford University
Amelia SuttonU. Massachusetts
xKevin KishimotoStanford University
Simona TabacaruTexas A&M

Ingolf Kusshbz
Huey-Ning Tan

Stanford University

Joanne LearyCornell University
Vitus TangStanford University
xEliana LimaFenway Library Organization
Irina TrapidoStanford University

Alexander LaoStanford University
Kevin WalkerThe University of Alabama

Eric LuhrsLehigh UniversityxAngela ZossDuke University

Discussion Items




Attendance & NotesAngela

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)
  • Today's note-takers:  Team Leads for project updates

Announcements /


Cancelling Monday's SIG meeting

  • No SIG meeting on July 11
  • Next SIG meetings: July 21, July 25

Reporting Documentation Subgroup needs new leader

  • We are bidding a fond farewell to Eric Pennington, who has done a wonderful job on our query development teams as well as our documentation team. Thank you, Eric!
  • The documentation team now needs a new leader. This is generally one meeting a month with the FOLIO-wide Documentation Working Group, plus additional time coordinating with the Reporting SIG subgroup members. (The documentation is at a relatively stable state now, with minor updates needed for each new FOLIO release.)
  • Also subteam meetings every other week.
  • Documentation is written to conform to the Google Developer Style Guide.
  • No need to have extensive experience with the SIG or the FOLIO reporting systems at this time! This is a great way to learn about everything!
  • Please reach out to Axel Dörrer or Sharon Beltaine if you might be interested.

Trying out a new Slack space for LDP questions

  • There are questions related to LDP projects (e.g., LDP-1, Metadb, LDLite, LDP query builder app) that cut across FOLIO and ReShare
  • Nassib is trying out a single Slack space for questions/support
  • Can use this invitation to add yourself

Want to join Development Team meetings?

  • These meetings have been happening on Wednesdays, 9am Eastern, every two weeks
  • Last week we filled out a scheduling poll to find a new time that is more convenient for Pacific coast
  • The new time will be: 1st and 3rd Wednesdays at 11am Eastern
  • Let Angela Zoss (Old)  know if you would like to start coming to the meetings
  • Angela Zoss (Old) will add a wiki page to explain about this group and where to find meeting notes/recordings

WOLFCon 2022

  • Aug 31-Sep 2; Hamburg, Germany
  • Registration Open
    • Early registration for in person is a $50 savings, extended to June 3 
    • Virtual attendance: $15, already open
  • Current planned sessions
  • Two reporting-related sessions planned:
    • SIG organized: Reporting Lessons from Implementers (Panel, Standard (50 min), Hall (up to 250 people), Live presentation)
    • LDP/Nassib organized:
      • Introduction to LDP

How to find our latest recordings

(Always) Recruiting New Query Developers

  • The Reporting SIG is always on the look-out for new query developers. Please let us know if you are interested in doing query development or if there are others at your institution who might be a good fit.

Reflection on alternating SIG meeting times
  • We have been on a trial of this schedule for SIG meetings for the last few months
  • Thoughts/reflections?
    • Actually feels pretty frequent, maybe don't feel like I have to come every time, just showing up because it's on the calendar
    • mission stuff is important, but maybe not the most engaging topic
    • want more on-the-group training
    • have been trying to play around with test environments but am flailing
    • people on East coast can do both meetings, but have actually only been coming to Thursday
    • agree - have enjoyed visioning, but the on-the-ground training has been really useful
    • pleased to see Stanford people on Thursdays
    • Monday meetings are deeper discussion days and Thursdays leave a bit more time for training
    • Training brainstorm:
      • don't know where to look for the things I want (bibliographic metadata)
        • Data model training, maybe starting with FOLIO apps and how they represent data and tracking that back to LDP, maybe go one functional area at a time 
        • at a subgroup meeting, someone shared an ER-diagram
        • First point: DBeaver Enterprise Edition offers a visual query builder like Access
        • If you are having trouble figuring out connections between tables, might want to check the SchemaSpy relationships diagram
      • I created some training materials for Cornell going over Access vs. DBeaver Enterprise once. This was to help ease their transition because their staff were used to relying on the visual query builder rather than SQL
      • ILS-specific training?
        • Tips for moving from Voyager (Cornell might be able to help with this, UAB?) - Stanford also moving from Symphony
        • Simmons was on Millennium and didn't ever use SQL before
        • Duke is on Aleph, ARC
      • More on SQL
        • Array expansion/CROSS JOIN (ask Nassib)
        • Grouping/aggregation/string aggregation
      • Query development and FOLIO Analytics tasks
        • Reviewing a pull request 
Reporting Vision and Strategy work

Reporting SIG Roadmap

Continue drafting roadmap milestones

  • TRAINING (see above)
    • note to Angela Zoss (Old): make training a top-level Wiki category
    • there may be a FOLIO-wide compilation of training, keep an eye out for that and add to it
  • Wiki section to highlight recordings from meetings where something cool happened, like a demo
    • Cornell shared Tableau dashboards
  • Add playlist of training materials to onboarding for new SIG members
  • Schedule some public presentations, like a FOLIO Forum
  • Best practices for custom tables in the LDP (both small and big datasets)
  • A directory of institutional query repositories
    • Best practices for setting up an institutional query repository; standardization would help us collaborate better, if at all possible
    • maybe our SIG could create a template institutional query repository on GitHub for people to clone
  • Best practices for permissions for LDP 
  • institutions that are farther into implementation, what is their reporting landscape (similar to Cornell showing Tableau and DBeaver→ Box workflow, FLO DBeaver parameters, ReShare custom query portal)
  • Also check Goals for 2022
Updates and Query Demonstrations from Various Reporting Related Groups and EffortsCommunity & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

RA/UM Working Group

MM Working Group

  • Meetings are 1st Tuesday of the month, 12-1pm ET via zoom using the usual FOLIO password. Our lab sessions are open to everyone. Please bring your questions, examples, and comments about reporting and metadata.
  • We are still looking for reviewers. Please contact MM reports working group.
  • We have completed pull requests for all but 1 derived table for metadb.

ERM Working Group

  • ERM Prototype and Query Development Status
    • folio-analytics version 1.4: finish fixes
    • folio-analytics version 1.5: add comments to columns in all derived tables
  • Topics for the future
    • eUsage
    • Open Access
  • Meetings are bi-weekly on tuesdays 11am ET alternating with RM Working Group

RM Working Group

Reporting SIG Documentation Subgroup

  • Honeysuckle documentation is live on https://docs.folio.org/docs/
  • Iris documentation is in progress, due December 15
  • Additional Context
    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

External Statistics Working Group

  • no updates currently
  • new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository
  • New organizational structure for External Statistics reports
    • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas
    • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository
    • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues
    • each reporting development team will take responsibility for the queries in their area for the external statistics clusters

Product Council

For all recent work on FOLIO Reporting SQL development:

Topics for Future MeetingsAll
  • How to deal with External Stats reports?
    • maybe subteam leads check in about that
    • probably wait until after Metadb conversion is more complete
  • ask for presenters: hosting experiences from implementers
  • Annual Reporting Goals
    • (in progress) Support the transition from LDP to Metadb (e.g., update derived table and report queries, update documentation, outreach, new training)
    • (ready to start) Developing training/onboarding for new SIG members/report users (esp. FOLIO-specific data model and transformation stuff)
    • (in progress) Develop a FOLIO Reporting Vision and Strategy
      • secondary goal: come up with language that can be used to explain to our institutions the importance of the work and of devoting resources
    • Improve communication between SIG and developers of apps so we hear about data model changes in advance
    • continued advocacy on part of the SIG to governance groups
    • (ready to start) Review JIRA issues, clean up, revisit strategy for JIRA
  • July 21: RA/UM data model training

Review and update Topics for Future Reporting SIG Meetings 

  • A test Action Item (Ingolf)