2023-05-18 Reporting SIG Meeting notes

Arthur Aguilera

University of Colorado, Boulder

Eliana Lima

Fenway Library Organization

Sharon Beltaine

Cornell University

Eric Luhrs

Lehigh University

Erin Block

University of Colorado, Boulder

Linda Miller

Cornell University

Nancy Bolduc

Cornell University

Nassib Nassar

Index Data

Shannon Burke

Texas A&M

Elena O'Malley

Emerson

Suzette Caneda

Stanford University

Tod Olson

University of Chicago

Dung-Lan Chen

Skidmore College

Jean Pajerek

Cornell University

Lloyd Chittenden

Marmot

Kimberly Pamplin

Texas A&M University 

Tim Dannay

Mount Holyoke College

Scott Perry

University of Chicago

Axel Doerrer

University Mainz

Natalya Pikulik

Cornell University

Shelley Doljack

Stanford University

Bob Scheier

Holy Cross

Stefan Dombek

Leipzig University

Vandana Shah

Cornell University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Linnea Shieh

Stanford University

Lynne Fors

Wellesley College

Kimberly Smith

Middle Tennessee State University

Lisa Furubotten

Texas A&M

Clare Spitzer

Stanford University

Alissa Hafele

Stanford University

Amelia Sutton

U. Massachusetts

Kara Hart

Wellesley College

Simona Tabacaru

Texas A&M

Corrie Hutchinson

Index Data

Huey-Ning Tan

Stanford University

Jamie Jesanis

Wellesley College

Vitus Tang

Stanford University

Jeanette Kalchik

Stanford University

Irina Trapido

Stanford University

Kevin Kishimoto

Stanford University

Catherine Tuohy

Emmanuel College

Ingolf Kuss

hbz

Kevin Walker

The University of Alabama

Alexander Lao

Stanford University

Angela Zoss

Duke University

Joanne Leary

Cornell University

Attendance & Notes

Angela

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• Today's note-takers:  Team Leads for project updates

Announcements /
Reminders

Sharon

Upcoming meeting topics

• Monday, May 22: WOLFcon brainstorm (CFP for WOLFcon)

• Thursday, June 1: Brainstorm outreach activities for the SIG, set up quarterly schedule

• Monday, June 12: Onboarding, Part 2 (tentative)

• Thursday, June 15: TBD

Combining MM and RA/UM subgroups

• Current plan is to meet monthly on 2nd Tuesdays at 1pm Eastern

  • Zoom: https://duke.zoom.us/j/92324148267?pwd=V3lCSGJBSm5mYm4xamVFNFJqOGhzZz09

• Looking for people excited to build new query writing skills; contact @Angela Zoss (Old) for more information

Any new members?

• Welcome/introductions

How to find our latest recordings

• Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

(Always) Recruiting New Query Developers

• The Reporting SIG is always on the look-out for new query developers. Please let us know if you are interested in doing query development or if there are others at your institution who might be a good fit.

Updates from development

Angela

Rolling releases for FOLIO Analytics

• Over the last year or so, we have had formal releases of FOLIO Analytics about every four months, aligned with the FOLIO flower releases

• As we have more institutions relying on LDP1 and Metadb instances, a delay of four months to receive new queries is often too long

• Additionally, having many pull requests waiting to be merged causes potential file conflicts (the same file gets edited differently by different people, and then the different edits have to be resolved manually)

• Nassib has been making changes to have pull requests merge automatically when it has three approvals

• Instead of waiting for a flower release, Nassib will then generate releases on a much smaller scale, very soon after a change or a small group of changes are merged

• Even with these rolling releases, the query development teams will still organize work around FOLIO flower releases

  • We will recruit review board members for each flower release

  • We will schedule a specific release to coincide with the flower release

  • We will summarize all changes merged during a single flower release cycle in a release notes document, likely on a wiki page attached to the repository

• For institutions that are running derived table queries from FOLIO Analytics, they can choose whatever update schedule makes sense to them; they can update frequently, wait for a flower release, selectively pick releases based on desired changes, etc.

Cleaning up JIRA Issues

• The Reporting SIG used JIRA for early report request tracking, but we've left it behind recently

• There are over 200 report requests and another few dozen "cluster" issues we created but don't really maintain

• Now that our development work is so reliant on GitHub and we aren't in much active conversation with the FOLIO community about reports, it's time to clean up the old JIRA issues and transition them to GitHub

• In our development subteams, we'll be going through these issues and making decisions about closing them and whether they will be addressed with any new query development

• Hope to have much of this cleaned up over the summer

Review of In-Progress Projects (Recurring)

• Build a directory of extracted and derived tables

• Build Metadb query cookbook-style documentation

  • has been opened and sent to the development teams for planning/prioritization

  • haven't settled on a style exactly, but have some examples

• Build Training Program for FOLIO Data Model

  • ACQ/ERM drafts have been presented and will be updated

• Port LDP1 derived tables to Metadb

  • possibly done??

• Recruit from new institutions not represented

  • recommend that the development teams reach out to SIGs for an update, invite new members

Review the release notes for FOLIO Analytics, LDP1, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

• LDP1 release notes

• Metadb release notes (via tags)

• LDLite release notes (via tags)

• ldpmarc release notes

• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)

• FOLIO Analytics release notes 

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

RA/UM Working Group

• Meetings have become more of a lab session, working through specific problems

• Contact Angela if you would like to join these meetings; second Tuesdays at 1pm Eastern

• Context

  • Meeting notes: https://docs.google.com/document/d/1UnzG64tl917LOH2FtWhCEPlSOsnJWKL-0eu88Ouo1DU/edit

  • Current status of RA/UM issues: https://github.com/folio-org/folio-analytics/issues?q=is%3Aissue+is%3Aopen+RA%2FUM

  • Status of LDP1 → Metadb querying porting: https://docs.google.com/spreadsheets/d/1efLc6QMJyGuXyQM26pZbti-B6wFhJuZt7s7FJbhdXYo/edit#gid=0

MM Working Group

• We are now holdings joint meetings with RA/UM. Our recurring meeting time has changed to the 2nd Tuesday from 1-2pm ET.
  Zoom URL: https://duke.zoom.us/j/92324148267?pwd=V3lCSGJBSm5mYm4xamVFNFJqOGhzZz09
  Meeting ID: 923 2414 8267
  Passcode: 358968

ERM Working Group

• Current topics

  • Reporting for FOLIO Apps

    • Open Access

    • eUsage

    • eHoldings

• Meetings are bi-weekly on tuesdays 11am ET alternating with ACQ Working Group

  • Next meeting will be at 9th, May

  • Contact @Stefan Dombek if you would like to get a calendar invitation

ACQ Working Group

• group is working with ERM group on ACQ-ERM FOLIO Data Model Training 

• group is working on ACQ-related (Acquisitions) derived tables for the next Folio-Analytics release 

  • see ACQ Derived Tables to Convert from LDP1 to Metadb

• for latest query development updates, see RM Prototype and Query Development Status

• Meetings are biweekly on Tuesdays 11am-noon ET; contact @Sharon Markus if you would like a calendar invitation

• Meeting Recordings are here: FOLIO ERM-RM Report Dev Teams

Reporting SIG Documentation Subgroup

• Morning Glory documentation is live on https://docs.folio.org/docs/

• Nolana documentation is in review

• Orchid documentation will be in progress soon, and plans are underway to include beta-level documentation for Metadb

• Additional Context

  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

External Statistics Working Group

• no updates currently

• new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository

• New organizational structure for External Statistics reports

  • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas

  • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository

  • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues

  • each reporting development team will take responsibility for the queries in their area for the external statistics clusters

D-A-CH Working Group (D-Reporting)

• Discussion on draft statement: "Hosting and Support"

  • The members of D-Reporting need more time to review the document and provide feedback

• Ongoing topics

  • Onboarding training

  • DBS statistics

    • JIRA-Issues, Rpt-Clusters

    • Gap analysis to statistic codes, user counts etc.

    • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO

• Meetings are currently held by appointment

  • Last meeting: 8th, May

  • Next meeting will be at 15th, May (1 pm, CEST)

  • Contact @Stefan Dombek if you would like to get a calendar invitation

Product Council

• (December 8 meeting) PC shared a report of the SIG check-ins

• would love for PC to check-in yearly

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main