2023-01-09 Reporting SIG Meeting notes

Arthur Aguilera

University of Colorado, Boulder

Eric Luhrs

Lehigh University

Sharon Beltaine

Cornell University

Linda Miller

Cornell University

Erin Block

University of Colorado, Boulder

Nassib Nassar

Index Data

Nancy Bolduc

Cornell University

Elena O'Malley

Emerson

Shannon Burke

Texas A&M

Tod Olson

University of Chicago

Suzette Caneda

Stanford University

Jean Pajerek

Cornell University

Lloyd Chittenden

Marmot

Michael Patrick

The University of Alabama

Tim Dannay

Mount Holyoke College

Eric Pennington

Texas A&M

Axel Doerrer

University Mainz

Scott Perry

University of Chicago

Shelley Doljack

Stanford University

Natalya Pikulik

Cornell University

Stefan Dombek

Leipzig University

Bob Scheier

Holy Cross

Jennifer Eustis

U. Massachusetts Amherst / Five College

Vandana Shah

Cornell University

Lynne Fors

Wellesley College

Linnea Shieh

Stanford University

Lisa Furubotten

Texas A&M

Clare Spitzer

Stanford University

Alissa Hafele

Stanford University

Amelia Sutton

U. Massachusetts

Kara Hart

Wellesley College

Simona Tabacaru

Texas A&M

Jamie Jesanis

Wellesley College

Huey-Ning Tan

Stanford University

Jeanette Kalchik

Stanford University

Vitus Tang

Stanford University

Kevin Kishimoto

Stanford University

Irina Trapido

Stanford University

Ingolf Kuss

hbz

Catherine Tuohy

Emmanuel College

Alexander Lao

Stanford University

Kevin Walker

The University of Alabama

Joanne Leary

Cornell University

Angela Zoss

Duke University

Eliana Lima

Fenway Library Organization

Attendance & Notes

Angela

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• Today's note-takers:  Team Leads for project updates

Announcements /
Reminders

Angela

Welcome (back) to Sharon!

• Happy to announce that Sharon Beltaine is now serving as co-convener (again!). Thanks so much, Sharon!

• Will rotate every two meetings

Watch for SIG member survey

• FOLIO SIG conveners have prepared a survey to check in with SIG members

• Reporting SIG will be sending this out soon

• Please complete! Shouldn't take long, and the feedback (anonymous) will help us know how to better structure meetings and activities

Any new members?

• Welcome/introductions

• Would anyone like a buddy? Like to be a buddy?

How to find our latest recordings

• Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

(Always) Recruiting New Query Developers

• The Reporting SIG is always on the look-out for new query developers. Please let us know if you are interested in doing query development or if there are others at your institution who might be a good fit.

Review of 2022 goals, planning 2023 goals

All

• Goals for 2022

• Reminders about in-progress projects, mission/statement of scope, and roadmap

• Proposed Goals for 2023

Update on derived table documentation

@Axel Dörrer @Stefan Dombek 

• Meeting notes

• A few options: full automation, semi automated, manually

• For charts/diagrams, probably have to use semi automated

• Full automation would require very exacting requirements for how derived tables are structured

• Semi automated would be more realistic; Stefan would write a script to pull things out of the postgres and thenadd some information

• For diagrams, can extract the tables involved and the foreign keys that connect them, then humans would create the diagrams

• Questions for the SIG:

  • what additional columns would be useful?

    • the info from postgres is not everything you need; sometimes you need if this is an aggregated column/value

• Note: will send around homework and check back in on this at the next Monday meeting (Jan 23)

Review of In-Progress Projects (Recurring)

• Build a directory of extracted and derived tables

• Build Training Program for FOLIO Data Model

• Investigate LDP1 Hosting Support

• Port LDP1 derived tables to Metadb

• Recruit from new institutions not represented

Review the release notes for FOLIO Analytics, LDP1, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

• LDP1 release notes

• Metadb release notes (via tags)

• LDLite release notes (via tags)

• ldpmarc release notes

• LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)

• FOLIO Analytics release notes 

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

RA/UM Working Group

• Meetings have become more of a lab session, working through specific problems

• Contact Angela if you would like to join these meetings; second Tuesdays at 1pm Eastern

• Context

  • Meeting notes: https://docs.google.com/document/d/1UnzG64tl917LOH2FtWhCEPlSOsnJWKL-0eu88Ouo1DU/edit

  • Current status of RA/UM issues: https://github.com/folio-org/folio-analytics/issues?q=is%3Aissue+is%3Aopen+RA%2FUM

  • Status of LDP1 → Metadb querying porting: https://docs.google.com/spreadsheets/d/1efLc6QMJyGuXyQM26pZbti-B6wFhJuZt7s7FJbhdXYo/edit#gid=0

• Recording of porting a table from LDP1 to Metadb: https://drive.google.com/drive/u/0/folders/1FrhrIM8-MeF0BPbI3kuD5ofoAqwGu1P1

MM Working Group

• Meetings are 1st Tuesday of the month, 12-1pm ET via zoom using the usual FOLIO password. Our lab sessions are open to everyone. Please bring your questions, examples, and comments about reporting and metadata. MM notes

• We will be fixing the LDP1 derived table instance_ext.sql which has a duplicate field (record_source and instance_source). The column record_source will be removed and comments will be added to the derived table.

• If you are able to test ldpmarc 1.6 new release, please do so.

ERM Working Group

• FOLIO Data Model Training (in progress)

• ERM Query Development Status

• Open Access

  • Report requests are being collected in the OA SIG Link (in progress)

  • The test environment from the SIG Reporting will get the app OA (in progress)

  • Test data will imported

  • Recent FOLIO Forum on Open Access App

• Meetings are bi-weekly on tuesdays 11am ET alternating with RM Working Group

  • Next meeting will be at 17th, Jan

  • Contact @Stefan Dombek if you would like to get a calendar invitation

RM Working Group

• group is working with ERM group on RM-ERM FOLIO Data Model Training 

• group will start working on RM-related derived tables for Orchid 1.6 release 

  • see RM Derived Tables to Convert from LDP1 to Metadb

• for latest query development updates, see RM Prototype and Query Development Status

• Meetings are biweekly on Tuesdays 11am-noon ET; contact @Sharon Markus if you would like a calendar invitation

• Meeting Recordings are here: FOLIO ERM-RM Report Dev Teams

Reporting SIG Documentation Subgroup

• Morning Glory documentation is live on https://docs.folio.org/docs/

• Nolana documentation is in review

• Orchid documentation will be in progress soon, and plans are underway to include beta-level documentation for Metadb

• Additional Context

  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

External Statistics Working Group

• no updates currently

• new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository

• New organizational structure for External Statistics reports

  • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas

  • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository

  • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues

  • each reporting development team will take responsibility for the queries in their area for the external statistics clusters

Product Council

• (December 8 meeting) PC shared a report of the SIG check-ins

• would love for PC to check-in yearly

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main

Topics for Future Meetings

All

• Exploring new recruitment/onboarding strategies (e.g., buddy system)

• More work on asynchronous collaboration, how to engage in discussions and question answering more broadly

  • consider connecting discuss.folio.org with a Slack channel, to make sure any forum topics get highlighted on Slack as well?

• Open question: should we update FOLIO LDP1-based Reporting First Implementers Grid

• Cleaning up our wiki pages

• January 19: tips on querying date fields from Sharon and Joanne

• talk about preparation for Metadb: do institutions have questions? is there anything we should be working on to try to support them?

Review and update Topics for Future Reporting SIG Meetings