2022-12-01 Reporting SIG Meeting notes

Arthur Aguilera

University of Colorado, Boulder

Eliana Lima

Fenway Library Organization

Sharon Beltaine

Cornell University

Eric Luhrs

Lehigh University

Erin Block

University of Colorado, Boulder

Linda Miller

Cornell University

Nancy Bolduc

Cornell University

Nassib Nassar

Index Data

Shannon Burke

Texas A&M

Elena O'Malley

Emerson

Suzette Caneda

Stanford University

Tod Olson

University of Chicago

Lloyd Chittenden

Marmot

Jean Pajerek

Cornell University

Tim Dannay

Mount Holyoke College

Michael Patrick

The University of Alabama

Axel Doerrer

University Mainz

Eric Pennington

Texas A&M

Shelley Doljack

Stanford University

Scott Perry

University of Chicago

Stefan Dombek

Leipzig University

Natalya Pikulik

Cornell University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Vandana Shah

Cornell University

Lynne Fors

Wellesley College

Linnea Shieh

Stanford University

Bob Scheier

Holy Cross

Lisa Furubotten

Texas A&M

Clare Spitzer

Stanford University

Alissa Hafele

Stanford University

Amelia Sutton

U. Massachusetts

Kara Hart

Wellesley College

Simona Tabacaru

Texas A&M

Jamie Jesanis

Wellesley College

Huey-Ning Tan

Stanford University

Jeanette Kalchik

Stanford University

Vitus Tang

Stanford University

Kevin Kishimoto

Stanford University

Irina Trapido

Stanford University

Ingolf Kuss

hbz

Catherine Tuohy

Emmanuel College

Alexander Lao

Stanford University

Kevin Walker

The University of Alabama

Joanne Leary

Cornell University

Angela Zoss

Duke University

Attendance & Notes

Angela

Attendance & Notes

• Today's attendance-taker: Linda (or substitute)

• Today's note-takers:  Team Leads for project updates

Announcements /
Reminders

Angela

Schedule for December

• cancelled December 26 SIG meeting, maybe December 21 development team meeting

Any new members?

• Welcome/introductions

• Would anyone like a buddy? Like to be a buddy?

How to find our latest recordings

• Recording details available on our Reporting SIG Meetings and Notes page and Reporting SIG Subteam Meetings page

(Always) Recruiting New Query Developers

• The Reporting SIG is always on the look-out for new query developers. Please let us know if you are interested in doing query development or if there are others at your institution who might be a good fit.

Review of In-Progress Projects

• Build a directory of extracted and derived tables

  • First meeting at 29th Nov. (Axel, Stefan): We will discuss the approach and check how much work we have to do and how many helpers we need. We will show the result at the SIG Reporting meeting.

• Build Training Program for FOLIO Data Model

  • RM/ERM: In progress. Next meeting at 30th Nov. Link

• Investigate LDP Hosting Support

  • Ingolf and Angela hoping to make progress this week

• Port LDP derived tables to Metadb

  • Hoping to finish for the Orchid release

• Recruit from new institutions not represented

  • Have some possibly contacts to follow up on

  • Angela thinking about reaching out to community council to talk about recruitment

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

RA/UM Working Group

• Meetings have become more of a lab session, working through specific problems

• Contact Angela if you would like to join these meetings; second Wednesdays at 1pm Eastern

• Context

  • Meeting notes: https://docs.google.com/document/d/1UnzG64tl917LOH2FtWhCEPlSOsnJWKL-0eu88Ouo1DU/edit

  • Current status of RA/UM issues: https://github.com/folio-org/folio-analytics/issues?q=is%3Aissue+is%3Aopen+RA%2FUM

  • Status of LDP → Metadb querying porting: https://docs.google.com/spreadsheets/d/1efLc6QMJyGuXyQM26pZbti-B6wFhJuZt7s7FJbhdXYo/edit#gid=0

• Recording of porting a table from LDP to Metadb: https://drive.google.com/drive/u/0/folders/1FrhrIM8-MeF0BPbI3kuD5ofoAqwGu1P1

MM Working Group

• Meetings are 1st Tuesday of the month, 12-1pm ET via zoom using the usual FOLIO password. Our lab sessions are open to everyone. Please bring your questions, examples, and comments about reporting and metadata. MM notes

• We reviewed the consistency of our LDP and metaDB derived tables which is looking good.

ERM Working Group

• FOLIO Data Model Training (in progress)

• ERM Query Development Status

• Open Access

  • Report requests are being collected in the OA SIG Link (in progress)

  • The test environment from the SIG Reporting will get the app OA (in progress)

  • Test data will imported

  • Recent FOLIO Forum on Open Access App

• Meetings are bi-weekly on tuesdays 11am ET alternating with RM Working Group

  • Next meeting will be at 6th, Dec

  • Contact @Stefan Dombek if you would like to get a calendar invitation

RM Working Group

• group is working with ERM group on RM-ERM FOLIO Data Model Training 

• group worked on RM-related derived tables for Metadb and adding comments to columns for folio-analytics Nolana 1.5 release

• group will start working on RM-related derived tables for Orchid 1.6 release 

  • see RM Derived Tables to Convert from LDP to Metadb

• for latest query development updates, see RM Prototype and Query Development Status

• Meetings are biweekly on Tuesdays 11am-noon ET; contact @Sharon Markus if you would like a calendar invitation

• Meeting Recordings are here: FOLIO ERM-RM Report Dev Teams

Reporting SIG Documentation Subgroup

• Morning Glory documentation is live on https://docs.folio.org/docs/

• Nolana documentation is in review

• Orchid documentation will be in progress soon, and plans are underway to include beta-level documentation for Metadb

• Additional Context

  • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

External Statistics Working Group

• no updates currently

• new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository

• New organizational structure for External Statistics reports

  • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas

  • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository

  • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues

  • each reporting development team will take responsibility for the queries in their area for the external statistics clusters

Product Council

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main

Discussion time

• How to get FOLIO data without an LDP

  • If you're okay using APIs might want to try LDLite

• Why don't all institutions get LDP?

  • EBSCO has internal analytics platform called Panorama, but it's not quite everything people need

  • Cornell has been through a learning curve with EBSCO on LDP, and things are getting better (more frequent updates, better performance)

  • have to negotiate it with them, but if they are willing to host, they should be able to now

  • it's really important that they stay on the recommended platform when they implement (LDP1 → AWS/Postgres)

  • Index Data develops the software and has offered support for other hosting providers, but that's easier if it's being hosted on the recommended platforms

• Upcoming training

  • Cornell going to share some of their local training

  • Duke may be able to share some local recordings as well

• Tableau dashboards at Cornell (built on LDP) are going over really well

  • they also run queries on a schedule, output Excel files, save to Box, restrict access using Box permissions

• DBeaver vs. PGAdmin

  • Enterprise edition has some extra features like visual query builder and scheduler

Topics for Future Meetings

All

• How to deal with External Stats reports?

  • maybe subteam leads check in about that

  • probably wait until after Metadb conversion is more complete

• Exploring new recruitment/onboarding strategies (e.g., buddy system)

• More work on asynchronous collaboration, how to engage in discussions and question answering more broadly

  • consider connecting discuss.folio.org with a Slack channel, to make sure any forum topics get highlighted on Slack as well?

• Open question: should we update FOLIO LDP1-based Reporting First Implementers Grid

• Cleaning up our wiki pages

• Monday, Dec 12: update on documentation of derived tables

• Thursday, Dec 15: tips on querying date fields from Sharon and Joanne

Review and update Topics for Future Reporting SIG Meetings