2021-03-15 Reporting SIG Meeting notes

Sharon Beltaine

Cornell University

Sara Colglazier

Mount Holyoke College/Five Colleges

Elizabeth Berney

Duke University

Erin Nettifee

Duke University

Joyce Chapman

Duke University

Karen Newbery

Duke University

Jean Pajerek

Cornell University

Tod Olson

University of Chicago

Claudius Herkt-Januschek

SUB Hamburg

Scott Perry

University of Chicago

Doreen Herold

Lehigh University

Stefan Stadtherr

MPIL Heidelberg

Sarah Park

Duke University

Simona Tabacaru

Texas A&M

Clint Bellanger

Auburn University

Kevin Walker

The University of Alabama

Ingolf Kuss

hbz

Christie Thomas

University of Chicago

Joshua Lambert

Missouri State

Andi Bihler

Munich Technical University Library

Joanne Leary

Cornell University

Cheryl Malmborg

University of Chicago

Michael Patrick

The University of Alabama

Vandana Shah

Cornell University

Nassib Nassar

Index Data

Angela Zoss

Duke University

Veit Köppen

University Magdeburg

Lisa DeCarolis

Smith College/Five Colleges

Linda Miller

Cornell University

Elena O'Malley

Emerson

Matt Harrington

Duke University

Holly Mistlebauer

Cornell University

Cathy Tuohy

Emmanuel College (FLO)

Nancy Bolduc

Cornell University

Shirley Moentnish

Missouri State

Eric Pennington

Texas A&M

Stefan Dombek

Leipzig University

Axel Doerrer

University Mainz

Natalya Pikulik

Cornell University

Owen Stephens

K-Int

Eliana Lima

Fenway Library Organization

Marcia Borensztajn

EBSCO

Harry Kaplanian

EBSCO

Molly Driscoll

EBSCO

Amelia Sutton

U. Massachusetts

Heather Loehr

Hanover College

Mary Morgan

Grand Valley State University

Jennifer Eustis

U. Massachusetts Amherst / Five College

Aaron Neslin

Five Colleges

Laura Daniels

Cornell University

Attendance & Notes

Sharon

Attendance & Notes

• Today's attendance-taker: Linda Miller

• Today's note-takers:  Team Leads for project updates

Test Data Updates (Reminder)

All

FOLIO Reporting developers and Reporting SIG members are encouraged to use this new page to share test data cases they have entered into FOLIO reference environments to keep us all aware of what data to expect when we test our queries.

• Test Data Updates to FOLIO Snapshot Environments

Report Ranking (Reminder)

Sharon

New Report Clusters are added on a regular basis, so it is important to make sure your institution is reviewing these clusters and ranking them to establish report development priorities. If you rank reports for your institution, please follow the instructions below. If someone else ranks, please pass this information along to that person so your institution's vote can be included.

• Action =>> Please review Reporting SIG-All Report Clusters (55 issues) in JIRA and RANK each report cluster for your institution (R1-R5)

• For reporting, institutions only need to rank the UXPROD Report Cluster JIRA issues. All reporting requirements, which are captured in REP-XXX issues, roll up to the UXPROD Report Clusters. Report clusters cover one or more report (REP-XXX issue) requirements.

Excel Views Follow-up

Nassib, Stefan

Excel Views: follow-up from Nassib on presentation by Stefan last week on Excel views

• generally, using Excel as a database tool with LDP is fine with the LDP

• LDP guide explains that using views with LDP is not recommended, however

• LDP is not a data warehouse, it provides software that you can deploy on your own to run a data warehouse

• Views run the query again, and can present performance issues in layered reporting queries with large tables

• Materialized views store the query result

• Views introduce dependencies that can block database schema changes

• With Metadb (the next version of LDP), schema changes can potentially be made at any time

• Derived tables are similar to materialized views

Other approaches to automating report distribution:

• creating local derived tables that you update automatically on your LDP may be a better way to provide a group of users with a specific report dataset

• your institution can create its own local schema(s) in addition to the "local" schema

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

Reporting SIG Documentation Subgroup

FOLIO Reporting development

• Daily Snapshots will only be kept for 2 weeks

  • Starting to keep folio snapshots for  2 weeks now; contact Nassib if you want specific dates saved off

  • Be sure to ask Nassib to save off a snapshot (in advance, before data are entered) of a particular dataset you entered on a particular day; he will probably use a naming convention such as “_save” for these custom snapshots

  • Sharon asked Nassib to save the datasets documented on the Test Data Updates to FOLIO Snapshot Environments page in the Reporting SIG wiki

• Track progress via recent pull requests, featuring contributions by members of the reporting community:
  https://github.com/folio-org/folio-analytics/pulls?q=is%3Apr+base%3Amain

RA/UM Working Group

• No meeting, just working on ongoing query tasks

• Meeting notes: https://docs.google.com/document/d/1UnzG64tl917LOH2FtWhCEPlSOsnJWKL-0eu88Ouo1DU/edit

• Current status of RA/UM issues: https://github.com/folio-org/folio-analytics/issues?q=is%3Aissue+is%3Aopen+RA%2FUM

MM Working Group

• No news to report this week.

• Working group uses this spreadsheet to track JIRA issues, priority, and reports needed.

ERM Working Group

• ERM Prototype and Query Development Status

• Finished work on derived tables invoice_transactions and  purchase_order_transactions

• Working on ERM Agreements Cost & ERM Agreements Count

• Need to use transactions amounts for ERM inventory cost query → GitHub issue

RM Working Group

• report development planned for FOLIO-Analytics Release 1.1

  • ACRL expenditures, title count, volume count, e-resources count

  • subscriptions query

  • fund query

  • claims query

• for latest updates, see RM Prototype and Query Development Status

External Statistics Working Group

• ACRL query set to be targeted for FOLIO-Analytics 1.1 release

• new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository

• New organizational structure for External Statistics reports

  • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas

  • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository

  • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues

  • each reporting development team will take responsibility for the queries in their area for the external statistics clusters

Topics for Future Meetings

All

Next meeting: Would one or two members be able to share their institution's Reporting Rollout Plan?

Review and update Topics for Future Reporting SIG Meetings