2023-11-16 Reporting SIG Meeting notes

Owned by Scott Perry
Last updated: Nov 16, 2023
6 min read

Date

Attendees

 Present?

Name

Organization

Present?

Name

Organization

xArthur AguileraUniversity of Colorado, Boulder
Eliana LimaFenway Library Organization
    x           Sharon BeltaineCornell University
Eric LuhrsLehigh University

Erin BlockUniversity of Colorado, Boulder
Lisa McCollLehigh University

Kathleen Moore
xLinda MillerCornell University

Shannon BurkeTexas A&M
Nassib NassarIndex Data

Suzette CanedaStanford University
Elena O'MalleyEmerson

Dung-Lan ChenSkidmore College
Tod OlsonUniversity of Chicago

Lloyd ChittendenMarmotxJean PajerekCornell University

Tim DannayMount Holyoke College
Kimberly PamplinTexas A&M University 

Axel DoerrerUniversity MainzxScott PerryUniversity of Chicago


Shelley DoljackStanford UniversityxNatalya PikulikCornell University

Stefan DombekLeipzig UniversityxEmily SanfordMichigan State University

Jennifer EustisU. Massachusetts Amherst / Five College
Bob ScheierHoly Cross
xLynne ForsWellesley College
Vandana ShahCornell University

Lisa FurubottenTexas A&M
Linnea ShiehStanford University

Alissa HafeleStanford University
Susie SkowronekOakland University

Kara HartWellesley CollegexKimberly SmithMiddle Tennessee State University
xCorrie HutchinsonIndex Data
Clare SpitzerStanford University

Jamie JesanisWellesley College
Amelia SuttonU. Massachusetts
xJeanette KalchikStanford University
Simona TabacaruTexas A&M

Kevin KishimotoStanford University
Huey-Ning Tan

Stanford University


Ingolf Kusshbz
Vitus TangStanford University

Alexander LaoStanford UniversityxIrina TrapidoStanford University

Joanne LearyCornell University
Catherine TuohyEmmanuel College

Harry KaplanianEbscoxPatrick WaiteU. Mass Amherst
xTim KiserMichigan State University
Joseph MolloySpokane Public Library



xChristie ThomasUniversity of Chicago

Discussion Items

Item

Who

Notes

Attendance & NotesScott

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)
  • Today's note-takers:  Team Leads for project updates


Announcements/Reminders

Scott


Impacts of New Fields and Features

  • Are there any new fields or features we should know about from any of the functional areas that may impact reporting?
    • New
    • From Recent Meetings
      • We will be getting new data fields for the Open Access app - more details coming
      • Timezone format is not consistent across the tables in FOLIO, which impacts LDP and Metadb
        • Nassib confirmed that he does not change timezone settings as part of the ETL with the LDP/Metadb software, so whatever is in FOLIO is what we get in LDP/Metadb
        • RFC-3339 sitting with TC about always representing times as an ISO date format https://github.com/folio-org/rfcs/pull/13
      • Invoices will have a fiscal year assigned. You will be able to process an invoice in a past fiscal year (with Poppy) and in a future fiscal year (after Poppy)
      • There is a proposal to deprecate the donor field in the POL and replace it with an Organization type of donor in Quesnelia.  This will also be linked to inventory in a future release as well.
      • (Jennifer Eustis) from MM: proposal for a new field for item source (New field in the item record: Source ID - Functional analysis)
      • (Stefan Dombek) feature with Orchid: in the module audit, we have logs for orders and order lines and snapshot for create, edit, and delete records (unfortunately not for fiscal year rollover, just create/edit/delete; need to know the date of your FYO and then report based on that) ( UXPROD-3215 - Getting issue details... STATUS )
      • (Jennifer Eustis) request for more helpful info when there are duplicate UUIDs during data import ( MDEXP-625 - Getting issue details... STATUS )


Upcoming meeting topics (tentative)

  • Reporting Development in Preparation for Poppy Release
  • Reporting Experiences from Various Institutions (Stanford December 7)
  • Metadb Updates for January 2024


(Slightly Changed) FOLIO Analytics 1.7 Poppy Development and Review Schedule

  • Oct 27 EOD: Last day to submit new Pull Requests for 1.7 Poppy release of Folio Analytics.
  • Oct 30 - Nov 3: Review Board completes review of all 1.7 code.
  • Nov 6 - Nov 10: Code fixed by report development teams per review board feedback.
  • Nov 10 - EOD:  Feature Freeze. 
  • Nov 13 - Nov 22: Testing.
  • Dec 1: Folio Analytics 1.7 is released.

*December 18 - FOLIO Application Poppy is released


Any new members?

  • Welcome/introductions


How to find our latest recordings


SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to Scott Perry  or Sharon Beltaine with any questions.

  • Representative for the Documentation Working Group
  • Query developers - possibly from Index Data?
  • FOLIO Analytics Review Board 


Reporting App DemonstrationCorrie Hutchinson

Reporting Product Owner Corrie Hutchinson will demonstrate the use and configuration of the Reporting App (replaces the LDP App). The Reporting App is used to query data on your LDP or Metadb reporting database. A new feature has been added for the Poppy release to allow running queries stored on GitHub repositories to be run right from the Reporting App in FOLIO. 

  • allows institutions to create connections to run sql queries on their LDP or Metadb instances and export results right from within the FOLIO application Reporting App
  • you can connect to a variety of repositories; repositories must be public; later feature will allow private repos
  • "run reports" functionality populates with the queries in the repository
  • can set default parameters for queries
  • run the report and export as csv
  • every sql query requires json metadata file - Mike Taylor has written instructions at https://github.com/folio-org/ui-ldp/blob/master/doc/reports.md
  • JSON file describes how the report runs and includes parameters
  • interest in public query repositories available
  • suggest we have future topic of how insitutions manage their report github repositories

Questions

  • Can we write queries in non-sql languages to be run with the Reporting App (e.g., python)?
  • Will there be an Actions menu, as we have in other FOLIO app interfaces?
  • Are there plans to make more github repositories of FOLIO report queries public?
  • Can the Reporting App hook up to LD Lite? 
  • How long will there be support for both LDP and Metadb platforms with the Reporting App?
  • Stay tuned on slack as Corrie researches answers to questions (Thank you, Corrie!)

Feature Requests


FOLIO Product CouncilJennifer Eustis

The PC met last Thursday on 11/9 and the notes can be found at 2023-11-09 Product Council Agenda and Meeting Notes. The PC SIG working group updated the PC on its progress. The template for SIG reports was rolled out in October. Feedback that was received has been incorporated into the template. The next written report is for 11/16 and can be found SIG Reports 2023-11-16. Bulk Edit and List App will have the same working group. Slack channels and the group name have been renamed.

2023-09-14 Product Council Agenda and Meeting Notes

Here's the wiki page for the tri council subgroup: FOLIO Product Council Sub Group on the Re-Architecting's Impact on the Product Council (Tri-Council)

Some additional useful links:
https://folio-org.atlassian.net/wiki/display/PC/2023-11-09+Product+Council+Agenda+and+Meeting+Notes

https://github.com/folio-org/ui-ldp/blob/master/doc/new-folio-release.md

UILDP-132 - Getting issue details... STATUS

UILDP-133 - Getting issue details... STATUS


Recurring Items (Updated weekly, but not always discussed in meeting)

ItemWhoNotes
Review of In-Progress Projects (Recurring)
Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)
Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.


MM/RA/UM Working Group


ERM Working Group

  • Current topic
    • Reporting for the FOLIO App Open Access and Agreements+external KBs
  • Meetings are bi-weekly on tuesdays 11am ET alternating with ACQ Working Group


ACQ Working Group


Reporting SIG Documentation Subgroup

  • Orchid documentation is live on https://docs.folio.org/docs/
  • Poppy documentation is in development
  • Additional Context
    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)


D-A-CH Working Group (D-Reporting)

  • Ongoing topics
    • Onboarding training
    • DBS statistics
      • JIRA-Issues, Rpt-Clusters
      • Gap analysis to statistic codes, user counts etc.
      • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO
  • Meetings
    • Next meeting will be at 20th, Nov
    • Contact Stefan Dombek if you would like to get a calendar invitation


Product Council


For all recent work on FOLIO Reporting SQL development: