2023-10-23 Reporting SIG Meeting notes

Owned by Sharon Markus
Last updated: Oct 23, 2023 by lm15@cornell.edu

Date

Attendees

 Present?

Name

Organization

Present?

Name

Organization


Arthur AguileraUniversity of Colorado, Boulder
Eliana LimaFenway Library Organization
      x                  Sharon BeltaineCornell University
Eric LuhrsLehigh University

Erin BlockUniversity of Colorado, BoulderxLisa McCollLehigh University

Kathleen Moore
xLinda MillerCornell University

Shannon BurkeTexas A&M
Nassib NassarIndex Data

Suzette CanedaStanford UniversityxElena O'MalleyEmerson
xDung-Lan ChenSkidmore College
Tod OlsonUniversity of Chicago

Lloyd ChittendenMarmotxJean PajerekCornell University

Tim DannayMount Holyoke College
Kimberly PamplinTexas A&M University 

Axel DoerrerUniversity MainzxScott PerryUniversity of Chicago


Shelley DoljackStanford UniversityxNatalya PikulikCornell University
xStefan DombekLeipzig University
Emily SanfordMichigan State University

Jennifer EustisU. Massachusetts Amherst / Five CollegexBob ScheierHoly Cross

Lynne ForsWellesley CollegexVandana ShahCornell University

Lisa FurubottenTexas A&M
Linnea ShiehStanford University

Alissa HafeleStanford University
Susie SkowronekOakland University

Kara HartWellesley CollegexKimberly SmithMiddle Tennessee State University
xCorrie HutchinsonIndex Data
Clare SpitzerStanford University

Jamie JesanisWellesley College
Amelia SuttonU. Massachusetts

Jeanette KalchikStanford University
Simona TabacaruTexas A&M

Kevin KishimotoStanford University
Huey-Ning Tan

Stanford University


Ingolf Kusshbz
Vitus TangStanford University

Alexander LaoStanford University
Irina TrapidoStanford University

Joanne LearyCornell University
Catherine TuohyEmmanuel College

Harry KaplanianEbsco
Joseph MolloySpokane Public Library






Discussion Items

Item

Who

Notes

Attendance & NotesScott

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)
  • Today's note-takers:  Team Leads for project updates


Announcements/Reminders

Scott


Impacts of New Fields and Features

  • Are there any new fields or features we should know about from any of the functional areas that may impact reporting?
    • New
      • We will be getting new data fields for the Open Access app - more details coming
      • Timezone is removed from some of the tables in FOLIO, which impacts LDP and Metadb
        • Nassib confirmed that he does not change timezone settings as part of the ETL with the LDP/Metadb software, so whatever is in FOLIO is what we get in LDP/Metadb
      • RFC-3339 sitting with TC about always representing times as an ISO date format https://github.com/folio-org/rfcs/pull/13
    • From Recent Meetings
      • There is a proposal to deprecate the donor field in the POL and replace it with an Organization type of donor in Quesnelia.  This will also be linked to inventory in a future release as well.
      • (Jennifer Eustis) from MM: proposal for a new field for item source (New field in the item record: Source ID - Functional analysis)
      • (Stefan Dombek) feature with Orchid: in the module audit, we have logs for orders and order lines and snapshot for create, edit, and delete records (unfortunately not for fiscal year rollover, just create/edit/delete; need to know the date of your FYO and then report based on that) ( UXPROD-3215 - Getting issue details... STATUS )
      • (Jennifer Eustis) request for more helpful info when there are duplicate UUIDs during data import ( MDEXP-625 - Getting issue details... STATUS )


Upcoming meeting topics (tentative)

  • Reporting Development in Preparation for Poppy Release
  • Reporting Experiences from Various Institutions


FOLIO Analytics 1.7 Poppy Development and Review Schedule

  • Oct 27 - Feature Freeze date; last day to make a PR for 1.7
  • Oct 30 - Nov 3 Review Board completes review of all 1.7 code
  • Nov 6 - Nov 10 - All code fixed and finalized by report development teams
  • Nov 13 - Nov 24 - Nassib reviews and merges code
  • Nov 27 - Folio Analytics 1.7 is released

*Nov 20 - FOLIO Application Poppy is released


Any new members?

  • Welcome/introductions


How to find our latest recordings


SIG Recruitment

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to Scott Perry  or Sharon Markus with any questions.

  • Representative for the Documentation Working Group
  • Query developers - possibly from Index Data?
  • FOLIO Analytics Review Board (immediate need!)


German FOLIO daysStefan Dombek

Report on German FOLIO Days

  • There were 3 sessions for reporting
    • Hands-On Lab, where participants got a practical introduction to FOLIO reporting with Metadb.
      • Content:
        • Small introduction to the LDP ecosystem (What does it all involve?)
        • 3 report questions were prepared and these were worked on live together with the participants. This means that queries were created live together. We used a prepared SQLite database, that contains the tables from Metadb. This meant that participants were able to participate barrier-free (No extra account in the testbed and firewall registration etc.). Instructions were created to prepare for this https://git.sc.uni-leipzig.de/dk677weba/hands_on_lab_metadb
        • Demonstration of how Metadb can be used in third-party software → Crystal Reports.
        • Demonstration of the repository folio-analytics
        • Informations about the Reporting SIG and their working groups
      • Feedback: There was positive feedback because the reporting was shown in practice and questions were answered straight away. There were people who had never come into contact with reporting in FOLIO and were amazed at how easy it was to query data with Metadb.
    • Presentation from Nassib: "Metadb: an open-source data platform for analytics" (virtual attending)
    • Internal meeting of the working group D-Reporting
      • Content:
        • Requirements on statistic fields in FOLIO for DBS
        • Data anonymization (GDPR) and how we can create statistics after that
Reporting CookbooksStefan Dombek

There was a wish in the community to have cookbooks for reporting in addition to the queries. These cookbooks are intended to provide a good introduction to reporting, similar to data model training. There has been a wiki in folio-analytics for some time. There are now cookbooks in this wiki. Cookbooks are good for providing code snippets in addition to explanations.

Working status: https://github.com/folio-org/folio-analytics/wiki

  • D-Reporting will have (in process) a cookbook for the DBS (German library statistics) where all reports are explained and a suggestion on how to create the reports.
  • ERM working group has a very completed cookbook, but it has to be finalized
  • Finances contains informations on how you can querying the finance data
  • ACQ working group thinking about which information can be written down
  • Cookbook MARC queries contains the content that was there before the other cookbooks were created
Development Focus: Getting ready for the Poppy ReleaseScott Perry
Sharon Beltaine

Review Board had its first meeting last week



Recurring Items (Updated weekly, but not always discussed in meeting)

ItemWhoNotes
Review of In-Progress Projects (Recurring)
Review the release notes for FOLIO Analytics, LDP1, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)
Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.


MM/RA/UM Working Group


ERM Working Group

  • Current topic
    • Reporting for the FOLIO App Open Access
  • Meetings are bi-weekly on tuesdays 11am ET alternating with ACQ Working Group


ACQ Working Group


Reporting SIG Documentation Subgroup

  • Orchid documentation is live on https://docs.folio.org/docs/
  • Poppy documentation is in development
  • Additional Context
    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)


External Statistics Working Group

  • no updates currently
  • new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository
  • New organizational structure for External Statistics reports
    • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas
    • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository
    • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues
    • each reporting development team will take responsibility for the queries in their area for the external statistics clusters


D-A-CH Working Group (D-Reporting)

  • Ongoing topics
    • Onboarding training
    • DBS statistics
      • JIRA-Issues, Rpt-Clusters
      • Gap analysis to statistic codes, user counts etc.
      • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO
  • Meetings
    • Next meeting will be at 6th, Nov
    • Contact Stefan Dombek if you would like to get a calendar invitation


Product Council


For all recent work on FOLIO Reporting SQL development: