Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date

...

Michigan State UniversityhbzCornell UniversityMike Gorrell

Present?

Name

Organization

Present?

Name

Organization

xArthur AguileraUniversity of Colorado, Boulder
Eliana LimaFenway Library Organization
xSharon BeltaineCornell University
Eric LuhrsLehigh University

Erin BlockUniversity of Colorado, Boulder
Lisa McCollLehigh University

Kathleen Moore
xLinda MillerCornell University

Shannon BurkeTexas A&M
Nassib NassarIndex Data

Suzette CanedaStanford UniversityxElena O'MalleyEmerson

Dung-Lan ChenSkidmore College
Tod OlsonUniversity of Chicago

Lloyd ChittendenMarmotxJean PajerekCornell University

Tim DannayMount Holyoke College
Kimberly PamplinTexas A&M University 

Axel DoerrerUniversity MainzxScott PerryUniversity of Chicago


Shelley DoljackStanford UniversityxNatalya PikulikCornell University
xStefan DombekLeipzig University
Emily SanfordMichigan State University
xJennifer EustisU. Massachusetts Amherst / Five CollegexBob ScheierHoly Cross

Lynne ForsWellesley College
Vandana ShahCornell University

Lisa FurubottenTexas A&M
Linnea ShiehStanford University

Alissa HafeleStanford University
Susie SkowronekOakland UniversityKara HartWellesley CollegeUniversity
xCorrie HutchinsonIndex DataxKen SmithValdosta State University

Jamie JesanisMCPHSxKimberly SmithMiddle Tennessee State University

Corrie HutchinsonIndex DataJeanette KalchikStanford University
Clare SpitzerStanford University

Jamie JesanisHarry KaplanianMCPHSEBSCO
Amelia SuttonU. Massachusetts

Jeanette KalchikStanford Tim KiserMichigan State University
Simona TabacaruTexas A&M
xHarry KaplanianEbscoKevin KishimotoStanford University
Huey-Ning Tan

Stanford University

Tim Kiser

Ingolf KussHBZ
Vitus TangStanford University

Kevin KishimotoAlexander LaoStanford University
Christie ThomasUniversity of ChicagoIngolf Kuss
xJoanne LearyCornell University
Irina TrapidoStanford University

Alexander LaoStanford UniversityMike GorrellIndex Data
Catherine TuohyEmmanuel CollegeJoanne Leary



xPatrick WaiteU. Mass Amherst




Index DataJoseph MolloySpokane Public LibraryJenn ColtCornell UniversityAugusto ConsingKlaus Hoverath, presenterTriangle SolutionsAnn CrowleyCornell University

Discussion Items

BibControl – Business Intelligence for libraries

This will be a presentation on the BibControl reporting application by Klaus Hoverrath

  • The BibControl system integrate, convert, filter, and standardise raw data from FOLIO  for ETL into your data warehouse
  • automatic, event-driven import and mapping of all data
  • OLAP allows modularizing areas of reporting, e.g., invoices
  • automatic, event driven creation and distribution of reports and analysis
  • Business Intelligence features include MIS, enterprise reporting, OLAP, data mining, and has an application builder
  • "Online cockpit" is a web portal where you can publish all your reports and statistics
  • "Report Viewer" is a standalone report viewer
  • Email dispatch for reports
  • Is this product open source software? NO, Bibcontrol is the vendor
  • What institutions are using BibControl with FOLIO data? GBV, HBZ
  • Bibcontrol has been using/testing LDP since 2020 and Metadb since 2022
  • ETL for MARC data is supported
  • Association with OCLC
  • Data structure is in a star schema
  • Need to create OLAP cubes for your data in various functional areas, e.g., inventory
  • You can download data via Excel or PDF
  • Dashboards can be created with graphs, charts, and interactive data points
  • Data Viewer shows the data fields, columns, tables
  • Windows platform needed to build reports, but web portal accessible on other platforms, e.g. Mac

LDP/Metadb Project Updates

Bring questions and feedback about the new LDP/Metadb support structure for Mike Gorrell and Corrie Hutchinson

  • Metadb Users Group meetings to be cancelled
  • The needs for support from those meetings to be addressed in other ways as we transition to a new support structure for LDP/Metadb

Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:

  • Location and Dates: Senate House, University of London, September 24-26, 2024
  • Call for Proposals Now Open: Got ideas about open-source to share? Talk about it at WOLFcon. Submit a presentation, panel, short talk, or pre-conference workshop. The deadline for submissions has been extended to April 30, 2024. Submit a session here.
  • Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.
  • Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.

Reporting SIG Planning for WOLFCon 2024:

  • Several sessions proposed for the WOLFCon 2024 conference! 
  • See ideas we have submitted so far at  WolfCon 2024 Planning

Item

Who

Notes

Attendance & NotesScottSharon

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)
  • Today's note-takers:  Team Leads for project updates


Announcements/Reminders

Scott

Ongoing Topics

"Workshopping your queries" -

Sharon

Announcements:


  • Wolfcon 2024 coming up in September
    • Here is a summary of information about WOLFCon 2024 from Jesse Koennecke:
      • Location and Dates: Senate House, University of London, September 24-26, 2024
      • Early Bird Registration Now Open: Join us at Senate House, University of London. September 24-26, 2024. Register now through July 31, 2024 for an early bird discounted rate.
      • Learn more about WOLFcon 2024: Want to learn more about the Open Library Foundation and WOLFcon? Be sure to visit our website where you can learn more about the foundation, members projects, communities, and the annual conference.


  • Metadb User Group meetings
    • The Metadb Users Group meetings have ended and the topics will now merged into Reporting SIG meetings


Ongoing Topics:

  • Workshopping your queries
    • part of each Reporting SIG meeting will be devoted to time to work through any query questions you may have
    • please reach out to Christie Thomas if you have a question you would like to "workshop" during an upcoming Reporting SIG meeting


  • Impacts of New Fields and Features (Sharon)

Summary of Metadb Development Meetings (Corrie and others)

  • Issue 826 & 827 (in GitHub) were discussed and volunteers solicited.
  • Nassib encouraged using functions.  Necessary for reports that will be run using the 'Run reports' functionality in the Reporting app.
    • Questions : why use functions instead of a saved query?  Do they impact performance? 
  • Nassib raised the issue of future plans for derived tables, but no roadmap was given or discussed.
    • Questions: what are the plans for derived tables in Metadb?  Advice on how to port needs from LDP to Metadb (when derived tables were employed in LDP reports)?
  • Action steps : 
    • Corrie to take questions to Nassib 
    • Possibly having Nassib come to train on using functions?


Upcoming
  • Upcoming Reporting SIG meeting topics (tentative)
  • Reporting SIG and Reporting Development meeting structure
    • focus on derived table development, support, maintenance
    • LDP to Metadb Training Part 2 (June 24)
    • Writing reports for the Reporting App (July 8)


  • Any new members?
    • Welcome/introductions



SIG Recruitment:

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Reach out to Scott Perry  or Sharon Markus with any questions.

  • Representative for the Documentation Working Group 
  • Query developers


Klaus HoverrathMike, CorrieWOLFCon 2024Sharon, Scott

Workshopping Queries 

Christie

*This is a standing Reporting SIG meeting topic. We don't expect to have time for this topic during the 5/13/24 meeting, so we'll pick it up again at future meetings

Bring your questions on queries written for the LDP or Metadb so we can "workshop" them!

Q: How can a user on the fly add ordinality to a derived table where it is not present? Example is the folio_derived.holdings_ext table which does not include ordinality. No solution was presented in the session. It was suggested that ordinality could be added to the derived holdings_ext and item_ext tables. New Proposal for Reporting SIG Meeting Topics, Schedule, and Structure


Scott, Sharon

We have a new proposal for the structure, topics, and schedule for Reporting SIG meetings starting July 2024. We would like to discuss this with you and see what you think! Here is the general idea:

  • Reporting SIG meetings return a weekly schedule, still held at 11am ET on Mondays
  • meeting topics alternate between "business" and "development" each week
  • "business" means topics like presentations on reporting functionality and new features, new reporting applications, surveys and studies on reporting, etc.
  • "development" means working on derived tables and report queries for the folio-analytics GitHub repository
  • "workshopping" queries could be scheduled during any of these meetings, and it would be great to have topics and/or questions in advance so we can prepare to walk through the answers/approaches, such as "how to I fix this inventory query to get rid of the duplicates?" or "what is the best way to calculate totals in this finance query?" 


-meetings devoted to workshopping are good

-sounds like a plan

-will add to slack messages to ask about this

-add labels to alternatings meeting, e.g. "Reporting SIG - Business," "Reporting SIG - Development" 



Metadb Software Development, Upgrades, and Testing


Corrie

Our Product Owner Corrie Hutchinson would like to cover some important topics with regard to Metadb software development, testing, and upgrades.

  • Testing Metadb upgrades
  • Bugfest testing workflows and processes

-ID still working on leadership transition

-metadb release cycle and testing procedures in discussion

-metadb testing needs to be done outside BugFest

-how would testing be different from testing done by individual institutions? 

-need to test metadb alone and as part of a flower release

-how do we make sure we don't break something with each new release? how can this be done in a more automated/discoverable way?

-how do we give feedback to the FOLIO community that things need to be changed upstream?

-FOLIO Snapshot is beyond what most FOLIO dbs are... it may not be the best testing environment

-Should we continue to try to point metadb to a BugFest environment?

-Reporting App needs to be tested as well

-Is bugfest stable for long enough that the initial metadb load has time to complete?

-I feel like metadb is more reactionary than other folio dev. so, when considering flower releases, maybe it would make sense to test metadb against bugfest immediately AFTER flower release. then the new folio data fields can be tested, but most institutions won't jump to new flower release right away

-might be better for Devops SIG to test Metadb and Reporting SIG to focus on derived table testing

-should we plan to align metadb releases with Flower releases or rolling releases

-should we plan sprint reviews in the Reporting SIG?


Discussion on workflows for the folio-analytics GitHub report repositoryStefan

Stefan Dombek will lead a discussion on workflows for the folio-analytics github repository


-new workflow is needed to go along with new structure for developing and reviewing PRs

-folio-analytics is behind 

-would be helpful to have sprints, deadlines, etc.

-rolling releases challenging in that there is less pressure to get the next query developed


Derived Table Pull Request Prioritization 

Sharon

To support the review and merge process for current pull requests submitted to the folio-analytics GitHub repository, we'll take a look at the current list of Pull Requests and add the new "High Priority" label to them.


FOLIO Product Council UpdateJennifer2024-05-30 Product Council Agenda and Meeting Notes. PC is addressing actionable items from 2023 Report on Things that could be better about FOLIO survey in this spreadsheet. The SIG/PC meeting will be on June 20, 2024, 10-11 am EST.


Recurring Items (Updated weekly, but not always discussed in meeting)

ItemWhoNotes
Review of In-Progress Projects (Recurring)
Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)
Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

  • The working group D-Reporting is planning its own repository on GitHub.
    • Special requirements require a separate repository for the German community.
    • Content of this repository
      • SQL files for DBS (FOLIO database + Metadb)
      • Files for the FOLIO App Reporting. Special reports are created here for the German community. These are usually reports that are desired as in-app reports but are not implemented in the apps.
      • SQL files for views for querying in the FOLIO database
      • Scripts for API calls, automation, Jupyter notebooks ...
      • Wiki
  • Ongoing topics
    • Workshopping
    • DBS statistics
      • JIRA-Issues, Rpt-Clusters
      • Gap analysis to statistic codes, user counts etc.
      • Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO
  • Meetings
    • Contact Stefan Dombek if you would like to get a calendar invitation


Metadb FOLIO User Group

  • Meetings
    • Contact Nassib Nassar if you would like to get a calendar invitation


Product Council


Reporting SIG Documentation Subgroup

  • Orchid documentation is live on https://docs.folio.org/docs/
  • Poppy documentation is in development
  • Additional Context
    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)


For all recent work on FOLIO Reporting SQL development:


...