Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

   Find your local number: https://openlibraryfoundation.zoom.us/u/ketrxUP4uW

Discussion Items

Item

Who

Notes

Attendance

Attendance & Notes

  • Today's attendance-taker: Linda (or substitute)

  • See attendance list at bottom of page

Announcements and Reminders

Sharon

Announcements:

  • About the Reporting SIG meeting schedule

    • Meetings are held on the first 4 Mondays of each month at 11:00 am Eastern U.S. time (see this time in your time zone). The first and third Mondays focus on Reporting Development topics, and the second and fourth Mondays focus on Reporting Business topics. 

    • "business" means topics like presentations on reporting functionality and new features, new reporting applications, surveys and studies on reporting, etc.

    • "development" means working on derived tables and report queries for the folio-analytics GitHub repository

    • "workshopping" queries could be scheduled during any of these meetings, and it would be great to have topics and/or questions in advance so we can prepare to walk through the answers/approaches, such as "how to I fix this inventory query to get rid of the duplicates?" or "what is the best way to calculate totals in this finance query?" 

  • December 23 meeting is canceled

Ongoing Topics:

  • Workshopping your queries

    • part of each Reporting SIG business meeting will be devoted to time to work through any query questions you may have

    • please reach out to Christie Thomas if you have a question you would like to "workshop" during an upcoming Reporting SIG meeting

  • Impacts of New Fields and Features (Sharon)

  • Upcoming Reporting SIG meeting topics (tentative)

    • Derived Tables

    • FUNCTIONS

  • Any new members?

    • Welcome/introductions

SIG Recruitment:

We will need to be recruiting for a variety of roles in the coming months. Please consider whether you would be interested. Please reach out to Scott Perry or Sharon Markus with any questions.

  • Representative for the Documentation Working Group 

Mapping Working Group

Mike Gorrell

As posted on #metadb-mapping -

I have clarity around which tables the transformed data will appear in. Let’s refer to the documentation https://metadb.dev/doc/#_create_data_mapping

There is an image of the data we are working with:

Image Modified

And the CREATE DATA MAPPING commands:

Code Block
CREATE DATA MAPPING FOR json
    FROM TABLE library.inventory__ COLUMN jsondata PATH '$'
    TO 't';

CREATE DATA MAPPING FOR json
    FROM TABLE library.inventory__ COLUMN jsondata PATH '$.metadata'
    TO 'metadata';

CREATE DATA MAPPING FOR json
    FROM TABLE library.inventory__ COLUMN jsondata PATH '$.tags'
    TO 'tags';

CREATE DATA MAPPING FOR json
    FROM TABLE library.inventory__ COLUMN jsondata PATH '$.tags.tagList'
    TO 'taglist';

Mapping a JSON object creates columns, and mapping a JSON array creates a table.  The only array in this example is tagList.  This results in an inventory__taglist table.  Everything else results in columns in the corresponding parent table, which in this case is inventory__t.The outermost object is a special case because there is no parent table.  So it results in the top-level inventory__t table.But if you imagine there is already a table inventory__t, the top-level columns and nested objects are added to it.

Notes:

-first level extraction goes to __t table

-second and third level extractions create new tables, which include

-The separate table for arrays only requires the UUID of the record; this will be included by the software as it transforms the data

-need the structure and column names, data, etc. for the resulting tables

Recurring Items (Updated weekly, but not always discussed in meeting)

Item

Who

Notes

Review of In-Progress Projects (Recurring)

Review the release notes for FOLIO Analytics, LDP, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

D-A-CH Working Group (D-Reporting)

  • A few libraries in Germany would like to start using Metadb soon. In most cases, hosting is in own data centers. The working group needs experience reports on what resources are required.

  • Ongoing topics: Workshopping, DBS statistics

    • Unification of reference data when mapping data from German union catalogs to FOLIO. Collaboration with the MM working group (D-A-CH).

    • Statistics after data anonymization according to GDPR. Collaboration with the RA/UM working group (D-A-CH).

  • Meetings: Contact Stefan Dombek if you would like to get a calendar invitation

Reporting SIG Documentation Subgroup

  • Quesnelia documentation is live on https://docs.folio.org/docs/

  • Ramsons documentation is in development

  • Additional Context

    • The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

For all recent work on FOLIO Reporting SQL development:

FOLIO Product Council

Jennifer Eustis

2024-10-31 Product Council Meeting Notes

  • FOLIO Bugfest starts on 11/11 for 2 weeks. There is a real need for testers.

  • New Claiming App (Sunflower). With Sunflower, there will be a new App for claiming. This app will simplify the identification of late pieces and allow institutions to send claims to vendors.

2024-10-17 Product Council Agenda and Meeting Notes

PC is looking at goals for this year. One goal is working on prioritization. The PC would like to be able to understand what the priorities are for each SIG and possible gaps. Other SIGs are creating Implementers pages through the use of Jira dashboards and lists of issues. Examples are:

Acquisitions SIG: Acquisitions/Resource Management implementers

Data Import: Data Import Implementers Topic Tracker

BELA: Bulk Edit Resource Management Implementation Topics

Each SIG and working group approaches this slightly differently depending on the needs of the group. What would work here to communicate the priorities and gaps with FOLIO reporting to the PC?The PC is asking SIGs to adopt a new prioritization process. This involves using Jira more to keep track of issues important to the SIG.

2024-11-21 Product Council Agenda & Meeting Notes

New Functionality called reading room. This expands functionality of current circulation. (not to be confused with the Reading Room App for LC) -

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyUXPROD-1835

New App - Claiming App. This was recently approved by PC. I believe this needs TC. I’m not sure when this is to be released. (slated for Sunflower)

Attendees

Present?

Name

Organization

Arthur Aguilera

University of Colorado, Boulder

Erin Block

University of Colorado, Boulder

Shannon Burke

Texas A&M University

Suzette Caneda

Stanford University

x

Mark Canney

Lehigh University

Dung-Lan Chen

Skidmore College

Lloyd Chittenden

Marmot

x

Ann Crowley

Cornell University

Tim Dannay

Mount Holyoke College

Danielle Dempsey

Villanova University

Axel Doerrer

University Mainz

Shelley Doljack

Stanford University

x

Stefan Dombek

Leipzig University

x

Jennifer Eustis

U. Massachusetts Amherst / Five College

Lynne Fors

Wellesley College

Vanessa French

Lehigh University

Lisa Furubotten

Texas A&M University

x

Mike Gorrell

Index Data

Alissa Hafele

Stanford University

Lucy Harrison

GALILEO

Kara Hart

Wellesley College

x

Andrew Henryson

Texas A&M University

Corrie Hutchinson

Index Data

Jamie Jesanis

MCPHS

Jeanette Kalchik

Stanford University

Harry Kaplanian

EBSCO

Sarah Kasten

University of Chicago

Tim Kiser

Michigan State University

x

Kevin Kishimoto

Stanford University

Ingolf Kuss

HBZ

Alexander Lao

Stanford University

x

Joanne Leary

Cornell University

Eliana Lima

Fenway Library Organization

Eric Luhrs

Lehigh University

x

Sharon Markus

Cornell University

Kathy McCarthy

EBSCO

Lisa McColl

Lehigh University

x

Linda Miller

Cornell University

Joseph Molloy

Spokane Public Library

Kathleen Moore

EBSCO

Nassib Nassar

Index Data

Elena O'Malley

Emerson

Tod Olson

University of Chicago

x

Jean Pajerek

Cornell University

Kimberly Pamplin

Texas A&M University 

Scott Perry

University of Chicago

x

Natalya Pikulik

Cornell University

Emily Sanford

Michigan State University

x

Bob Scheier

Holy Cross

x

Vandana Shah

Cornell University

Linnea Shieh

Stanford University

Rebekah Silverstein

Oklahoma State University

Susie Skowronek

Oakland University

Ken Smith

Valdosta State University

x

Kimberly Smith

Middle Tennessee State University

Clare Spitzer

Stanford University

Amelia Sutton

U. Massachusetts

Simona Tabacaru

Texas A&M University

Huey-Ning Tan

Stanford University

Vitus Tang

Stanford University

Christie Thomas

University of Chicago

Irina Trapido

Stanford University

Catherine Tuohy

Emmanuel College

Patrick Waite

U. Mass Amherst

Visitors:

x

Aj

?

x

Clair Dolan

?

John Malconian

Index Data

x

Robert Pleshar

University of Chicago

x

Lauren Schiller

University of Chicago

x

Julie Stauffer

University of Chicago