2021-06-21 Reporting SIG Meeting notes

Sharon Beltaine

Cornell University

Tod Olson

University of Chicago

Nancy Bolduc

Cornell University

Jean Pajerek

Cornell University

Axel Doerrer

University Mainz

Michael Patrick

The University of Alabama

Stefan Dombek

Leipzig University

Eric Pennington

Texas A&M

Jennifer Eustis

U. Massachusetts Amherst / Five College

Scott Perry

University of Chicago

Ingolf Kuss

hbz

Natalya Pikulik

Cornell University

Jesse Lambertson

University of Chicago

Vandana Shah

Cornell University

Eliana Lima

Fenway Library Organization

Amelia Sutton

U. Massachusetts

Linda Miller

Cornell University

Simona Tabacaru

Texas A&M

Nassib Nassar

Index Data

Kevin Walker

The University of Alabama

Elena O'Malley

Emerson

Angela Zoss

Duke University

Attendance & Notes

Angela

Attendance & Notes

• Today's attendance-taker: Linda Miller

• Today's note-takers:  Team Leads for project updates

Announcements /
Reminders

Angela

Fundamentals of the FOLIO Community (June 30 at 11am Eastern U.S. time)

• This webinar is the first in a new series of onboarding videos for community members. It will cover topics such as FOLIO’s governance structure and the relationship between libraries, vendors, and developers, user-experience design, and the FOLIO Code of Conduct.

• Register for the Forum by following this link to Zoom.

• A recording of this Forum will be included above and on the Open Library Foundation YouTube channel (https://www.youtube.com/c/OpenLibraryFoundation).

Recruiting New Query Developers

• The Reporting SIG is always on the look-out for new query developers. Please let us know if you are interested in doing query development or if there are others at your institution who might be a good fit.

Test Data

FOLIO Reporting developers and Reporting SIG members are encouraged to use this new page to share test data cases they have entered into FOLIO reference environments to keep us all aware of what data to expect when we test our queries.

• Test Data Updates to FOLIO Snapshot Environments

Cluster Ranking

New Report Clusters are added on a regular basis, so it is important to make sure your institution is reviewing these clusters and ranking them to establish report development priorities. If you rank reports for your institution, please follow the instructions below. If someone else ranks, please pass this information along to that person so your institution's vote can be included.

• Action =>> Please review Reporting SIG-All Report Clusters (57 issues) in JIRA and RANK each report cluster for your institution (R1-R5)

• For reporting, institutions only need to rank the UXPROD Report Cluster JIRA issues. All reporting requirements, which are captured in REP-XXX issues, roll up to the UXPROD Report Clusters. Report clusters cover one or more report (REP-XXX issue) requirements.

Request for feedback: Documentation of mod-users data attributes

All

From MODUSERS-119:

Detailed documentation has been published on https://dev.folio.org/reference/api/#mod-users . This includes

• https://s3.amazonaws.com/foliodocs/api/mod-users/users.html#users_post

• https://s3.amazonaws.com/foliodocs/api/mod-users/groups.html#groups_post

Please review and give feedback whether this is sufficient and this issue can be closed, or list the information that is still missing.

If you use these modules, please review the documentation over the next week or two and send feedback to Angela.

The case of the deprecated field

Tod/All

Deprecated fields - how does the LDP deal?

• can we track changes to the schema over time? watch for new/changing elements, keep an eye out for "deprecated"

• even SIGs don't know what the data elements are

• app documentation isn't necessarily up to date

• would Documentation Working Group be a resource for better documentation of data fields in an app

• list of fields, but not sure how current it is - maybe Charlotte has it ("beta elements")

  • https://docs.google.com/spreadsheets/d/1RCZyXUA5rK47wZqfFPbiRM0xnw8WnMCcmlttT7B3VlI/edit#gid=952741439

• We have early attempt: FOLIO Data Model Documentation

• Git log can look between a set of dates (command line at least, can check on GitHub)

  • Look for changes to ramls/userdata.json  during 2020:

    git log --since=2020-01-01 --until=2020-12-31 ramls/userdata.json

• Maybe consider GitHub actions to run scripts nightly, send alerts?

• Bring up in a dev meeting to explore possibilities

Noticing any problems with the data integrity?

Stefan/All

• example problem with communication between FOLIO apps - if you delete a PO line, the agreements don't get updated

• App Interaction SIG has a channel on Slack, so can share information with them (#appinteraction)

• Orders talks to Inventory, but Inventory doesn't talk back to Orders, so changes in Inventory don't get reflected back in the orders

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries.  Each week, these groups will share reports/queries with the Reporting SIG.  Reporting development team leads are encouraged to enter a summary of their work group activities below.

RA/UM Working Group

• Progress on Patron List, maybe ready for review this week

• No meetings until July 15

• Context

  • Meeting notes: https://docs.google.com/document/d/1UnzG64tl917LOH2FtWhCEPlSOsnJWKL-0eu88Ouo1DU/edit

  • Current status of RA/UM issues: https://github.com/folio-org/folio-analytics/issues?q=is%3Aissue+is%3Aopen+RA%2FUM

MM Working Group

• We didn't meet last week.

ERM Working Group

• Fortuantely no ERM query and no (erm) derived table is affected by upcoming Bound-with data model

• Draft of  ERM-Order Status Report Cluster is available on Github, some MARC data still needs to be added

• ERM Prototype and Query Development Status

RM Working Group

• plan to analyze impacts of new bound-with data model

  • new data model to be included in Juniper (mid August)

  • new bound with table, see UXPROD-1241 for details

    • https://folio-org.atlassian.net/browse/UXPROD-1241

    • Bound-with data model

  • so far, only the RM item_count query is impacted

• working on queries for the 1.2 FOLIO Analytics release

  • reviewed RM-Standing Orders query and ERM-Orders Status query, which are similar but will be posted separately due to minor differences in design

  • reviewed Open Order query

• for latest updates, see RM Prototype and Query Development Status

• Friday the RM SIG proposed a new organization; ERM would be raised to level of SIG, and RM would join Acquisitions group to form an Acquisitions SIG, also elevate Open Access group to a SIG

Reporting SIG Documentation Subgroup

• Reviewed all of the feedback, planned out changes, and will incorporate this week

• Additional Context

  • Over the next few months, Reporting SIG Documentation Subgroup will be helping to build end-user documentation for https://docs.folio.org/docs/ (much will be linking to existing documentation over on GitHub)

  • see Reporting SIG Documentation Subgroup and Guide to Reporting Documentation pages in this wiki

External Statistics Working Group

• no updates currently

• ACRL query set included in FOLIO-Analytics 1.1 release

• new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository

• New organizational structure for External Statistics reports

  • external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas

  • these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository

  • institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues

  • each reporting development team will take responsibility for the queries in their area for the external statistics clusters

For all recent work on FOLIO Reporting SQL development:

• https://github.com/folio-org/folio-analytics/commits/main

How-To: Adding Test Data in FOLIO Snapshot

Angela

Are Reporting SIG meeting recordings available?

Tod

Yes, at https://drive.google.com/drive/folders/0B7G8S7WF6N20VE5Wa0I0STZGcjg?resourcekey=0-6tdvnGsUOaD0Ixp-nK_5VA

Scheduling future topics

All

• Volunteers for sharing reporting rollout plans

• Volunteers for sharing how institutions are using the LDP

• Prioritizing training topics

Topics for Future Meetings

All

• Alternate FOLIO reporting systems

  • Google Sheets add-on (June 14)

  • ByWater system (June 28)

• Follow-up on MARC status, Quickmarc/Data Import conflicts

• Show and tell

  • how are institutions using the LDP

  • Cornell's report ticketing system

  • Rollout plans from institutions

  • Ask someone on the sysadmin side to talk about LDP administration (Jason Root?)

• Training topics

  • adding test data in FOLIO snapshot

  • How to do ad hoc querying with the derived tables

  • How to use the LDP app

  • using KNIME to build reports

Review and update Topics for Future Reporting SIG Meetings