2021-11-17 Data Import Subgroup meeting

Attendees: @Ann-Marie Breaux (Deactivated) @leeda.adkins@duke.edu @Timothy Watters @Kimberly Pamplin @Autumn Faulkner @Lisa McColl @Monica Arnold @Nick Cappadona @Raegan Wiechert @Lloyd Chittenden @Ann Kardos @Christie Thomas 

Development update: 

• Remaining Kiwi Bugfix work:

  • Kiwi smoke testing for data import

  • Kiwi go/no-go decision delayed until Mon 22 Nov

• Juniper Hotfix 4

  • Large invoices

• Lotus Folijet planning: dashboard where you can see the current scope and status of Data Import work for Lotus

• Current Data Import feature development dashboard and bugfix support

Agenda topics: 

• Data Import log improvements: brainstorming session

  • Is there additional info on the backend that is not surfacing in the UI?

  • Filtering by errors is helpful

  • Not all completed with errors jobs give enough information, especially if it's status Failed

  • DI will create the Instance, but no SRS created, will Complete with errors, but not have any error messages

  • Having error messages be more understandable - see Lisa's InstanceType example (seems to be related to the 008)

  • If SRS is discarded, need to have asterisk and explanation of errors

  • The summary page showing the overall results of the job has not yet been developed, and it's really hard to find the errors, especially for large jobs - counts of what succeeded and what failed

  • There are some records that cannot be loaded, and no idea why

  • Is it important to log the single record imports? Yes, everyone agrees

  • START HERE NEXT MEETING

  • Is it important to keep DI logs online forever? (Kiwi BF has 7k+, Cornell has 20K+) challenging for the View all screen, since it's trying to keep track of so much data

    • What if they were automatically purged after x days?

    • What if the log results could be exported?

• Question: Is the 336 mapping fix backported to Juniper? No, it's available in Kiwi. If needed in Juniper, then the library or its hosting provider can adjust the library's MARC-in-Instance default map manually.

• No meeting Weds 24 Nov 2021

• Next meeting Weds 1 Dec 2021