2022-08-10 Data Import Subgroup meeting

Recordings are posted Here (2022+) and Here (pre-2022)                   Slack channel for Q&A, discussion between meetings

Requirements details Here                                                                    Additional discussion topics in Subgroup parking lot

Attendees: Ann-Marie Breaux (Deactivated) Jennifer Eustis Monica Arnold Lynne Fors 

Morning Glory

• Morning Glory Folijet and Spitfire planning: dashboard where you can see the current scope and status of Data Import work for Morning Glory
• Folijet Current Development Board
• Folijet Current Bug Board (will be merged back into the dev board as of next sprint)

Agenda topics:

• MM SIG presentation on last week Data Import and Morning Glory/Nolana
  • MM SIG meeting notes from last week - Data Import update is last topic: https://wiki.folio.org/display/MM/2022-08-04+Metadata+Management+Meeting+notes
  • Slide deck: 
  • MM SIG meeting recording: https://recordings.openlibraryfoundation.org/folio/metadata-management-sig/2022-08-04T11:30/ (password is same as for FOLIO Zoom meetings)
• Deleting import logs via API:
  • Available as of Morning Glory
  • There was a Slack question recently about being able to delete Import logs via API as of Morning Glory. We have added some documentation in the Data Import tips and tricks. Please see this page: 4-Data Import Logs, in the last section: Deleting Import Logs via API.
• MARC Modifications and Field protections
  • MG bug: MODDICORE-248 - Getting issue details... STATUS
  • Modify scenarios – describe real use cases – homework
    • https://bugfest-mg.int.aws.folio.org/settings/data-import/job-profiles/view/673f7ba3-27d2-4bf4-935f-f358f46583fe?sort=name
    • At beginning of job
    • At end of job
    • After match?
    • At beginning and end of job
    • At beginning, after match, and at end of job?
  • Any scenario where a job would have a Modify action without a Create or Update?
    • Example: https://bugfest-mg.int.aws.folio.org/settings/data-import/job-profiles/view/5564537e-9bda-426f-a755-de5ae16d7ebd?sort=name
      • What would be the expected outcome for a job set up like this?
    • Would it be valid to say that field protections and overriding field protections only invoke when there is one of these Update actions in a job profile?
      • Update MARC Bib (protect and override)
      • Update Instance (protect only, if override need an Update MARC Bib action)
      • Update MARC Authority (protect only, in previous discussion, decided that overrides are not needed for MARC Authority, only Bibs)
      • Not for update Holdings, Item actions (no MARC record underneath)
      • Not for update MARC Holdings action (field protections not currently allowed in FOLIO, per previous discussion)
• Lotus HF3 Hot fixes for Data Import:
  • View list here
  • MODSOURCE-509 - Getting issue details... STATUS : working except one small issue; when an incoming MARC Bib has an HRID in 001, an 035 will be created; documenting as known issue in Lotus; attempting to correct in Morning Glory
  • MODDICORE-272 - Getting issue details... STATUS : working but would be good to have additional testing
  • MODSOURMAN-841 - Getting issue details... STATUS : working but would be good to have additional testing
• Morning Glory Bug fixes for Data Import: 
  • View complete list here
  • View unclosed bugs here
    • Some issues have different solutions for Lotus HF versus MG Bugfix versus Nolana, e.g. MODSOURCE-509 - Getting issue details... STATUS versus MODSOURCE-528 - Getting issue details... STATUS , or MODSOURMAN-841 - Getting issue details... STATUS versus MODSOURMAN-843 - Getting issue details... STATUS ; fixed Lotus first, now MG in progress
    • MODDICORE-275 - Getting issue details... STATUS : tested on Snapshot, and seems to be working properly; would be good to have someone else test it on Snapshot and confirm, before we release it to MG BF
    • MODSOURMAN-840 - Getting issue details... STATUS : finishing the fix; files where some records have 999 ff's and some don't were giving us the most trouble
    • MODINV-709 - Getting issue details... STATUS :
      • Separate profiles for 1) match by POL and update Inventory records and 2) match by VRN and update Inventory records work properly
      • Aiming to fix in Nolana; use separate profiles as a workaround for MG

Upcoming meetings:

• 17 August 2022
  • Order field mapping profile questions
  • UIDATIMP-294 - Getting issue details... STATUS
    • Go over POL limit override, Create separate POs based on MARC value 
    • POL Subscription fields: included as part of one-time order in Orders app; include in field mapping?
    • Overall screen - any questions?
• 24 August 2022
  • Combined meeting with quickMARC Subgroup, to go over MARC Authority and MARC Bibliographic headings linking (only manually for now, not via DI)