Archived Data Import Implementers and Feature Discussion Topics
Please add any topics that come to mind, or add notes to an existing topic
Maintained by @leeda.adkins@duke.edu and the Data Import Subgroup Please add questions and topics here. When noticed, topics or questions posted in Slack will be added here as well.
Sequence | Priority | Date added | Topic | Resolved? | From who? | Tags | Notes & resolution (include dates for any discussion & resolution) |
|---|---|---|---|---|---|---|---|
| High | 8/17/22 | Updating individual fields in MARC Bibs/related instances | No | multiple |
| Planned for Nolana Now that we have updated the field protection handling, figure out what additional work is needed on updating individual fields, e.g. could only happen with Update MARC action, not an Update instance action, right? Any fixes needed for repeatable/non-repeatable fields? |
| High | 8/17/22 | Creating/updating multiple Inventory holdings and items from the same incoming MARC Bib | No | multiple |
| Planned for Orchid Most important: how does the data need to be formatted in the incoming MARC Bib to identify the appropriate holdings/items to create/update. What if there are multiple items for the same holdings? What if vendor only knows POLs/VRNs, not Inventory HRIDs/UUIDS? See https://folio-org.atlassian.net/browse/UXPROD-3729 and https://folio-org.atlassian.net/browse/UXPROD-2741 |
| Medium | 8/17/22 | Deleting old (no longer-used) versions of SRS records from SRS | No | @Ann-Marie Breaux (Deactivated) |
| Lots of questions, needed analysis described in linked Jira. Also needs more discussion with the Subgroup |
| TBD | 8/17/22 | Creating (and maybe updating?) MARC holdings from incoming MARC Bib records | No | @Jacquie Samples |
| See https://folio-org.atlassian.net/browse/UXPROD-3782 for sample file and additional questions/details |
| TBD | 4/27/22 | Creating custom job profiles for MARC Holdings | No | @leeda.adkins@duke.edu |
| For libraries storing MARC Holdings in SRS and Inventory holdings is controlled by it, are there cases where libraries will need to create custom job profiles in the UI (currently only a profile to delete, and no UI option) |
| TBD | 11/17/21 | Protecting fields in Instances when they are overlaid by MARC | No | @Jenn Colt |
| It might be that this is too much of an edge case to worry about, but it came up for us so we are just wondering about opinions. In this case it was a FOLIO record that had a link in it that we would have liked preserved when overlaid with marc. |
| Done? | 11/15/21 | Brainstorm log enhancements | No | multiple |
| Aim for some updates in Morning Glory |
| Done? | 11/15/21 | Importing updates for MARC Authority records | No |
|
| Spitfire will be working on this in Morning Glory |
| TBD | 11/15/21 | Analyzing issues with Inventory Single Record Import | No |
|
| Unclear if the issue are in Inventory, Data Import, or both |
| TBD | 11/15/21 | Finalize stories for Creating invoices from MARC Bibs | No |
|
| Should be fairly simple effort since most of the work was done for EDIFACT invoice import |
| Done? | 11/15/21 | Discuss and create stories for Creating orders from MARC Bibs | In Process |
|
| 17 August: Working on this in Nolana |
| Medium | 11/15/21 | Discuss what should happen with SRS MARC Bibs when their corresponding Instances are deleted from Inventory | No |
|
|
|
| TBD | 11/15/21 | How could we start cleaning up SRS? Work on preview feature? Rollback feature? Endpoint for deleting free-floating SRS records? | No | @Jenn Colt @Raegan Wiechert |
| Break into separate topics? |
| High | 8/18/21 | Shared Rancher environment for Import/Export/QM SMEs and POs | No | @Ann-Marie Breaux (Deactivated) |
|
|
| High | 6/1/21 | Default behaviors (implicit/explicit) | No | @Ann-Marie Breaux (Deactivated) |
|
|
| High | 6/1/21 | Creating FOLIO orders from MARC 9xx data | in process | @Ann-Marie Breaux (Deactivated) |
|
|
| High | 6/1/21 | Surfacing errors in log summaries |
|
|
| Split into multiple?
|
| Medium | 8/18/21 | Deleting import logs | done | @Ann-Marie Breaux (Deactivated) |
| Delivered in Morning Glory |
| Done? | 4/27/2018 | Using barcode as a match point |
| Leeda/Duke | matching | for outsourced cataloging record updates |
| Done? | 4/27/2018 | Loading non-Roman script records |
| Leeda/Duke | non-Roman |
|
| TBD | 4/27/2018 | Merging best data from multiple versions of the record |
| Lisa/Lehigh | merging | like MARCedit can do |
| Done? | 4/27/2018 | Loading authority records |
| Mary/Alabama | authorities |
|
| TBD | 4/27/2018 | Using batch load for deletes |
| Christie/Chicago | deletes |
|
| Done? | 4/27/2018 | Export-clean-reload workflow |
| Christie/Chicago | export-reload | our group focusing on loads, not exports; where does exporting fit into the system and dev work? |
| Duplicate? | 4/27/2018 | Using MARC 9xx data for e-invoicing |
| Christie/Chicago | invoicing | do we need to develop MARC 9xx e-invoicing, or is coordinated EDIFACT e-invoicing good enough? |
| TBD | 4/27/2018 | Converting spreadsheet into MARC records for batch loading |
| Christie/Chicago | delimited files | from vendors who cannot supply MARC records; would be helpful if this were part of the FOLIO batch loader, instead of a separate process |
| TBD | 5/2/2018 | Batch import of MARC holdings data in same file as MARC bibliographic data |
| Dec 2017 workshop | holdings |
|
| DONE | 5/2/2018 | Batch import of MARC holdings data in separate file from bibliographic data |
| Dec 2017 workshop | holdings |
|
| DONE | 5/2/2018 | Ability to match to an existing instance, holdings, or item record and update it. |
| Dec 2017 workshop | matching |
|
| Done? | 5/2/2018 | Ability to recognize this instance, holdings, item is not already in FOLIO and create new one |
| Dec 2017 workshop | creating | Different from matching? |
| TBD | 5/2/2018 | Logistics around importing batch files (not so much the file itself, but the support processes for dealing with imported MARC files) |
| Dec 2017 workshop | logistics | * Scheduling/automatic import vs. triggering import upon command |
| Done? | 5/2/2018 | Matching |
| Dec 2017 workshop | matching | * Matching (e.g. matchpoints, cascade of matchpoints, variation by type of file or source of file?) |
| Done? | 5/2/2018 | Templates/defaults/scripts |
| Dec 2017 workshop | templates | For automatic edits when loading data |
| TBD | 5/3/2018 | Handling incoming tag data properly |
| Ann-Marie | tags | If incoming data has tags, the “auto” or “systems” user needs to have permission to add new tags, or there needs to be an error message if only existing tags are allowed, but a new tag is trying to be created. FOLIO also needs to be able to parse tag data in the same MARC field & subfield, separated by a pipe delimiter, into separate tags. And if any incoming tag data is upper-case, needs to be lower-cased. Any space in incoming tag data needs to be closed up. |
| TBD | 5/17/18 | Investigate SolrMARC and Catmandu; anytthing we can learn from them? |
| WOLFcon |
| SolrMARC project from UVA (https://code.google.com/archive/p/solrmarc/) might be good to pull from; Catmandu at University of Ghent (http://librecat.org/) also another good project to look at - both are open source projects |
| Done? | 5/23/18 | Hierarchies of matchpoints |
|
| matching | from 23 May subgroup meeting |
| Done? | 5/23/18 | What should happen when someone is editing (or recently edited) a record in MARCcat, and the same record is being batch loaded? |
|
| merging post-load reporting | from 23 May subgroup meeting |
| TBD | 5/23/18 | Should a new order create only an inventory instance at point of order, or also a brief MARC record? Maybe only instance, and create/link the MARC record at point of receipt? |
| Ann-Marie | creating | from 23 May subgroup meeting |
| Duplicate? | 6/19/18 | Handling tags in incoming MARC 9xx data: multiple tags separated by commas, strip any spaces, what happens if duplicate tag?, tag permissions as relate to data coming in via file loads |