2026-06-03 Data Import SIG Meeting
Recordings are posted Here (2022+) and Here (pre-2022) Slack channel for Q&A, discussion between meetings
Requirements details Here Additional discussion topics in Subgroup parking lot
Attendees: @Christie Thomas @Jennifer Eustis @Robert Pleshar @Whitney Christopher @Yael Hod @Katie Rahman @Ryan Taylor @Jeanette Kalchik
Notetaker: Whitney Christopher
Links:
Agenda:
| Item | Notes |
Announcements |
|
|
| Results from Poll on taking a month off | We will have meetings for August. |
Updates | May 20, 2026: Updates on new functionality and bugs: Update instance, holdings, and item in reverse order (Line 6 in New Topics spreadsheet.) https://folio-org.atlassian.net/browse/MODDATAIMP-1290 / https://folio-org.atlassian.net/browse/MODINVSTOR-1363 | @Ryan Taylor Updates and documentation in particular for 1363 how redundancy works and any documentation)
Conversation is still ongoing. Working with Christine and Kahlil from Spitfire. Ryan will keep the SIG updated hopefully within the next couple of weeks. -Ryan Taylor |
Housekeeping |
|
|
| Splitting Issue | Splitting issue where if there is an error or if the processed is stopped by user then you have to go through each individual load to find the errors/records. --Jeanette Kalchik Ryan will create a Jira. |
| DI load preview and rollback. | A preview or ability to rollback for Data Import--similar to the preview in Bulk Edit --Christie Thomas |
Discussion |
|
|
| New topic: Set for delete: Should users be able to match on deleted records in Data Import? - To be discussed at June 3rd meeting? | Set for delete was fully rolled out in Sunflower. A request from Jenn Colt, at Cornell, when matching, when you wanted to update MARC SRS, you are matching on all records. Could we add a toggle option to chose whether to match on deleted items?--Whitney Christopher An enhancement for Jeanette Kalchick, at Stanford, since the records are not currently actually being deleted. It helps the records stay consistent. Prevents multiple records in FOLIO. Supports a toggle option. --Jeanette Kalchik. Could the toggle apply for a match to instance as well as MARC to MARC? Conceptually the difference between ‘set for deletion’ and ‘deletion’ have not been made clear. This should be made clearer before we come to a decision. Set for deletion is disabled at Chicago due to concerns about accidentally deleting/setting a record for deletion. Agrees with the toggle option.--Christie Thomas Should the toggle be at the environment level or the match level? --Jennifer Eustis Is it possible to have an import profile that the ‘set for deletion’ setting is set to off or on? --Robert Pleshar Profile matching and could check or uncheck for the profile like the qualifiers use to be. Having a default or being able to change it at the MARC matching level. Problematic that you can create newly delete records at the profile level. --Jeanette Kalchik Should the record be skipped or loaded and should it be logged?--Jennifer Eustis For updates it should go through and be noted in the log. Something should not be created as new that is marked for deletion.--Jeanette Kalchik Don’t create records marked for delete. If the record isn’t created how will it let us know the record wasn’t created and why. The log should clearly indicate what is happening. --Yael Could a toggle be used to reject incoming records with a 'd' in the leader? Might work to prevent creating deleted records.--Christie Thomas Could there be a way down the road to create a separate file and log for rejected records? --Jeanette Kalchik There is a Jira for this. https://folio-org.atlassian.net/browse/UXPROD-5293 IN SUMMARY: We need a setting to turn on/off this functionality in the settings and in match profiles. When the setting is turned on in either way, we need better logs and a downloaded-able report to say if it is matching to suppressed or delete. On create, we do not want to create deleted records. Ryan will share our takeaways with Product Owners in the Metadata Management space. Toggle is straightforward to get a Jira in place. Changing the leader 5 'd' mapping will take more work. Involves Bulk Edit will take some work to keep alignment between the two apps. |
| Review of Trillium Features: | https://folio-org.atlassian.net/browse/UXPROD-4704 Testing for this has happened in BugFest. Did people like the functionality and would people be interested in an enhanced version of this for the future EX. where people could download the identifiers? --Jennifer Eustis Having a link at the top of the log that opens to inventory with all the records. --Christie Thomas +1 from Katie Rahman
|
|
| Would people be interested in more asynchronous work? Could do a portion asynchronously and the other portion could happen synchronously in the 2nd meeting of the month. --Jennifer Eustis
|