Data Import Requesting a New Topic
The spreadsheet below is used to add an idea for new or changed functionality that cannot be found in the FOLIO Jira project. Once the topic for a new or changed idea has been made into a Jira issue, that topic will be moved to the Archived Data Import page. This is because once the issue is in JIRA, the community will track that issue through the use of labels and comments directly on the Jira issue.
How to add your idea to the spreadsheet below:
Make sure you are logged in
Go to the last entry in the spreadsheet and add a new row if necessary
Add
Topic: Name of the idea or changed functionality
Description: Include expected behavior and any prerequisites
Date added to the spreadsheet
Your name and Institution
If this has been discussed or will be discussed in a SIG meeting, the link to that meeting
How to contribute to other people's discussion topics:
Do not add detail to topics that have Jira issues as your comments may be overlooked.
To contribute to an existing topic. Add a new paragraph to the description column.
@mention yourself at the beginning of the paragraph
How a decision is made regarding the requested new topic:
A requested topic is brought to the SIG for discussion. In the SIG discussion, the SIG members can recommend that the requested new topic
Should not be developed
Because current functionality is sufficient
Because this does not meet our MVP needs
Should be developed
Requires more discussion
This is recorded on a wiki page in the Decision Log section of Data Import’s Wiki Space. The decision is recorded on one wiki page with the appropriate status (ENDORSED, DENIED, COMMUNITY REVIEW). Once all the information has been added to the Decision log, that topic is then removed from the Suggest a New Topic spreadsheet.
If the decision is that the requested topic should be developed, then a decision log is created with the status of “COMMUNITY REVIEW”. A summary of the topic is shared in SLACK #data-import-sig for at minimum 1 week. This decision is also added to the next agenda under housekeeping where a Jira issue will be created together.
If the decision is that the requested topic needs further discussion, then this topic is added to the next agenda.
How are topics archived:
When a decision has been reached and the period of review has passed, then this is recorded in the decision log and acts as the archived topic that was requested.
Previous Archived Spreadsheet
Topic | Original Description/use case | Date Added | Provided By (Name/Institution) | Has Been Discussed (Link to agenda/minutes) | Action Taken by SIG | |
|---|---|---|---|---|---|---|
| 1 | Unable to pull vendor account number from POL when importing EDIFACT invoices | In our previous system the vendor account number lived at the PO/Invoice level. Now it is on the POL/invoice line. I have not found a way when loading EDIFACT invoice files to draw this directly from the POL or to retrieve it from the vendor file. This means for each invoice we must put in all of the vendor account numbers manually, which adds up and is prone to error. If there is a way that data import could pull this value from the POL it would save so much time in our processing. | 2024-04-12 | @Kimberly Pamplin |
| |
| 2 | Ensure consistency of UI for blank indicators between Bulk Edit, Data Export, quickMarc, and Data Import | Issue: Data Import displays blanks with a space. quickMarc is a slash and so on. To avoid confusion, it'd be great to make sure that blank indicators and how marc fields and subfields are mapped in bulk edit, data import, and data export are done in a consistent way. | 2024-02 | @Jennifer Eustis |
| |
| 3 | Ability to view application log | When DI was in the planning phase with, there was a request to be able to view the application log. Examples were provided from other systems. This is still needed. This was shown as "server logs" in the original wireframes. See | 2024-08-15 | Lab Session |
|
|
| 4 | Add date and start/stop running date and times to the summary log page | Right now to see these times, you have to click out of the summary log view and back to the brief log view. Having this information displayed also on the summary page is helpful and needed. | 2024-10-17 | Lab session | https://folio-org.atlassian.net/wiki/spaces/DISIG/pages/1215103056 | Requested Jira for enhancement. Waiting on Ryan for link to Jira issue, https://folio-org.atlassian.net/browse/UXPROD-5293 |
| 5 | Data Import log does not provide reason for No Action status. | The reason was previously provided as an error even though No action is means updates or creates were not taken because of the profile logic. (Multiple matches, single match with no create or update action provided, or no matches, etc.) The reason for No action should be provided in the log because it could be any of a number of scenarios. | 2024-10-23 | @Christie Thomas University of Chicago |
| |
| 6 | Update instance, holdings, and item in reverse order. | Right now the instance, holdings, and item must be updated in that order. It is also not possible to update an item independently and then, in the same job, match and update the instance and holdings. When updating all three records as a part of a shelf ready workflow, integrations (FOLIO app and external) require that the barcode be added to the item before the holdings record is updated. We need to be able to match and instance, holdings, and item (in that order) and then update the item, holdings, and instance or the item, instance, holdings in either of those orders. Error message from import in Poppy: | 2024-10-31 | @Christie Thomas University of Chicago |
|
|
| 7 | Update the SRS with override field protections enabled and update the instance status and cataloged date in a single job. | It is not possible to pair and SRS update with an instance update in the same job. We have the need to update the srs marc record and the instance record in a single job with a single match. (Match and instance or an srs marc record and specify an srs marc bibliographic update profile and an instance update profile. Or create an action that is linked to multiple field mapping profiles. | 2024-10-31 | @Christie Thomas University of Chicago |
|
|
| 8 | Delete holdings and items in batch via data import | When marking an instance for deletion we should be able to also delete all holdings and items attached to the instance or delete holdings and items targeted by identifier. | 2024-11-21 | @Christie Thomas University of Chicago |
|
|
| 9 | How to map other subfields of the 035 | Currently the behavior on update is that the $a or $z are mapped. However, with other fields then the value isn’t mapped and the field appears but is empty. You see the 035 and then nothing. It’s like the process doesn’t know what to do. From Ryan on Slack: Hmmm interesting scenario here. As I understand it, the 035 default mapping is specifically looking for $a or $z. So I would say that Jennifer's thinking is correct that the system just doesn't know what to do with it and, therefore, does nothing.@Lisa Lorenzo - I tested with your file in snapshot and even added a $b into the mix too. Neither 035 $9 or $b get mapped to the instance. However, they are retained in the underlying SRS MARC. I would say this is expected behavior today, since default Instance mapping for 035 is specifically looking for $a or $z. To include other subfields would require customized mapping. | 2024-12-10 | @Lisa Lorenzo @Jennifer Eustis |
|
|
| 10 | Create single log entry for a batch import jobs that are split rather than a log entry for each sub-batch of 1000 records. | When file splitting is turned on, multiple log entries are generated for a single import file with one log for each batch of 1000 records in the file. For a a large file, this can create dozens of logs that need to be reviewed and reconstituted into a single log for reporting out. It is preferable to create a single log for the job with the ability to view the log for a single batch. This would make it easier for staff to manage large batch jobs via file splitting for the long term. | 2025-01-24 | Christie Thomas (University of Chicago) |
| |
| 11 | Single log entry | When using split files functionality, it is necessary for some to have one single log entry instead of one log entry for each split file | 2025-02-05 | Chicago | https://folio-org.atlassian.net/wiki/spaces/DISIG/pages/700809255 |
|
| 12 | Multiple Statistical Codes | Users need to be able to create multiple statistical codes from one field with repeatable subfield, e.g. 949 $s books $s facauthor $s gift | 2025-03-27 | Lynne Fors |
|
|
| 13 | Scheduling DI jobs | Users would like the ability to schedule jobs | 2025-04-17 | Christie Thomas |
|
|
| 14 | Cancelled jobs in settings | If a job is canceled it does not show up in the Settings under Jobs using this profile. Not clear if this is expected behavior or a bug | 2025-07-30 | @Yael Hod/Stanford |
|
|
| 15 | Ctrl+Left click to open new tab in logs | In the logs I want to hold Ctrl then left click to open the link in a new tab. I can right click and open in a new tab. In a Job this is possible for the JSON, instance, etc. | 2025-080-07 | @Jeanette Kalchik /Stanford |
|
|
| 16 | Mark Job Profiles Active or In active | It would be extremely helpful to be able to deactivate Job Profiles that we wish to retain for reference purposes (such as documenting previous workflows) but don’t want to allow anyone to use the profile. Adding a checkbox to Job Profile settings page to allow us to mark the job Active (or uncheck to mark as In active). In active job profiles do not display in the list of available jobs in the Data Import app when running a job; only active job profiles are displayed to choose from. | 2025-08-07 | @Lynne Fors (Wellesley) ; Lab Session |
|
|
| 17 | Expected behavior when creating orders with a quantity greater than 1. | Data import behavior when the quantity is greater than 1 (multiple copies) has been inconsistent from release to release. For example, at Chicago, I would expect for a quantity of 2 to have 2 items open and for each of those items to be associated with the PO. In certain conditions, one item will be created regardless of the quantity and in other conditions multiple items will be created, but only the first item is associated with the PO. The goal of this inquiry is to understand expected behavior included impact on POL properties, Inventory records, and the relationship between PO LIN quantity and Locations Quantity in the field mapping profile. | 2025-08-08 | @Christie Thomas (University of Chicago) and @Whitney Christopher (Cornell) |
|
|
| 18 | include the date/time data (start + end) somewhere in the Data Import log individual job view | The start/end time for each job appears in the log list but not when you are looking at an individual job. | 2025-09-10 | @Yael Hod (Stanford) |
|
|
| 19 | In field mapping profile allow option to add if not a duplicate. | When adding an administrative note via data import it is possible to add an administrative note twice. Need an option to add an administrative note only if it is not a duplicate. | 2025-09-15 | @Christie Thomas |
|
|
| 20 | Use API to copy and create job profiles | With Export & Import Data Import Job Profiles via API the question of copying profiles came up. This would be in the same tenant and just copying then modifying a few things rather than duplicating at each level and recreating. If you export and import in the same environment it will update the original profile (as expected) since the get call has the uuids. Is there any way to remove the uuids or otherwise change the profile so that a new profile will be created in the same environment? (copied from DI slack channel) | 2025-09-19 | @Jeanette Kalchik |
|
|
| 21 | Archive old Data Import Jobs | Jobs that we no longer use, but wish to retain the information about we add zz - to name so it will be at the bottom of the list. The ability to Archive/suppress jobs from the Data Import module that are no longer in use would be a great enhancement. | Oct 24, 2025 | @Jeanette Kalchik /Stanford |
|
|
| 22 | Upload KBART files to specific packages directly | As an e-resources librarian, I want the ability to load a KBART file for a specific package directly into that package’s eHoldings screen, e.g. Books at JSTOR: Evidence-Based Acquisition, to manage my holdings. These KBART files can originate from a vendor, such as JSTOR, ProQuest, or OCLC Collection Manager. Currently, I have to transform a KBART into a .csv file and insert the package name using Excel, which can be an extremely frustrating process as each sheet can only handle 20,000 rows. If there are more than 20,000 rows, multiple sheets have to be created which can become cumbersome and complicated. Eliminating this step would greatly improve my efficiency in managing my e-resources. https://folio-org.atlassian.net/browse/UXPROD-5253 Data Import is a potential option to loading these files into FOLIO. A joint session with ERM about this topic may be needed. | 2025-11-05 | @Lynne Fors (Wellesley) |
|
|
| 23 |
|
|
|
|
|
|