2024-7-10 Data Import Subgroup meeting

Recordings are posted Here (2022+) and Here (pre-2022)                   Slack channel for Q&A, discussion between meetings

Requirements details Here                                                                    Additional discussion topics in Subgroup parking lot


Attendees: Ryan TaylorJennifer Eustis, Whitney ChristopherSara ColglazierRobert Pleshar, Jeanette Kalchik, Lisa English

Notetaker: Christie Thomas

Links:

Agenda: 

TopicWhoMeeting NotesRelated JiraDecisions and Actions

Announcements:


Running joint UAT with Folijet, Spitfire, and Firebird. Focused on searching in inventory, cancelled LCCN mapping. UAT has not been closed yet - will continue throughout this week. 

Q: results from previous UAT for data import? Likely, would have gone over it at MM because it was also a joint UAT. This is also technically still open. 

The links for UATs are in the data import slack channel. 

WolfCon 2024 - Ryan and Jennifer Eustiss will be doing a session on data import updates tips and tricks on 9/25. First half Ryan will be going over a roadmap of data import for the next few releases. (high-level - goals and features) Jennifer will be leading a discussion of tips and tricks for using data import. Contact Jennifer Eustiss via slack if you want to help out with this. 



Enforce an order to deletion for Data Import Profiles (Data Tracker Topic)All

Discussed in 2024-2-28 Data Import Subgroup meeting and  2024-1-31 Data Import Subgroup meeting

Issue: When a user deletes a job profile without unlinking all the profiles in the job, then that user cannot delete the associated profiles. It is necessary to unlink all profiles before deleting the job.

Discussion: developers will look into this in the coming sprints. 

MODDATAIMP-1026 - Getting issue details... STATUS
Warning or error to stop the job when a job doesn't contain any action profiles (Data Tracker Topic)Sara Coglazier, Jenn Colt, Christie Thomas

Discussed in 2024-2-28 Data Import Subgroup meeting

Issue: A job will appear to run even though there are no actions. Found in particular with the 361 and 365 issues where action profiles were missing.

Discussion: Create or update of a job profile without any action profiles will be disallowed. This includes profiles with a match and no action profiles.  This change will be live in snapshot today. 

Q: Just need one action for either a match or a no match? This is correct. Only one action profile is needed for the job to be able to save. 

Q: What happens if an action is deleted leaving an existing job profile with no actions? It is expected that the job profile will be editable but cannot be saved until another action profile is added. 


Q: What happens if action profiles are removed from a job profile after creation (intentionally deleted or via a bug as has been seen before at migration). What happens when someone tries to run a job with no action profiles? Ryan will look into this scenario. 

MODDICONV-373 - Getting issue details... STATUS

Ability to change the link to a profile rather than unlink and then link (Data Tracker Topic)


Jennifer Eustis

Discussed in 2024-2-28 Data Import Subgroup meeting

Issue: Right now, it is necessary to unlink and then link to a new profile. It would be great to have the option to also be able to change the link if you just need to link to a different profile.

Discussion: Needs a ticket to be created ad Ryan will be sure to get one in the system to look into this. Will probably require longer term changes to how the profile page is set up. 



Enhance Electronic Access (856) subfield mappings to include non public note, access, and terms governing access (Data Tracker Topic)Jennifer Eustis

Issue: The mapping for the MARC 856 was done almost 2-3 years ago. It is limited. This was discussed at last year's WOLFCon and in a MM SIG and was approved to expand functionality to 856 $x, $7, and $n.

Discussion: Lots of stakeholders across the project. Needing broad discussion.

Question of how to keep up with the changes to the standards to allow for new fields when they emerge. A process needs to be in place for this in the future. 

Also need to address mapping URI relationship based on indicators which was a part of the same conversation at WolfCon last year. There should already be a ticket for URL relationship mapping in the holdings. 

UIIN-2579 - Getting issue details... STATUS
Ability to pull vendor account number from POL when importing EDIFACT invoices (Data Tracker Topic)Kimberly Pamplin

Discussed in lab.

Issue: In our previous system the vendor account number lived at the PO/Invoice level. Now it is on the POL/invoice line. I have not found a way when loading EDIFACT invoice files to draw this directly from the POL or to retrieve it from the vendor file. This means for each invoice we must put in all of the vendor account numbers manually, which adds up and is prone to error. If there is a way that data import could pull this value from the POL it would save so much time in our processing.


Discussion: Need more information and records for testing. Ryan will reach out. Also, suggested that Dennis (orders PO) be consulted. It was noted that vendor account number is not editable after the order is open. This field sometimes get populated in the invoice and sometimes it does not, but not clear what the difference is. 



Ensure consistency of how blank indicators and marc fields and subfields appears in mappings and profiles across Data Export, Data Import, Bulk Edit, and quickMarcJennifer Eustis

Discussed in Bulk Edit.

Issue: Data Import displays blanks with a space. Quickmarc is a slash. Bulk Edit is designing editing of MARC srs bibs where MARC fields and subfields mappings look different from Data Imports (thinking of Marc Modifications) and so on. To avoid confusion, it'd be great to make sure that blank indicators and how marc fields and subfields are mapped in bulk edit, data import, and data export are done in a consistent way.


Discussion: Ryan will reach out to Magda and Christine to get the conversation started. 



Notes from previous meetings...

Discussion: Question about Invoices or Invoice Lines in the data import log summary. Vote for Invoice Lines. 

Also, suggested to have one meeting per month devoted to the topic tracker. 




Upcoming meetings/agenda topics:


Chat: