| Status | Topic | Description/use case | Date Added | Provided By (Name/Institution) | Interested Parties | Has Been Discussed (Link to agenda/minutes) | Jira Link | Action Required |
---|
1 | | MARC-MARC Matching Enhancements | MARC-MARC matches and MARC-Inventory matches have differing use cases. Pairing a MARC-MARC match with a more specific MARC-Instance or MARC–Holdings or MARC–Item match allows for identifying a specific record to be updated, or confirms that a new record is needed. Click here to expand... We want to ensure that MARC-MARC matching works properly for repeatable and non-repeatable fields, especially 0XX/9XX fields, and that they can pair well with Inventory submatches. In scope: - MARC-MARC matches that result in multiple possible hits can be narrowed to single records with MARC-Inventory or static value submatches
- Review any existing matching bugs and plan to resolve as part of this feature
Out of scope: - After a MARC-MARC or MARC-Instance match, a user can include both Instance and MARC Bib actions afterwards (need examples from users)
- Confirm that MARC matches are working properly using indicator wildcards (asterisks) versus blanks
- Currently ISBN matches do not translate 10-digit and 13-digit so that they can be matched against each other, Include in this feature, or handle as a separate feature in the future? See
MODSOURMAN-269 - Should we add a bug for not being able to have an override action for field protections under a MARC-Instance match?
- What else?
Use case(s): - SMEs: Please add examples*
* MARC-MARC match on OCLC number and then submatch by Instance status - MARC-MARC match on 001 and then submatch for holdings by permanent location
- Need a use case that results in multiple SRS hits that then need to be narrowed down by Inventory match
| 2020-05-13 | All | All | 2024-1-17 Data Import Subgroup meeting |
UXPROD-2742
-
Getting issue details...
STATUS
| - More Use Cases and scenarios
|
2 | | Data Import removes duplicate 856s in SRS | Overview: When updating an SRS record via Data Import, some MARC fields are duplicated while others are de-duped without notification or guidelines. ** Click here to expand... Steps to Reproduce: - Log into any environment on Orchid or Nolana.
- Identify any record in inventory and export the MARC record.
- Add two exact duplicate 856 fields to the record.
- Exact duplicates including indicators and subfields. Copy & paste.
- Import using a simple overlay job profile matching on a subfield of the 999 to update the SRS. Do not use MARC modifications.
Expected Results: The SRS record contains duplicate 856 fields. Actual Results: The SRS record contains only one of the duplicate 856 fields. ** Additional Information: We know that Data Import does not de-dupe the 903 field, for example, during an update but it does the 856 field. Data Import jobs which create new SRS records includes the duplicate 856 fields. This raises several questions: - Why does the system de-dupe during an update without explicit instructions from the user?
- Which fields does the system de-dupe and when?
- Is this a bug? Or by design?
From testing, there appears to be no difference between de-duping of the 856 when field protections are applied or not.
| 2023-06-13 | Corrie Hutchinson (Unlicensed) | All | 2024-1-17 Data Import Subgroup meeting 2024-1-10 Data Import Subgroup meeting
|
MODDATAIMP-879
-
Getting issue details...
STATUS
| - Need to define what deduplication means
- Clarify expectations
- Deduping in the UI vs SRS
- Deduping the incoming record
|
3 | | Jobs run immediately after canceled jobs take excess time | Overview: Jobs started immediately after canceling a job get stuck and don't progress Click here to expand... Steps to Reproduce: - Log into Orchid bugfest
- Use data import to begin a file of 5000 records with a moderately complex import profile
- Cancel the data import job when it hits around 2%
- Immediately go to Inventory and trigger an Inventory Single record import by selecting OCLC and using record # 1234567
- Then do a few more Inventory single record imports
- Watch the log to confirm that the stopped job actually stops and the single record imports are happening quickly
Expected Results: The job cancels and stops processing. Data import jobs started after the cancellation act normally. Actual Results: Single record imports started after canceling a job like this are slow. One single record import after a cancelation took 17 minutes. Additional Information: In Nolana, canceled jobs created a large number of error messages that seemed to affect performance. Have the logs been checked to be sure this isn't still happening? Is something else causing this behavior?
Attached file and profile "cornell ebz" can be used to replicate. BE notes (possible solution): - Create cache in mod-source-record-manager with jobs that are IN_PROGRESS. When job is marked as CANCELLED, COMPLETED, ERROR - update the cache and send Kafka event (probably, we only need the event for CANCELLED status)
- mod-source-record-storage, mod-inventory, mod-orders, mod-invoice should also have the same cache as in mod-source-record-manager. Subscribe these modules to the status update event. When Job_Cancelled event is received - update cache, set status of that job to CANCELLED.
- In mentioned above 4 modules, when event for record processing is received, before processing - check JobExecution status in the cache. If it is not cancelled - proceed with processing. If there is no record for the given JobExecution, call mod-source-record-manager endpoint to retrieve info for the cache (alternatively call mod-source-record-manager to get the cache data only on module startup).
| 2023-03-29 | | All | 2024-2-21 Data Import Subgroup meeting |
MODSOURMAN-970
-
Getting issue details...
STATUS
UXPROD-4704
-
Getting issue details...
STATUS
| Converted from bug to new feature. Ryan T. to get information on how this affects slicing |
4 | | Adding MARC modifications to imports with update actions creates broken records | Overview: Click here to expand... Steps to Reproduce: - Log into Morning Glory bugfest
- Go to inventory and select import using the "OCLC with MARC modifications" option and import OCLC number 31934425
- The record should import successfully and the title will have received an obvious MARC modification
- Attempt to overlay the same record with the same OCLC number.
Expected Results: Overlaying the record works. The MARC is modified as described in the profile and the instance and SRS are updated. Actual Results: The instance is not updated. A modified SRS record is created but still has the original OCLC 001 and 003. QuickMARC will not work on the record. Additional Information: URL: Update profile: https://bugfest-mg.int.aws.folio.org/settings/data-import/job-profiles/view/1c351fa4-d578-434f-a02a-7ff46af16f06?query=single&sort=name An example of an instance with this issue: https://bugfest-mg.int.aws.folio.org/inventory/view/53e28701-dccc-49be-a01d-9adaa15f4cb6?query=neuromancer&sort=title&xidtype=0dd718cf-a09a-4f1c-be6a-0cf0de58b424 Job profiles - Morning Glory
- Nolana
- Orchid
BE Notes: - First Modify action saves the record in SRS, subsequent Match on MARC Bib in SRS returns multiple match error, because it finds not only the original record, but also the one that was just saved.
- During modify action post-processing an attempt appears to change instance hrid because of incoming record doesn't contain actual instance hrid in 001
that causes error on instance update.
Note for QAs: When this bug is fixed, create a new TestRail for modification, followed by match, followed by update action, as outlined in the repro steps above. Then unlink this Jira from TestRail C350914 | 2022-08-04 | | All |
|
MODDATAIMP-710
-
Getting issue details...
STATUS
|
|
5 | | Adding MARC modifications to single record overlay doesn't respect field protections | Overview: When a MARC modification action is added to the end of the single record overlay job, protected fields from the existing MARC SRS are removed rather than from the incoming file. Click here to expand... Steps to Reproduce: - Log into some FOLIO snapshot environment
- Go to Settings/Data Import
- Duplicate the field mappings for Inventory Single Record - Default for the update marc bib and update instance
- Create a new field mapping for a marc modification where the fields 029, 506, 856, 583 are deleted
- Create action profiles linked to the field mappings you just created
- Duplicate the inventory single record match for no srs and existing srs
- In field protections, make sure that you add 583 with subfield 5 and data MU in addition to 856 with subfield 5 and data MU.
- Create a job with a match to existing marc srs. On matches update marc srs. On no matches, another match to no srs and then under that update instance. Then at the level of the 1st match, add the modify marc action (see screenshot)
- Bring in a record and add a 583 with a $5 MU and a 856 $5 MU
- Overlay
Expected Results: The existing and protected fields should remain in the record. Actual Results: The protected fields have been removed. Additional Information: URL: The job profile on orchid bugfest is https://bugfest-orchid.int.aws.folio.org/settings/data-import/job-profiles/view/b590fc78-f069-42a1-bfdd-3988c7d6be00?query=fc%20test&sort=name. | 2023-08-23 | | All | 2024-2-21 Data Import Subgroup meeting |
MODDATAIMP-897
-
Getting issue details...
STATUS
| Functionality audit being prepared in DI lab |
6 | | Single record overlay creates duplicate OCLC # / 035 | Overview: When "Overlay source bibliographic record' is employed for the first time, duplicate 035 fields are created. Click here to expand... Steps to Reproduce: - Log into bugfest-Orchid
- Open Inventory and search for an instance (random records were chosen and the behavior was duplicated each time)
- From Actions, choose 'Overlay source bibliographic record':
- External target = OCLC WorldCat
- Profile = Inventory single record - default update instance (Default)
- Enter the OCLC# of the instance currently being viewed
- Click 'Import'
Expected Results: The bibliographic record and instance are updated with the latest OCLC version. Actual Results: The bibliographic record and instance are updated but with duplicate 035 fields for those OCLC#s with a prefix. Additional Information: Testing shows that this happens on the initial overlay, but subsequent overlays do not continue to 'add' duplicates. Records tested in bugfest-orchid: in523951 and in2486915 (screenshots of before overlay and after are attached) Duplicate data causes issues with integrations and other functions that rely on the OCLC# as a match point. | 2023-04-12 | | All |
|
MODDICORE-339
-
Getting issue details...
STATUS
|
|
7 | | The number of created invoices is displayed when all invoices have errors with invoice lines | Overview: ** Click here to expand... The file has 18 invoices and 1104 invoice lines. Steps to Reproduce: - Admin user is logged in.
Steps to Reproduce: - Duplicate the "Default – GOBI monograph invoice" profile.
- Update next fields into the copied profile:
- Name: any unique name
- Incoming record type: EDIFACT Invoice
- FOLIO record type: Invoice
- Description: clean-up the field
- Details block:
1) Batch group: any option from the dropdown list 2) Vendor name: use Organization lookup to find and select GOBI Library Solutions (which will also automatically fill in the Accounting code) 3)Payment method: any option from the dropdown list.
3. Create a new "Action Profile" with a unique valid name and with the next properties in it: - Action: Create
- FOLIO record type: Invoice
- Link the field mapping profile from step#2.
4. Create a new "Job profile" with a unique valid name in it and with the next properties in it: - Accepted data type: EDIFACT
- Link an action profile from step#3.
5. Upload a valid EDIFACT file using Job profile from the previous step. 6. Wait till the file is uploaded. 7. Check log UI and summary to see the record with the upload result. 8. Pay attention on the 'Invoice' column in the 'Created' row. Expected Results: The '0' number of created invoices is displayed in cells in the row with the 'Created' row in the 'Summary' table in logs. Actual Results: The '18' number of created invoices is displayed in cells in the row with the 'Created' row in the 'Summary' table in logs. NOTE: Recreated on Poppy Bugfest: | 2023-11-23 | Tetiana Paranich |
| Dec 13 2023 Data Import Subgroup meeting |
MODSOURMAN-1094
-
Getting issue details...
STATUS
|
|
8 | | Investigate deleting old versions of records from SRS, SPIKE | When SRS records are updated, the previous version is marked as old (and the newest version is marked as actual), but the older versions are not deleted. Over time, many, many previous versions of records will build up in SRS and potentially affect performance. Click here to expand... If we wanted to remove the old records, how complicated would that be, and what might we need to take into consideration? KS: there are also lots of "trash" data saved to SRS as a result of failed or stopped imports (records linked to a snapshot/jobExecution that is Cancelled or records that don't have 999 ff i UUIDs) - consider ways to clean up that data as well. - Developers
- If UI import log related to the previous version of a record has not yet been deleted, what would happen if an SRS record related to the log was deleted. Would it break the log? Can we prevent SRS records from being deleted if they are still connected to an import log in the UI?
- Should we plan to keep the current and most recent previous? (would that be helpful for when we implement the rollback feature?)
- Would there be any issues related to the various UUIDs assigned during imports?
- Would there be any issues related to
- quickMARC updates?
- LDP data extracts?
- Data export
- OAI-PMH
- OK for it to apply to all SRS records? all 3 MARC types, EDIFACT invoices?
- How often to run the cleanup? Make it variable in the MOD or UI settings?
- How much effort would this be? T-shirt sizes for UI and BE
- SMEs
- Would this be helpful? Do we have any way to measure or estimate the impact on SRS/Import performance before implementing?
- Any requirements?
- Any questions or concerns?
Results of this spike - Wiki page with design
- All required Jira stories
- T-shirt sizes for UI and MOD
- Decide if this is a separate feature or just a couple of stories
| 2022-08-16 |
|
|
|
MODSOURMAN-857
-
Getting issue details...
STATUS
|
|
9 | | Not able to use the system generated match profiles | I am attempting to create a new job profile for single record import to get rid of the junk fields. I was able to do this a while back on our test tenant and today I was finally able to get around to creating it on our production tenant. Click here to expand... However, when I went to add the Match profile (Inventory Single Record - Default match for existing SRS record) which is a system generated profile, it did not appear as one of the options. When I look at the Action profiles, I am able to choose system generated ones, so the problem is only with the Match profiles. We are on Orchid-SP-5. I was also able to recreate the issue on Snapshot. (I don't have Bugfest access so I did not try that.) Steps to Reproduce: - Log into FOLIO Snapshot
- Go to Settings–>Data Import–>Job Profiles–>Actions–>New Job Profile
- Under Overview, click on the plus sign
- Choose Match
Expected Results: A list of all Match Profiles (both system provided and locally created) is shown Actual Results: Only locally created Match Profiles are shown (if there are none, you get "no results found") Additional Information: When I did my original creation of the job profiles in May, our test tenant would have been on Orchid-SP-3 or 4, so this seems to be something that was introduced in one of the patches since then. | 2023-09-14 |
|
|
|
UIDATIMP-1521
-
Getting issue details...
STATUS
|
|
10 | | Data Import log displays ambiguous information for successful matches on anything but 999i/instance uuid | f your match profile matches incoming MARC 020 on instance ISBN, and the incoming MARC record matches an instance, the reported status in the log of the SRS record will be Updated if the MARC record also contains a 999-ff-i matching the instance's UUID, but Created if the incoming MARC record does not contain a 999-ff-i. In both cases the status reported for the instance in the log is Updated. Click here to expand... To a librarian wishing to overlay existing FOLIO records with matching incoming MARC record, it is a source of great confusion that, when there is a match and an underlying SRS record, the status of the SRS record is sometimes reported as Updated and sometimes as Created – even if you are matching on the same field, overlaying the same record. This may cause enough uncertainty about whether Data Import works as expected, overlaying the right records when it should, to make the librarian reluctant about using Data Import. It seems that either - there is something wrong in how FOLIO creates/updates existing SRS records when matching on anything but the UUID in 999i
or - the information about SRS update/creation displayed in the log is incorrect or designed in a way that is more confusing than useful to end users (librarians)
It would be great, if as a first step, someone with insight into how Data Import works could review the current behaviour to assess whether librarians can "safely" use Data Import with match profiles even though the log shows this ambiguous result. Steps to Reproduce: To test, you need: - a FOLIO instance with an underlying SRS record
- three .mrc files: one with the UUID of the instance in 999i, one without a 999i field but with the ISBN of the instance in 020a, and one with a 999i field that contains a value which is not an instance UUID.
Use the following job profile: https://bugfest-kiwi.folio.ebsco.com/settings/data-import/job-profiles/view/5d105836-e127-48f4-a942-dec42ef265e6 Try the following three: - Using a job profile that matches on identifier ISBN, import a MARC record that contains a 999i field with a FOLIO identifier.
- Using a job profile that matches on identifier ISBN, import a MARC record that does not contain a 999i field with a FOLIO identifier.
- Using a job profile that matches on identifier ISBN, import a MARC record that contains a 999i field with the value "catsarecute"
Expected Results: - Using a job profile that matches on identifier ISBN, import a MARC record that contains a 999i field with a FOLIO identifier.
The incoming 020 of the incoming MARC record successfully matches on the ISBN of the instance. In the log, instance and SRS have status Updated.
- Using a job profile that matches on identifier ISBN, import a MARC record that does not contain a 999i field with a FOLIO identifier.
*The incoming 020 of the incoming MARC record successfully matches on the ISBN of the instance. In the log, instance and SRS have status Updated.
- Using a job profile that matches on identifier ISBN, import a MARC record that contains a 999i field with the value "catsarecute"
The incoming 020 of the incoming MARC record successfully matches on the ISBN of the instance. In the log, instance and SRS have status Updated.
| 2022-05-30 |
|
|
|
MODSOURMAN-848
-
Getting issue details...
STATUS
|
|
11 | | Field is shown after being removed via data import when field mapping profile has rule allowing updates for this field | Field is shown after being removed via data import (when field mapping profile has rule allowing updates for this field) Click here to expand... Preconditions: - The job profile for updating existing "MARC bib" records should be created for "Data import" app: " Update MARC Bib by matching 999 ff $s subfield value (830 - update all) ". Related field mapping profile should have following rule in "Field mapping" accordion:
Field: 830 In.1: * In.2: * Subfield: *. - The system must have at least 1 "MARC Bibliographic" record which has fields linked to at least 1 "MARC Authority" record.
- In Orchid Bugfest
- The "830" MARC field with "$a" value "Cambridge tracts in mathematics" of imported "Instance" record must be linked to the "100" field of imported "MARC Authority" record ("Cambridge tracts in mathematics and mathematical physics").
- Authorized user with the following permissions:
Data import: Can upload files, import, and view logs Inventory: All permissions MARC Authority: View MARC authority record quickMARC: Can Link/unlink authority records to bib records quickMARC: View, edit MARC bibliographic record UI: Data export module is enabled
- User is on "Inventory" pane with search results for "Instance" record which was linked with "MARC Authority" (see Precondition, e.g.: "The algebraic theory of modular systems / by F.S. Macaulay.").
Steps to Reproduce: - Check the checkbox that is displayed next to the "Instance" record which is linked to "MARC Authority" records on the search result pane.
For example: "The algebraic theory of modular systems / by F.S. Macaulay.". - Click on the "Actions" button on the second pane and select "Export Instances (MARC)" option.
- Go to "Data export" app.
- Download exported ".mrc" file by clicking on the "File name" column value.
- Open downloaded ".mrc" file via "MarcEdit" (or any similar app).
- Delete the linked field (see precondtions): "830" field
- Save the edited ".mrc" file.
- Go to the "Data import" app >> Click on the "or select files" button >> Select the updated ".mrc" file (see previous step) >> click the "Open" button
- Click on the created in precondition "Update MARC Bib by matching 999 ff $s subfield value (830 - update all)" job profile >> Click on the "Actions" in the appeared third pane >> Select "Run" option >> Click on the "Run" button in appeared modal.
- Find updated record in "Inventory" app
- Click on the "Actions" button and select "Edit MARC bibliographic record" option from the expanded menu.
Expected Results: Deleted "830" field (see step 6) is not shown. Actual Results: Deleted "830" field (see step 6) is shown and has divided boxes (see attached screencast). | 2023-03-09 |
|
|
|
MODSOURCE-691
-
Getting issue details...
STATUS
|
|
12 | | match on 035$a with qualifier fails | When updating an SRS record using a match on the 035$a with a qualifier on the incoming MARC record, the match fails. Click here to expand... Steps to Reproduce: - Log into bugfest-poppy.
- Open Data Import and look at Job 10638.
- Job Profile = CAH Update SRS MARC on 035$a match w/ qualifier
- This profile matches MARC to MARC on the incoming 035$a with a qualifier exactly matching the 035$a of the existing record : (MiFhGG)galncbln000092 -> galncbln000092.
- For matches, the record is updated overriding the protection on the 856.
- Sample test records = 51356_test_records.mrc
Expected Results: The job matches the incoming records to the SRS records associated with in10783235 and in10783236 and updates these records with the new 856 in the incoming MARC record. Actual Results: The incoming records are not matched, the log for SRS MARC says 'No action', and the SRS record is not updated. Additional Information: I tested the Field Mapping Profile without the 856 protection and it still failed (Job 10641). When reviewing logs on an internal system, the error messages given note that a match is not found. Additional testing was done on changing the 'Match criterion' of the existing record and no value was found to make the Match profile successful. Original testing done in an Orchid environment. | 2023-11-15 | |
| 2024-1-31 Data Import Subgroup meeting |
MODDICORE-386
-
Getting issue details...
STATUS
| Ryan to review Jira with Folijet leads to understand current design and identify requirement gaps Partial matching, e.g. begins with, ends with, is required but it does not function as it should. Only exact matching seems to work. |
13 | | data import sorts protected fields out of order after update | Field protections moves the protected field to the first Nxx field. For instance, if the protected field is a 541, the protected 541 becomes the first of all 5xx tags. (see screen shot attached.) Click here to expand... Steps to Reproduce: - Log into folio-snapshot as diku_admin.
- Go to settings > Data import > field protections and add the 541 tag as a protected field.
- In settings > data import create a new update instance mapping and action profile. The profile can be empty or the status / statistical code/ cataloged date can be changed.
- Create a new match profile on the 999ff$i to instance uuid.
- Create a new job using the new match profile and instance uuid.
- Use the default import profile to create a new record in the system that has a 541 tag.
- Go to inventory and locate the newly created record. Select the record and then use the Action menu to export the instance.
- Open the newly created and edit the 541 in QuickMarc so that you will know that this was the existing 541 record. Save the record.
- Use data import to overlay the FOLIO record. There should be two 541s in the record. The existing 541 (protected) will be the first 5xx field in the record and the newly imported 541 will be in its existing place in the record.
Expected Results: Both 541 fields will be next to each other filed according to their previous position. I think it can be assumed that protected 541 will be the first 541 in the new record where both 541 fields are present. Actual Results: The protected 541 is filed at the beginning of all 5xx fields in the record and the new 541 is in place as it was in the incoming file. | 2023-05-08 |
| |
|
MODDICORE-358
-
Getting issue details...
STATUS
|
|
14 | | Subfield can't be removed when updating Marc bib upon import | Subfield cannot be removed when updating "MARC Bib" upon import when field mapping profile has rules allowing update of several subfields in all fields (including the subfield which is being added) Click here to expand... Preconditions: • The job profile should be created for "Data import" app: "Update MARC Bib records by matching 999 ff $s subfield value (subfields 1, 2)" • "Match profile" should have following specified: Field: 999 Ind 1: f Ind 2: f Subfield: s - Action profile should be Update MARC Bib
• "Field mapping profile" should have following rules specified: Update specific fields only Field: * In.1: * In.2: * Subfield: 1. Field: * In.1: * In.2: * Subfield: 2. No Field protection overrides • Attached "MARC Bib" record should be imported to the system via "Default - Create instance and SRS MARC Bib" job profile (it has subfields "$1", "$2" in two fields) Steps to Reproduce: - Export previously imported "MARC Bib" record from Preconditions (For preconditions, use MARC_bib_Black_panther_five_nonRepeatable_linkable_fields.mrc file attached to this Jira, and import using the default Create MARC Bib and Instance job profile)
- Open exported .mrc file in "MarcEdit" or similar editor
- In 130 field: delete "$2" subfield and update "$1" subfield value (e.g., change "$1" value to "new")
- In 240 field: delete "$2" subfield and add one more "$1" subfield (e.g., add "$1onemore")
- Save updated file
- Import updated file using "Update MARC Bib records by matching 999 ff $s subfield value (subfields 1, 2)" job profile created in Preconditions
- Open updated "MARC Bib" record for edit ("Actions" → "Edit MARC bibliographic record")
Expected Results: "$2" removed from both edited fields. Following "$1"subfield values are shown in fields: - "130" field: "$1new"
- "240" field: "$1original $1onemore"
Actual Results: "$2" subfields are not removed from edited fields. "$1" subfields updated/added as expected | 2023-06-01 |
|
|
|
MODDICORE-353
-
Getting issue details...
STATUS
|
|
15 | | Fields duplicated when adding one subfield when updating Marc bib upon import | Fields duplicated when adding one subfield when updating "MARC Bib" upon import when field mapping profile has rules allowing update of several subfields in all fields (including the subfield which is being added) Click here to expand... Preconditions: • The job profile should be created for "Data import" app: "Update MARC Bib records by matching 999 ff $s subfield value (subfields 1, 2)" • "Match profile" should have following specified: Field: 999 Ind 1: f Ind 2: f Subfield: s - Action profile should be: Update MARC Bibs
• "Field mapping profile" should have following rules specified: Update specific fields: Field: * In.1: * In.2: * Subfield: 1. Field: * In.1: * In.2: * Subfield: 2. No overrides to MARC field protection • Attached "MARC Bib" record should be imported to the system via "Default - Create instance and SRS MARC Bib" job profile Steps to Reproduce: - Export previously imported "MARC Bib" record from Preconditions
- Open exported .mrc file in "MarcEdit" or similar editor
- Add "$1" subfield values in with no "$1" (e,g.:
- add "$1555555" to "035" field
- add "$1test" to "264" field
- Save updated file
- Import updated file using "Update MARC Bib records by matching 999 ff $s subfield value (subfields 1, 2)" job profile created in Preconditions
- Open updated "MARC Bib" record for edit ("Actions" → "Edit MARC bibliographic record")
Expected Results: "$1" added to edited "035", "264" fields. Fields were not duplicated Actual Results: "035", "264" fields were duplicated. First copy of each remains unchanged (no added subfield), while second copies contain added "$1" subfield | 2023-06-01 |
|
|
|
MODDICORE-352
-
Getting issue details...
STATUS
|
|
16 | | Fields duplicated when adding several subfields when updating marc bib upon import | Fields duplicated when adding several subfields when updating "MARC Bib" upon import when field mapping profile has rules allowing update of corresponding subfields in corresponding fields Click here to expand... Preconditions: • The job profile should be created for "Data import" app: "Update MARC Bib records by matching 999 ff $s subfield value (240, 600)" • "Match profile" should have following specified: Field: 999 Ind 1: f Ind 2: f Subfield: s - Actin profile should be: Update MARC Bibs
• "Field mapping profile" should have following rules specified: Update specific MARC fields Field: 240 In.1: * In.2: * Subfield: 1. Field: 240 In.1: * In.2: * Subfield: 2. Field: 600 In.1: * In.2: * Subfield: 1. Field: 600 In.1: * In.2: * Subfield: 2. No overrides to the existing field protections • Attached "MARC Bib" record should be imported to the system via "Default - Create instance and SRS MARC Bib" job profile Steps to Reproduce: - Export previously imported "MARC Bib" record from Preconditions
- Open exported .mrc file in "MarcEdit" or similar editor
- Add "$1" and "$2" subfields to "240" field (e.g., add "$1test$2testing")
- Add "$1" and "$2" subfields to one of the "600" fields (e.g., add "$1test$2testing" to the third "600" field)
- Save updated file
- Import updated file using "Update MARC Bib records by matching 999 ff $s subfield value (240, 600)" job profile created in Preconditions
- Open updated "MARC Bib" record for edit ("Actions" → "Edit MARC bibliographic record")
Expected Results: "$1", "$2" added to edited "240", "600" fields. Fields were not duplicated Actual Results: "240", "600" fields were duplicated. First copy of each remains unchanged (no added subfields), while second copies contain added "$1", "$2" subfields | 2023-06-01 |
|
|
|
MODDICORE-351
-
Getting issue details...
STATUS
|
|
17 | | Job summary: error column does not display errors | When there is any error related to an instance/authority/orders/invoice, the error column does not display it. | 2024-01-25 |
|
|
|
UIDATIMP-1590
-
Getting issue details...
STATUS
|
|
18 | | Field mapping profiles: state of the final form fields is not set | When switching between Folio record types fields with the same name do not reset the state (value, dirty, etc.), although the field values are equal to the initial. Current workaround: start over/refresh page | 2021-06-30 |
|
|
|
UIDATIMP-947
-
Getting issue details...
STATUS
|
|
19 | | Incorrect quantity is displayed in the cell of no action and error rows at the individual import job's log | The '1' number of Instance is displayed in cell in the row with the 'No action' and 'Error' rows header in the 'Summary table' at the individual import job's log. | 2024-01-19 |
|
|
|
MODSOURMAN-1117
-
Getting issue details...
STATUS
|
|
20 | | The status of srs marc is created after match+modify action | Expected Results: The status of SRS MARC is 'Updated' in the Import log after uploading MARC file for update. | 2023-03-07 |
|
|
|
MODDATAIMP-1008
-
Getting issue details...
STATUS
|
|
21 | | PMSystem displayed as source in quickmarc view when record was created by non matches action of job profile | "PMSystem" displayed as source (instead of User's last and first name) in "Edit MARC authority record" view when record was created by "Non-matches" action of job profile. | 2023-03-07 |
|
|
|
MODSOURCE-608
-
Getting issue details...
STATUS
|
|
22 | | Duplicate field is added when updating $0 in linked marc bib field upon data import if field mapping profile allows $0 update | Duplicate field is added when updating "$0" in linked "MARC bib" field upon data import if field mapping profile specifically allows "$0" update | 2023-02-15 |
|
|
|
MODSOURCE-594
-
Getting issue details...
STATUS
|
|
23 | | Single record overlay creates duplicate oclc #/035 | When "Overlay source bibliographic record' is employed for the first time, duplicate 035 fields are created. ** | 2023-04-12 |
|
|
|
MODDICORE-339
-
Getting issue details...
STATUS
|
|
24 | | Invoice level adjustments do not work | When loading an EDIFACT invoice using a field mapping profile with invoice-level adjustments, the adjustments error | 2021-03-29 |
| Kimberly Pamplin |
|
MODDICORE-125
-
Getting issue details...
STATUS
|
|
25 | | Invoice line level adjustments don't work | When loading an EDIFACT invoice using a field mapping profile with invoice-level adjustments, the adjustments error | 2021-03-29 |
| Kimberly Pamplin |
|
MODDICORE-124
-
Getting issue details...
STATUS
|
|
26 | | Data import incorrectly maps Resource type for no display constant generated | | 2023-04-19 |
|
|
|
MODDATAIMP-804
-
Getting issue details...
STATUS
|
|
27 | | Incorrect behavior of "Delete Files" button | Note: Does not always reproduce "Delete files" request deletes the file, but does not always show in the UI Delete request returns "Cannot delete uploadDefinition 09ef7415-34e4-44cd-9af3-31953df9f200 - linked files are already being processed". | 2022-06-02 |
|
|
|
MODDATAIMP-691
-
Getting issue details...
STATUS
|
|
28 | | Status descending sort on Data Import view all page not working | In Honeysuckle Bugfest, on the Data Import View all, the status sort ascending works, but not descending | 2020-12-09 |
|
|
|
UIDATIMP-798
-
Getting issue details...
STATUS
|
|
29 | | MARC holdings update log has additional empty row | MARC Holdings update log has additional empty row. If two "MARC Holdings" records are updated by one job, then 2 additional empty rows will be displayed. | 2023-05-01 |
|
|
|
MODSOURMAN-983
-
Getting issue details...
STATUS
|
|
30 | | Data Import field mapping profile is saved with data deleted from the system | The user can save a mapping profile with data that has been deleted from the system. | 2022-08-19 |
|
|
|
MODDICONV-290
-
Getting issue details...
STATUS
|
|
31 | | Alert modal with error message is displayed on page after entering '##*' characters and clicking on search button | | 2022-06-10 |
|
|
|
MODDICONV-250
-
Getting issue details...
STATUS
|
|
32 | | DI Log: Title missing but status reads updated | | 2023-10-24 |
|
|
|
MODSOURMAN-1069
-
Getting issue details...
STATUS
|
|
33 | | Asynchronous migration is not completed | The asynchronous migration script was run but migration has not been completed, the migration job is still IN_PROGRESS. | 2023-06-04 |
|
|
|
MODSOURCE-665
-
Getting issue details...
STATUS
|
|
34 | | RRT - Invoices don't display fund codes | Institution specific - MI State Univ./ Library of Michigan | 2024-01-04 |
|
|
|
MODINVOSTO-173
-
Getting issue details...
STATUS
|
|
35 | | Review and fix Marc updates for individual fields | Currently (as of Orchid), the Data Import MARC Updates for specific fields do not handle repeatable fields properly. The logic needs updating, and UI may need updating to indicate how incoming repeatable MARC fields should be handled vis-a-vis the same repeatable field(s) in the existing SRS MARC Bib. This is similar to how the field protection logic needed updating to handle repeatable vs non-repeatable fields properly. | 2023-02-20 |
|
|
|
UXPROD-4080
-
Getting issue details...
STATUS
|
|
36 | | Job profile with POL/VRN match cascade does not finish properly | Some Inventory records (Instances/Holdings/Items) get created when orders are opened, depending on the Inventory setting in the POL. During testing of POL/VRN matching, I noticed that some holdings being updated by importing MARC Bibs were having their source changed from FOLIO to MARC. We need to ensure this DOES NOT happen. | 2022-05-25 |
|
|
|
MODINV-709
-
Getting issue details...
STATUS
|
|
37 | | Poppy data import log does not include links to records for SRS updates. | For SRS updates with no instance update, the changes to the import logs have resulted in no record links in the log. Before the log indicated that the instance was updated and included a link to the instance. Now, the log indicates that the SRS record is updated, but there is no link. I am guessing it is because there is no SRS record per se in FOLIO. Can we revisit the decision to not display the instance update status with a link? Or add a link to the instance to the SRS updated status? PPT from Data Import subgroup work: From this spreadsheet it appears that the instance should also be updated and provide the record link:
. |
|
|
|
|
MODDATAIMP-984
-
Getting issue details...
STATUS
MODSOURMAN-1106
-
Getting issue details...
STATUS
|
|
38 | | Partial matching doesn't work | Partial matching, e.g. begins with, ends with, is required but it does not function as it should. Only exact matching seems to work. | 2021-01-25 | Yael Hod (Stanford) Corrie Hutchinson (Unlicensed) Chicago |
| 2024-1-31 Data Import Subgroup meeting |
MODDICORE-386
-
Getting issue details...
STATUS
| - Review Jira with Folijet leads to understand current design and identify requirement gaps.
|
39 | | RRT, 5C match bug | Problem of match that didn't match
| 2023-09-28 |
|
|
|
MODINV-882
-
Getting issue details...
STATUS
|
|
40 | | Duplicate records in incoming file causes problems after overlay process with no error reported | When overlaying instance records, if the incoming file has duplicate records and therefore multiple incoming matches for one match in FOLIO, the record that was overlaid in FOLIO cannot be opened using quickMARC. Note: In this scenario the incoming file has the duplicate records and therefore duplicate match points. FOLIO does not have duplicates. | 2021-12-15 |
|
|
|
MODSOURCE-530
-
Getting issue details...
STATUS
|
|
41 | | Add new subfields to Electronic access (856) | New subfields in the MARC 856 field need to be represented in Inventory data. The same elements should appear in the electronic access block in Instance, Holdings, and Item records. https://www.loc.gov/marc/bibliographic/bd856.html
| 2023-09-14 |
|
| 2024-7-10 Data Import Subgroup meeting |
UXPROD-4467
-
Getting issue details...
STATUS
|
|
42 | | Enforce an order to deletion for Data Import profiles | There needs to be an enforced order to deletion for Data import profiles to prevent this or there should be a confirmation window that lets you delete associated match/action profiles with the job profile if they aren't in use in another Job profile Click here to expand... From 2024-01-31 chat: Technically, not true Lynne. I accidentally deleted a job profile without unlinking stuff first (which I was not stopped from doing). I was then not allowed to delete the associated profiles because they needed to be unlinked first, which I could not do because I could no longer get to the job profile to unlink them. | 2024-01-31 |
|
| 2024-2-28 Data Import Subgroup meeting 2024-7-10 Data Import Subgroup meeting |
MODDATAIMP-1026
-
Getting issue details...
STATUS
MODDICONV-388
-
Getting issue details...
STATUS
| - Developers will look into this
|
43 | | There needs to be a warning or error to stop the job when a job contains no action profiles.
| If a job doesn't have any actions, nothing happens and there is a risk that the records are corrupted.
| 2021-02-08 | Sara Colglazier Jenn Colt Christie Thomas |
| 2024-2-28 Data Import Subgroup meeting 2024-7-10 Data Import Subgroup meeting |
MODDICONV-373
-
Getting issue details...
STATUS
| - Ryan will ask what the behavior is for when actions are missing and you try to run a job or if you can edit a job with no actions.
Behavior now in FOLIO snapshot |
44 | CLOSED | When importing EDIFACT files, invoices lines aren't in order | When importing an Edifact file, the invoices lines aren't in order. | 2024-02-06 | Corrie Hutchinson, Jennifer Eustis | Kimberly Pamplin |
|
MODDATAIMP-995
-
Getting issue details...
STATUS
type |
key |
summary |
assignee |
reporter |
priority |
status |
resolution |
created |
updated |
due |
|
|
45 | CLOSED | Data import job profile will not create multiple holdings/items when conditional mapping is used in field mapping profiles | Overview: The Poppy release introduced functionality to create multiple holdings and items from a single MARC bib, using data from 9xx fields in the MARC record (see UXPROD-2741: Import of MARC Bibs to create/update multiple holdings and items: BE workCLOSED ) However, if the holdings or item field mapping profile contains a conditional mapping (e.g. Permanent holdings location = 945$a; else “LOCCODE”), only the first specified 9xx field will be used to create a single holdings/item. Click here to expand... Steps to Reproduce: Log into Poppy Bugfest as a user with admin permissions. Create a job profile using the steps here: https://foliotest.testrail.io//index.php?/cases/view/388505 On the holding field mapping profile, update the Permanent location mapping to be 945$h; else "1 hour earlier (1he)"
Case 1: Use the .mrc file attached to the Testrails and import using the job profile created in Step 2.
Expected Results: Multiple holdings and items are created. Actual Results: Only a single holdings/item representing the first 945 field is created. Case 2: Modify holdings mapping profile to contain Permanent location mapping 945$h Import attached NoLocationMarcField.mrc file
Expected Results: Job finished with status “Completed with errors“, error log for holdings says that permanent location should be not null Actual Results: Job finished with status “Completed with errors“, error log for holdings show StackTraceThrowable exception Additional Information: Removing the ; else “LOCCODE” produced expected results. See my tests by looking at the logs for 12177 (successful creation of multiple holdings/items) and 12180 (only created single holdings/item). The MARC records used for these examples and the job profiles are listed within the log. |
| Molly Driscoll |
|
|
MODDICORE-394
-
Getting issue details...
STATUS
| - Request to be added to Poppy CSP 2
|
46 | CLOSED | Item creation using Data Import is missing data | Overview : When importing a MARC bibliographic record with 9xx fields designating order, holdings, and item record data, the enumeration and copy number fields of the item record fail to populate as instructed. | 2024-02-27 | Corrie Hutchinson (Unlicensed), Christie Thomas |
|
|
MODDATAIMP-1009
-
Getting issue details...
STATUS
|
|
47 | IN PROGRESS | Ability to change the link to a profile rather than just remove it | Current situation: We are only able to link or unlink profiles (field mapping to action, action to a job, match to a job, etc). New Feature: We want to be able to change the link rather than just unlink Expected behavior: There is another option that allows the user to change the link to a different profile. Use case: The wrong profile was used and the new one needs to be added. Rather than unlinking everything, it'd be easier to just update the link to the correct one. | 2024-02-27 | Jennifer Eustis |
| 2024-2-28 Data Import Subgroup meeting 2024-7-10 Data Import Subgroup meeting |
| - Ryan will create a ticket. This might involve rethinking the profiles page setup.
|
48 | CLOSED | Quantity = 0 in POL for order format equal to electronic | Overview : When creating orders with an order format of electronic, an instance, and a holdings records from a MARC bibliographic record using Data Import, the quantity in both the ‘Cost details' and ‘Location’ section of the POL is ‘0' despite the field mapping profile instructing it be '1’. A nearly identical profile for order format equal to print does not display this behavior. | 2024-02-27 | Corrie Hutchinson (Unlicensed), Christie Thomas |
|
|
MODDATAIMP-1010
-
Getting issue details...
STATUS
|
|
49 | CLOSED | DI Jobs stall when matching on a holdings and/item nested under an instance |
| 2024-03-01 | Christie Thomas |
| 2024-2-28 Data Import Subgroup meeting | | |
50 | OPEN | Unable to pull vendor account number from POL when importing EDIFACT invoices | In our previous system the vendor account number lived at the PO/Invoice level. Now it is on the POL/invoice line. I have not found a way when loading EDIFACT invoice files to draw this directly from the POL or to retrieve it from the vendor file. This means for each invoice we must put in all of the vendor account numbers manually, which adds up and is prone to error. If there is a way that data import could pull this value from the POL it would save so much time in our processing. | 2024-04-12 | Kimberly Pamplin |
| 2024-7-10 Data Import Subgroup meeting |
| |
51 | CLOSED | Import profile with Instance match to POL and Vendor Reference Number not working | Overview: Vendor records were received containing the POL and Vendor Reference Number (VRN) are not matching to the source = FOLIO Instance records that the GOBI API created through the Orders app. Click here to expand... Current workaround: No workaround Steps to Reproduce: Log into Orchid bug-fest Create brief pending order records using POL numbers and Vendor Reference numbers from MARC file Use Import job profile: GOBI API eBooks - Full cataloging Upload records and run job Vendor Reference Numbers and POL numbers must be unique. If running the import job multiple times, you must change these data points in the MARC records.
Expected Results: Match on the PO Line and then the Vendor Order Reference number before updating the Instance record with full cataloging record and the holdings item with the correct holdings type and permanent location Actual Results: Records are all discarded | 2023-08-03 | Lynne Fors | All |
|
MODINV-876
-
Getting issue details...
STATUS
| Fix is in Quesnelia Formerly UIDATIMP-1506 |
52 | IN PROGRESS | Additional values needed for Electronic access fields or 856 subfields | Issue: Right now, only a few subfields from the 856 are mapped. We would like to expand that ability to include the non public note (856$x), access status (856$7) and terms governing access (856$n). |
| Jennifer Eustis | All | 2024-7-10 Data Import Subgroup meeting |
UIIN-2579
-
Getting issue details...
STATUS
| - Ryan will also look into mapping indicators.
- Need to account for all Inventory record types
- Need to account for bulk edit, data import/export, ???
|
53 | IN PROGRESS | Ensure consistency of UI for blank indicators between Bulk Edit, Data Export, quickMarc, and Data Import | Issue: Data Import displays blanks with a space. Quickmarc is a slash and so on. To avoid confusion, it'd be great to make sure that blank indicators and how marc fields and subfields are mapped in bulk edit, data import, and data export are done in a consistent way. | 2024-02 | Jennifer Eustis | All | 2024-7-10 Data Import Subgroup meeting |
| - Ryan is bringing this topic to Magda and Christine to discuss.
|
54 | IN PROGRESS | Reporting: Have the ability to download a list of instance, holdings, or item record identifiers that were successfully imported | Issue: There isn't a way to retrieve a list of identifiers through the Data Import log. | 2024-07-11 | Jennifer Eustis | All |
|
| - Ryan will look into making row 54-56 as one epic that has smaller stories.
|
55 | IN PROGRESS | Reporting: Have the ability to save a list of successfully imported records to a list in the Lists App | New Functionality. In addition to downloading a list, it would be great to be able to save the imported identifiers to a list in the Lists App | 2024-07-11 | Jennifer Eustis | All |
|
|
|
56 | IN PROGRESS | Reporting: Have the ability to download a list of errors from an import | Issue: The only way to see errors is to navigate in the log and to click on the title to see the jason. Having an export like in Bulk Edit would be helpful. | 2024-07-11 | Jennifer Eustis | All |
|
UIDATIMP-914
-
Getting issue details...
STATUS
|
|
57 | OPEN | Ability to view application log | When DI was in the planning phase with, there was a request to be able to view the application log. Examples were provided from other systems. This is still needed | 2024-08-15 | Lab Session | ALL |
|
|
|