Data import job stuck in progress with 99-100% on OKAPI and Eureka bugfest environments when do bulk edit of ~100K MARC Instances on specific dataset
Description
CSP Request Details
CSP Rejection Details
Potential Workaround
Attachments
- 14 Mar 2025, 08:51 AM
- 13 Mar 2025, 02:36 PM
- 13 Mar 2025, 02:36 PM
- 06 Mar 2025, 01:12 PM
- 06 Mar 2025, 01:12 PM
- 06 Mar 2025, 01:12 PM
- 06 Mar 2025, 01:12 PM
- 05 Mar 2025, 02:24 PM
- 05 Mar 2025, 02:24 PM
- 07 Feb 2025, 11:54 AM
- 07 Feb 2025, 11:54 AM
- 06 Feb 2025, 01:31 PM
blocks
is blocked by
Checklist
hideActivity
Aliaksandr Fedasiuk 22 hours ago
About stuck import on the https://eureka-bugfest-ramsons.int.aws.folio.org/
The main reason for this is the unstable environment (problem with connection to the DB): Timeout for DB_HOST:DB_PORT=db.rebf.folio-eis.us-west-2:5432
Tatsiana Hryhoryeva 2 days ago
So far verification on https://bugfest-ramsons.int.aws.folio.org/ failed, opened https://folio-org.atlassian.net/browse/BF-1145
Tatsiana Hryhoryeva 2 days ago
Verified on https://eureka-bugfest-ramsons.int.aws.folio.org/ environment with the file attached to the ticket, DI job stuck in progress at 94%
There is reindex issue on Eureka Ramsons bugfest: https://folio-org.atlassian.net/browse/BF-1132 , https://folio-org.atlassian.net/browse/MSEARCH-996
Probably, makes sense to repeat verification after successful reindex. Meanwhile going to check the same flow on OKAPI bugfest environment
Kateryna Senchenko last week
Hi @Ryan Taylor, we discussed this issue with @Tatsiana Hryhoryeva and decided to proceed with the release. https://folio-org.atlassian.net/browse/MODSOURMAN-1287 is not relevant for Ramsons, therefore we shouldn’t wait for it to be resolved before back-porting this bugfix. Moving the ticket to Awaiting release. Thank you!
Tatsiana Hryhoryeva March 6, 2025 at 1:12 PM
Re-checked on https://folio-etesting-sprint-fs09000000.ci.folio.org/ environment on the same dataset:
DI job completed without stuck in progress
BE job did not complete - behavior on bulk edit side will need to be rechecked after https://folio-org.atlassian.net/browse/MODSOURMAN-1287
cc: @Magda Zacharska
Details
Details
Assignee
Reporter
Priority
P2
Overview: After recent changes in Data Import the bulk edit of MARC Instances for large number of Instances was retested on OKAPI bugfest environment. Bulk edit job was not completed due to Data import job stuck in progress with 100%
The issue was reproduced before as described in https://folio-org.atlassian.net/browse/MODSOURMAN-1261
Steps to reproduce:
Go to “Bulk edit“ app
Select “Inventory - instances“ record type
Select “Instance UUIDs“ record identifier
Click “or choose file“ button => Upload file with large number of MARC Instances UUIDs (attached)
Click “Actions“ > “Instances with source MARC (POC)“
Select any options/actions to edit MARC fields of Instance records (e.g. add 500 field)
Click “Confirm changes“
Click “Commit changes“
Expected result: Preview of record changed is displayed
Actual result: Committing changes progress is displayed endlessly. Data import job stuck in progress with 100%
Additional information:
On Eureka environment the issue reproduced when done on the same dataset
On OKAPI environment Bulk edit of ~100K MARC Instances completed successfully (done on different dataset)
On Eureka environment Bulk edit of ~100K MARC Instances completed successfully (done on different dataset)
Testrail: https://foliotest.testrail.io/index.php?/cases/view/584452