Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Log entries are empty for completed jobs

Description

The issue can be reproduced on bugfest (non-ECS, ECS) and sprint testing environment. It was identified by bulk edit jobs but the issue can be re-created directly in the Data import using also files that were not generated by bulk edit.

Steps to recreate:

  1. In https://bugfest-ramsons.int.aws.folio.org/ start bulk edit using BF DEFAULT: Match 001 to Instance HRID, then update instance or create new instance data import profile and attached one of the attached files:

    1. 2024-12-12-Updates-Preview-SearchInstanceUUIDs2024-12-12T12_40_52+04_00.mrc

    2. 2024-12-11-Updates-Preview-SearchInstanceUUIDs2024-12-11T11_37_54-05_00.mrc

    3. exported-records.mrc

  2. The job will complete either successfully (first file) or complete with errors (second and third file)

  3. Navigate to import logs for complete jobs

Expected behavior:

Details of the import job are displayed, including the list of affected instance records

Actual behavior:

The error log is empty:

image-20241212-180120.png

 

Additional information:

In Quesnelia bugfest the behavior for importing the same file with the same import profile is as expected:

image-20241212-182348.png

CSP Request Details

None

CSP Rejection Details

None

Potential Workaround

None

Attachments

41
  • 31 Jan 2025, 10:41 AM
  • 30 Jan 2025, 10:39 AM
  • 29 Jan 2025, 02:33 PM
  • 29 Jan 2025, 02:33 PM
  • 29 Jan 2025, 02:33 PM
  • 29 Jan 2025, 02:33 PM
  • 29 Jan 2025, 02:33 PM
  • 29 Jan 2025, 06:00 AM
  • 29 Jan 2025, 06:00 AM
  • 24 Jan 2025, 06:26 PM
  • 24 Jan 2025, 06:26 PM
  • 24 Jan 2025, 02:49 PM

blocks

defines

is blocked by

is defined by

Checklist

hide

Activity

Show:

Tatsiana Hryhoryeva January 31, 2025 at 10:41 AM

After https://folio-org.atlassian.net/browse/MODSOURMAN-1274 bulk edit of 100K MARC Instances checked on OKAPI bugfest environment, log entries returned as expected

2025-01-31_15h41_14.png

Tatsiana Hryhoryeva January 30, 2025 at 10:39 AM

Bulk edit of 100K MARC Instances re-checked on OKAPI bugfest environment, log entries returned as expected

2025-01-30_10h33_20.png

Tatsiana Hryhoryeva January 29, 2025 at 2:33 PM

Verified on Eureka bugfest environment for the following bulk edit of MARC instances two jobs, partially done in parallel:

  • 30K records on non-ECS environment

  • 50K records on ECS environment, Central tenant

Bulk edit jobs completed, log entries returned as expected. Timeout errors also were present, e.g. null,io.vertx.core.impl.NoStackTraceThrowable: Timeout for DB_HOST:DB_PORT=db.rebf.folio-eis.us-west-2:5432

2025-01-29_12h28_09.png
2025-01-29_12h35_59.png

Also, bulk edit of 100K MARC instances verified on OKAPI and Eureka environment in Central tenant, find details below

  • On OKAPI bugfest environment bulk edit of 100K MARC instances stopped moving forward after committing 77K of records

    2025-01-29_18h23_22.png

     

    2025-01-29_15h46_16.png

  • On Eureka bugfest environment bulk edit of 100K MARC instances completed successfully

    2025-01-29_18h18_47.png

Testing will be continued to recheck bulk edit of 100K MARC Instances on OKAPI bugfest environment

Tatsiana Hryhoryeva January 29, 2025 at 6:00 AM

Verified on OKAPI bugfest environment for the following bulk edit of MARC instances two jobs, partially done in parallel:

  • 30K records on non-ECS environment

  • 50K records on ECS environment, Central tenant

Bulk edit jobs completed, log entries returned as expected.

However, there are lots of errors reported from Data import, including "error": "io.vertx.core.impl.NoStackTraceThrowable: Timeout for DB_HOST:DB_PORT=db.rbf.folio-eis.us-west-2:5432"

2025-01-29_08h58_28.png
2025-01-29_08h52_42.png

Testing will be continued for larger number of records on OKAPI bugfest environment, and also on Eureka bugfest environment

Javokhir Abdullaev January 27, 2025 at 7:19 AM

that would be the last option
discussed with Olamide, application level lock when inserting batch records should resolve it
as each instance will persist batch records sequentially without interfering with each other
pr is ready

Done

Details

Assignee

Reporter

Labels

Priority

Story Points

Sprint

Development Team

Folijet

Parent

Fix versions

Release

Ramsons (R2 2024) Bug Fix

RCA Group

Data related (ex. Can be detected with large dataset only)

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs

Created December 5, 2024 at 2:29 PM
Updated January 31, 2025 at 10:41 AM
Resolved January 28, 2025 at 10:25 AM
TestRail: Cases
TestRail: Runs

Flag notifications