Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Importing a file of 25,000 authority records does not complete

Description

URL: https://metadata.ci.folio.org or Lotus Bugfest
Metadata Login: diku_admin / admin or Lotus Bugfest

  1. Go to data import

  2. Import a file of 25,000 authority records

  1. Use the job profile: Default - Create SRS MARC Authority

  2. Hit Run

Expected outcome: 25,000 authority records are created and job completes

Actual outcome: 25,000 authority record job never completes. It hangs on 99%

25,000 record is attached.

Another issue identified by

During Create MARC authority import we have got error on mod SRS 

[vert.x-worker-thread-10] ERROR rdChunksKafkaHandler [72160511eqId] RecordCollection processing has failed with errors with event: 'null', chunkId: '6c96f806-e9f5-4720-b680-b44361a3a0e7', chunkNumber '2119'-'19' with recordId: 'null'

 

Steps to reproduce:

using

start import MARC authority

CSP Request Details

None

CSP Rejection Details

None

Potential Workaround

None

Attachments

9

Checklist

hide

TestRail: Results

Activity

Show:

Khalilah GambrellMarch 28, 2022 at 5:43 PM

 and . Thank you. Let me ask the group that provided msplit00000001.mrc  file to see if we can review the data provided. 

Roman_FedynyshynMarch 28, 2022 at 2:50 PM

fixed.
now process can be completed in 9 minutes without the errors 

Serhii_NoskoMarch 28, 2022 at 2:41 PM

Hi ,
Today after all fixes deployed I have been tested importing of msplit00000003.mrc on the Lotus bugfest env and it has been completed successfully.

Regarding file msplit00000001.mrc - it stucks on my local and runcher(so I have not tested in on bugfest), because last chunk does not arrive for processing, I assume its due some corruptions with the mrc file(not DI import).
does this file msplit00000001.mrc important for you to continue investigation or it was just some test file?

Ann-Marie BreauxMarch 23, 2022 at 1:12 PM

Hi please recheck on Lotus Bugfest after the Bugfix releases of and to see if the 25K import completes successfully.

Khalilah GambrellMarch 22, 2022 at 12:06 AM

, if you have any thoughts on this issue please let us know. This issue has been open since Jan 27th. 

Done

Details

Assignee

Reporter

Labels

Priority

Story Points

Development Team

Spitfire

Parent

Release

Lotus R1 2022

RCA Group

TBD

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs

Created January 27, 2022 at 9:53 PM
Updated April 11, 2022 at 12:52 PM
Resolved March 28, 2022 at 2:50 PM
TestRail: Cases
TestRail: Runs