Poppy | Import and Update of MARC authority records with enabled "splitting" feature in "Data import" app.

Poppy | Import and Update of MARC authority records with enabled "splitting" feature in "Data import" app.

Purpose:

We need to verify that "Data import splitting feature" works as expected for "MARC authority" records.

Assumptions:

  1. "Splitting" feature works only with ".mrc" format.
  2. Chunk size = 1000 records.
  3. For update tests we can use ".mrc" files with same number of records in it which we used for Create tests.
  4. Created Job profile "KG - Create SRS MARC Authority on nonmatches to 010 $a" should have the following configuration:
    For matches - Update MARC authority record
    For non-matches - Create new MARC authority record

Known issues:

  1. MODSOURCE-709
  2. Errors like described there MODSOURCE-687 (io.vertx.core.impl.NoStackTraceThrowable: Timeout) sometimes appear for files more than 5000 records.
    For example: https://bugfest-poppy.int.aws.folio.org/data-import/log/b89fefac-01ff-4580-ace5-d75f387a769b/bc671d95-91dd-47c8-9589-e91af81c4454


Testing scenarios:

Test #Scenario descriptionMain stepsExpected resultResult (Pass/Fail) AssigneeFiles for testLink to Data import log
1Create 1 record using default job profile - "Default - Create SRS MARC Authority"Upload attached file1 chunk

Pass

Valery_Pilko 
name_title.mrc
https://bugfest-poppy-plus.int.aws.folio.org/data-import/job-summary/ce4a955f-e7a3-4746-a2fb-728c99d9b255
2Create 999 records using default job profile - "Default - Create SRS MARC Authority"Upload attached file1 chunk

Pass

Valery_Pilko 999 records.mrchttps://bugfest-poppy-plus.int.aws.folio.org/data-import/job-summary/95c64ca3-40f3-49ec-acb3-76e0a6d4b053
3Create 1000 records using default job profile - "Default - Create SRS MARC Authority"Upload attached file1 chunk

Pass

Valery_Pilko 1000 records.mrc
4Create 1001 records using default job profile - "Default - Create SRS MARC Authority"Upload attached file2 chunks

Pass

Valery_Pilko 1001 records.mrcID  (Poppy plus) 106, 107
5Create 1999 records using default job profile - "Default - Create SRS MARC Authority"Upload attached file2 chunks

Pass

Valery_Pilko ID  (Poppy plus) 110, 111
6Create 2000 records using default job profile - "Default - Create SRS MARC Authority"Upload attached file2 chunks

Pass

Valery_Pilko ID  (Poppy plus) 114, 115
7Create 2001 records using default job profile - "Default - Create SRS MARC Authority"Upload attached file3 chunks

Pass

ID  (Poppy plus) 118, 119, 120
8Create 10000 records using default job profile - "Default - Create SRS MARC Authority"Upload attached file10 chunksPassID  (Poppy plus) 123-132
9Update 1 record using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"Upload attached file1 chunkPass
name_title.mrc
ID  (Poppy plus) 135
10Update 999 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"Upload attached file1 chunkPass999 records.mrcID  (Poppy plus) 138
11Update 1001 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"Upload attached file2 chunksPass1001 records.mrcID (Poppy) 9381 9382
12Update 5000 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"Upload attached file 5 chunksPass5000 records.mrcID (Poppy plus) 201-205
13Update 10000 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"Upload attached file10 chunksPass10000 records.mrcID (Poppy) 9543-9552
13Create 2500 records using default job profile - "Default - Create SRS MARC Authority"
And at the same time upload another ".mrc" file with 2500 records using default job profile - "Default - Create SRS MARC Authority"
Upload attached files3 chunks in each. 
No crossing in logs
Pass

ID (Poppy plus) 238-240

ID (Poppy plus) 242-244

14Update and Create scenario:
Upload a file with 2 records (1 for update (should exist in the system already) and 1 for create) using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"
Upload attached file1 chunks in total. 1 record should be updated; new 1 record should be createdPass

15Update and Create scenario:
Upload a file with more than 2000 records (some records to update (should exist in the system already) and some records to create) using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"
Upload attached file3 chunks in total. Approx. half of records created, other half updatedPassID (Poppy plus) 302-304