Poppy | Import and Update of MARC authority records with enabled "splitting" feature in "Data import" app.

Poppy | Import and Update of MARC authority records with enabled "splitting" feature in "Data import" app.

Purpose:

We need to verify that "Data import splitting feature" works as expected for "MARC authority" records.

Assumptions:

  1. "Splitting" feature works only with ".mrc" format.

  2. Chunk size = 1000 records.

  3. For update tests we can use ".mrc" files with same number of records in it which we used for Create tests.

  4. Created Job profile "KG - Create SRS MARC Authority on nonmatches to 010 $a" should have the following configuration:
    For matches - Update MARC authority record
    For non-matches - Create new MARC authority record

Known issues:

  1. MODSOURCE-709

  2. Errors like described there MODSOURCE-687 (io.vertx.core.impl.NoStackTraceThrowable: Timeout) sometimes appear for files more than 5000 records.
    For example: https://bugfest-poppy.int.aws.folio.org/data-import/log/b89fefac-01ff-4580-ace5-d75f387a769b/bc671d95-91dd-47c8-9589-e91af81c4454



Testing scenarios:

Test #

Scenario description

Main steps

Expected result

Result (Pass/Fail) 

Assignee

Files for test

Link to Data import log

Test #

Scenario description

Main steps

Expected result

Result (Pass/Fail) 

Assignee

Files for test

Link to Data import log

1

Create 1 record using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

1 chunk

Pass

@Valery_Pilko 

name_title.mrc

https://bugfest-poppy-plus.int.aws.folio.org/data-import/job-summary/ce4a955f-e7a3-4746-a2fb-728c99d9b255

2

Create 999 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

1 chunk

Pass

@Valery_Pilko 

999 records.mrc

https://bugfest-poppy-plus.int.aws.folio.org/data-import/job-summary/95c64ca3-40f3-49ec-acb3-76e0a6d4b053

3

Create 1000 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

1 chunk

Pass

@Valery_Pilko 

1000 records.mrc

https://bugfest-poppy-plus.int.aws.folio.org/data-import/job-summary/a2f9be34-187c-43d7-b634-288b115d321d

4

Create 1001 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

2 chunks

Pass

@Valery_Pilko 

1001 records.mrc

ID  (Poppy plus) 106, 107

5

Create 1999 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

2 chunks

Pass

@Valery_Pilko 

1999 records.mrc

ID  (Poppy plus) 110, 111

6

Create 2000 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

2 chunks

Pass

@Valery_Pilko 

2000 records.mrc

ID  (Poppy plus) 114, 115

7

Create 2001 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

3 chunks

Pass

@Valery_Pilko 

2001 records.mrc

ID  (Poppy plus) 118, 119, 120

8

Create 10000 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached file

10 chunks

Pass

@Valery_Pilko 

10000 records.mrc

ID  (Poppy plus) 123-132

9

Update 1 record using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"

Upload attached file

1 chunk

Pass

@Valery_Pilko 

name_title.mrc

ID  (Poppy plus) 135

10

Update 999 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"

Upload attached file

1 chunk

Pass

@Valery_Pilko 

999 records.mrc

ID  (Poppy plus) 138

11

Update 1001 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"

Upload attached file

2 chunks

Pass

@Valery_Pilko

1001 records.mrc

ID (Poppy) 9381 9382

12

Update 5000 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"

Upload attached file

 5 chunks

Pass

@Valery_Pilko

5000 records.mrc

ID (Poppy plus) 201-205

13

Update 10000 records using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"

Upload attached file

10 chunks

Pass

@Valery_Pilko

10000 records.mrc

ID (Poppy) 9543-9552

13

Create 2500 records using default job profile - "Default - Create SRS MARC Authority"
And at the same time upload another ".mrc" file with 2500 records using default job profile - "Default - Create SRS MARC Authority"

Upload attached files

3 chunks in each. 
No crossing in logs

Pass

@Valery_Pilko

msplit00000009.mrc

msplit00000010.mrc

ID (Poppy plus) 238-240

ID (Poppy plus) 242-244

14

Update and Create scenario:
Upload a file with 2 records (1 for update (should exist in the system already) and 1 for create) using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"

Upload attached file

1 chunks in total. 1 record should be updated; new 1 record should be created

Pass

@Valery_Pilko





15

Update and Create scenario:
Upload a file with more than 2000 records (some records to update (should exist in the system already) and some records to create) using created job profile - "KG - Create SRS MARC Authority on nonmatches to 010 $a"

Upload attached file

3 chunks in total. Approx. half of records created, other half updated

Pass

@Valery_Pilko

create+update.mrc

ID (Poppy plus) 302-304