/
Package export testing 21.10.2022

Package export testing 21.10.2022

Oct 25, 2022

These tests were executed at Snapshot-1 environment 21.10.2022. https://folio-snapshot.dev.folio.org/ 
Note: The value of KAFKA_CONSUMER_POLL_INTERVAL is equal to default value (3600000), which must be equal to 1 hour; see the link https://github.com/folio-org/mod-data-export-worker/blob/master/README.md

Probably the issues described in test #4-#5 appear because of the KAFKA_CONSUMER_POLL_INTERVAL which was set to default value (3600000). This statement is false (see Package export testing 25.10.2022)

Test №

Test data information

Test result information:

Test №

Test data information

Test result information:

1 (Smoke)

Type:

Package

Job ID:

Status:

Error:

Start Time:

End Time:

Size of ".csv" (Mb)

Title:

Wiley Online Library

5

Successful

 

10/21/2022, 6:11 AM

10/21/2022, 6:16 AM

1,4

Link:

/eholdings/packages/58-473

 

Package info:

# of Titles

2,862

Test №

Test data information

Test result information:

Test №

Test data information

Test result information:

2 (Smoke)

Type:

Package

Job ID:

Status:

Error:

Start Time:

End Time:

Size of ".csv" (Mb)

Title:

Springer eBooks (Complete Collection 2013)

6

Successful

 

10/21/2022, 6:20 AM

10/21/2022, 6:36 AM

7,1

Link:

/eholdings/packages/36-6693

 

Package info:

# of Titles

9825

Test №

Test data information

Test result information:

Test №

Test data information

Test result information:

3 (Critical)

Type:

Package

Job ID:

Status:

Error:

Start Time:

End Time:

Size of ".csv" (Mb)

Title:

VLeBooks

7

Successful

 

10/21/2022, 7:25 AM

10/21/2022, 7:53 AM

51,3

Link:

/eholdings/packages/125531-2631932

 

Package info:

# of Titles

9,727 (apply sort "Asia")

# of Notes

1 (4k symbols with formatting)

Provider token

Yes

Package token

Yes

# of Tags

1

# of Agreements

1

Test №

Test data information

Test result information:

Test №

Test data information

Test result information:

4 (Critical)

Type:

Package

Job ID:

Status:

Error:

Start Time:

End Time:

Size of ".csv" (Mb)

Title:

VLeBooks

9

Failed

[503 Service Unavailable] during [GET] to [http://eholdings/packages/125531-2631932/resources?searchfield=title&filter%5Bname%5D=asia&page=10&count=20&include=accessType] [KbEbscoClient#getResourcesByPackageId(String,Map)]: [{ "errors" : [ { "title" : "Service 'resourcemanagement.knowledgebase.rma-title' is unavailable" } ], "jsonapi" : { "version" : "1.0" } }] (ServiceUnavailable)

10/21/2022, 8:30 AM

10/21/2022, 9:31 AM

 

Link:

/eholdings/packages/125531-2631932

Note: The "Start time" value changed to: "10/21/2022, 9:30 AM"
See screenshot:

Package info:

# of Titles

9,727 (apply sort "Asia")

# of Notes

 15 (4k symbols with formatting)

Provider token

Yes

Package token

Yes

# of Tags

5

# of Agreements

5

Title info:

# of "Titles" with assigned:
"Note", "Agreements", "Tags",
"Access status type"

10

# of Tags in each

5

# of Agreements in each

5

# of Notes in each

10

Test №

Test data information

Test result information:

5 (Critical)
RETEST of 4 test

Type:

Package

Job ID:

Status:

Error:

Start Time:

End Time:

Size of ".csv" (Mb)

Title:

VLeBooks

10

Failed

 

10/21/2022, 9:36 AM

10/21/2022, 11:56 AM

691 mb

Link:

/eholdings/packages/125531-2631932

Notes: It's retest of previous test (test 4):


After one hour of job (with id=10) execution:
1) The "Start Time" of Job with Id=10 changed to "10/21/2022, 10:37 AM".
2) The "Start Time" of Job with Id=9 changed to "10/21/2022, 10:37 AM".
3) The Status of Job with Id=9 changed to "In progress"
See attached screenshot:



After more 14 minutes:
4) The job with Id value=09 changed status to "Successful.
5) The "Start Time" of Job with Id=9 changed to: "10/21/2022, 8:30 AM" .
6) The "End time" of Job with Id=9 changed to: "10/21/2022, 10:51 AM".
7) The size of exported ".csv" file from Job with Id=9 is 690 Mb.
8) In exported ".csv" file the information about Titles #7798-9727 is missing (the fields are blank). 
See attached screenshot:

 

After two hours of job (with Id=10) execution :
9) The "Start Time" of Job with Id=9 changed to: "10/21/2022, 11:37 AM".
10) The job with Id value=09 changed status to "Failed".
11) The error message of job with Id value=09 changed status to "[502 Bad Gateway] during [GET] to [http://eholdings/packages/125531-2631932/resources?searchfield=title&filter%5Bname%5D=asia&page=233&count=20&include=accessType] [KbEbscoClient#getResourcesByPackageId(String,Map)]: [{ "errors" : [ { "title" : "Internal server error" } ], "jsonapi" : { "version" : "1.0" } }] (BadGateway)".

After more 14 minutes:
12) The job with Id value=09 changed status to "Successful".
13) The "Start Time" of Job with Id=10 changed to "10/21/2022, 9:36 AM".
14) The size of exported ".csv" file from Job with Id=10 is 690 Mb.
15) In exported ".csv" file the information about Titles #9650-9727 is missing (the fields are blank). 
See attached screenshot:



In attachments, you can find the logs of these exports:

Package info:

# of Titles

9,727 (apply sort "Asia")

# of Notes

 15 (4k symbols with formatting)

Provider token

Yes

Package token

Yes

# of Tags

5

# of Agreements

5

Title info:

# of "Titles" with assigned:
"Note", "Agreements", "Tags",
"Access status type"

10

# of Tags in each

5

# of Agreements in each

5

# of Notes in each

10

 

Test №

Test data information

Test result information:

6 (Critical)

Type:

Package

Job ID:

Status:

Error:

Start Time:

End Time:

Size of ".csv" (Mb)

Title:

VLeBooks

11

Successful

 

10/21/2022, 12:37 PM

10/21/2022, 12:52 PM

about 6 Mb

Link:

/eholdings/packages/125531-2631932

This test is performed to show the difference between export of "Package" record with duplicated in each row "Package" information and between export of only "Resource" information.
There is significant difference in execution time and size of exported ".csv" (Compare export job id=10 and job id=11)

You can see the exported file in attachements:

Title info:

# of "Titles" with assigned:
"Note",
"Agreements", "Tags",
"Access status type"

10

# of Tags in each

5

# of Agreements in each

5

# of Notes in each

10