Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Info

It's been found after testing that the actual durations of the imports performed were about 2 (two) times longer than what was reported. This is due to the PTF environment missing a DB trigger that, when restored, doubled the imports' durations.

Table of Contents


Jira Legacy
serverSystem JiraJIRA
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyPERF-210

Jira Legacy
serverSystem JiraJIRA
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyUIDATIMP-1033

...

  • mod-data-import-2.3.0-SNAPSHOT.220
  • mod-data-import-converter-storage-1.13.0-SNAPSHOT.183
  • mod-source-record-storage-5.3.0-SNAPSHOT.378
  • mod-source-record-manager-3.3.0-SNAPSHOT.526
  • mod-inventory-18.1.0-SNAPSHOT.475
  • mod-inventory-storage-22.1.0-SNAPSHOT.650
  • mod-search-1.6.0-SNAPSHOT.172
  • mod-quick-marc-2.3.0-SNAPSHOT.145
  • folio/marc-authorities 1.0.100034 (folio_marc-authorities-1.0.100034)


Results


ProfileMorning Glory Duration
1KDefault - Create SRS MARC Authority

40 sec

5K

Default - Create SRS MARC Authority1 min 14 sec
10KDefault - Create SRS MARC Authority2 min 32 sec
25KDefault - Create SRS MARC Authority6 min
50KDefault - Create SRS MARC Authority12 min

...

  • More or less resource usages are the same as for KIWI release Data Import Test Report (Kiwi)#5K-10KImports.
  • With part of files we've got error: [vert.x-worker-thread-10] ERROR rdChunksKafkaHandler [72160511eqId] RecordCollection processing has failed with errors with event: 'null', chunkId: '6c96f806-e9f5-4720-b680-b44361a3a0e7', chunkNumber '2119'-'19' with recordId: 'null'.  
    Jira Legacy
    serverSystem JiraJIRA
    serverId01505d01-b853-3c2e-90f1-ee9b165564fc
    keyUIDATIMP-1087

...

Results after modules updating 



ProfileDuration newDuration old

5K

Default - Create SRS MARC Authority2 min 15 s1 min 14 sec
10KDefault - Create SRS MARC Authority3 min 58 s2 min 32 sec
25KDefault - Create SRS MARC Authority10 min 47 s6 min
50KDefault - Create SRS MARC Authority18 min 18 s12 min