...

• Kiwi release was able ho harvest 7,808,200 records in 19 hr 8 min (1M records per 2 hours and 15 min).
• Average response time per request 0.874s.
• A few issues were found
  • OutOfMemory exception:

    Jira Legacy
    server System Jira serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODOAIPMH-374

  • Thread block issue: 

    Jira Legacy
    server System Jira serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODOAIPMH-374

  • When instances didn't have underlying MARC records, multiple repeating calls from mod-edge-oai-pmh to mod-oai-pmh were occurred, resulting in the end-client receiving an timeout, see see

    Jira Legacy
    server System Jira serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODOAIPMH-383

     

Test flow

Test consist of few calls:

...

1) OutOfMemory exception. fixed in scope of of 

2) Thread block issue. fixed in scope of of 

3) DB timeout.  Client timeouts.  

...

• Total Underlying SRS records: 1,212,039
• Duration: 4 hr 57 min
• Records transferred: 4,770,043 (should be 8,415,303)
• Records harvested - 20,618 X 100 = 2,061,800.

...

• While data transferring process is going on the background DB CPU usage has reached 70%-75%.
• Data transferring process has failed in 10 minutes and transfer only 4770043 from 8M records.
• Harvesting itself consumes 15% DB CPU.

Test 2

• Total Underlying SRS records: 1,212,039
• Duration: 4 hr 25 min
• Records transferred: 3,815,867 (should be 8,415,303)
• Records harvested - 22305 X 100 = 2 230 500.

...