IN PROGRESS
...
Duration - 4 hr 57 min
Records transferred . - 4770043 (should be 8415303)
Records harvested - 20618 X 100 = 2 061 800.
Total Underlying SRS records: 1,212,039
...
- RDS response times (logs)
View file name ;PGLogs.logheight 250 - mod-oai-pmh (logs);
- nginx-oai-pmh (logs);
- edge-oai-pmh (logs);
- okapi (logs);
...
- While data transferring process is going on the background DB CPU usage has reached 70%-75%.
- Data transferring process has failed in 10 minutes and transfer only 4770043 from 8M records.
- Harvesting itself consumes 15% DB CPU.
Test 2
Records transferred . - 3815867 (should be 8415303)
Records harvested - 22305 X 100 = 2 230 500.
Underlying records number: 1212039
Final test (bugfest data set)
...