...

There are two types of calls, and the only difference is in "metadataPrefix" which can be "marc21" or "marc21_withholdings".  Each of these calls may have a "startDate" parameter.

Backend

• mod-oai-pmh:3.2.2, mod-oai-pmh:3.2.4
• edge-oai-pmh:2.3.0
• mod-inventory-storage:19.4.3
• okapi:4.2.2

...

• 61 back-end modules deployed in 110 ECS services
• 3 okapi ECS services
• 8 m5.large  EC2 instances
• 2 db.r5.xlarge AWS RDS instance (1 reader, 1 writer)
• 1 mod-oai-pmh ECS services (to easy troubleshoot)
• INFO Okapi logging level
• Load balancer timeouts increased to 4000 seconds.
• nginx timeouts extended to 3600 seconds.

Summary

"marc21" metadataPrefix working much faster than "marc21_withholdings" . Few basics numbers about both matadataPrefix :

1) marc21 metadataPrefix:

• Response time for both tests (including start date and without it) is 6.5 - 6.6 seconds on 75%/95% percentiles;
• mod-oai-pmh CPU usage did not grow higher than ~30%. (usually it not higher than 15%);
• Other modules didn't show visible RAM usage. Ram usage of OAI_PMH was near 110 -119 %;
• RDS CPU usage usually stay on 15 % rate. 

...

• The <tenantId>_mod-oai-pmh.instances table is filled up with records. When the number of records approaches 40M, a call [oai?verb=ListRecords&metadataPrefix=marc21_withholdings&apikey=${APIKey}&start=${Date}] that used to take 7 minutes now takes longer than 40 minutes.
• After several runs (5-7), the oai-pmh calls take longer than 20 minutes even though the instances table is empty. mod-pubsub needs to be restarted for it to return results within 7 minutes again.

Please Note: that on ptf env. getaway timeout value on public load-balancer was increased from 400 to 4000 seconds. While default value on our prod env. is 400 seconds, calls that includes marc21_withholdings metadataPrefix won't work and will fail with 504 "Getaway Timeout".

...

Detailed Results

Test 1

...

Service Memory usage:

DB CPU usage:

Test

...

6 

...