Expand

title	Quesnelia modules memory and CPU parameters

Module	Task Def. Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft limit	CPU units	Xmx	MetaspaceSize	MaxMetaspaceSize
qcon-pvt
Thu May 23 10:47:25 UTC 2024
mod-remote-storage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-remote-storage:3.2.0	2	4920	4472	1024	3960	512	512
mod-finance-storage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-finance-storage:8.6.0	2	1024	896	1024	700	88	128
mod-ncip	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-ncip:1.14.4	2	1024	896	128	768	88	128
mod-agreements	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-agreements:7.0.0	2	1592	1488	128	0	0	0
mod-ebsconet	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-ebsconet:2.2.0	2	1248	1024	128	700	128	256
mod-consortia	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-consortia:1.1.0	2	3072	2048	128	2048	512	1024
mod-organizations	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-organizations:1.9.0	2	1024	896	128	700	88	128
mod-serials-management	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-serials-management:1.0.0	2	2480	2312	128	1792	384	512
mod-settings	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-settings:1.0.3	2	1024	896	200	768	88	128
mod-search	9	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-search:3.3.0-SNAPSHOT.224	2	2592	2480	2048	1440	512	1024
edge-dematic	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-dematic:2.2.0	1	1024	896	128	768	88	128
mod-data-import	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-data-import:3.1.0	1	2048	1844	256	1292	384	512
mod-tags	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-tags:2.2.0	2	1024	896	128	768	88	128
mod-authtoken	3	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-authtoken:2.15.1	2	1440	1152	512	922	88	128
edge-courses	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-courses:1.4.0	2	1024	896	128	768	88	128
mod-inventory-update	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-inventory-update:3.3.0	2	1024	896	128	768	88	128
mod-notify	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-notify:3.2.0	2	1024	896	128	768	88	128
mod-configuration	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-configuration:5.10.0	2	1024	896	128	768	88	128
mod-orders-storage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-orders-storage:13.7.0	2	1024	896	512	700	88	128
edge-caiasoft	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-caiasoft:2.2.0	2	1024	896	128	768	88	128
mod-login-saml	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-login-saml:2.8.0	2	1024	896	128	768	88	128
mod-erm-usage-harvester	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-erm-usage-harvester:4.5.0	2	1024	896	128	768	88	128
mod-password-validator	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-password-validator:3.2.0	2	1440	1298	128	768	384	512
mod-licenses	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-licenses:6.0.0	2	2480	2312	128	1792	384	512
mod-gobi	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-gobi:2.8.0	2	1024	896	128	700	88	128
mod-bulk-operations	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-bulk-operations:2.0.0	2	3072	2600	1024	1536	384	512
mod-fqm-manager	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-fqm-manager:2.0.1	2	3000	2600	128	2048	384	512
edge-dcb	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-dcb:1.1.0	2	1024	896	128	768	88	128
mod-graphql	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-graphql:1.12.1	2	1024	896	128	768	88	128
mod-finance	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-finance:4.9.0	2	1024	896	128	700	88	128
mod-erm-usage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-erm-usage:4.7.0	2	1024	896	128	768	88	128
mod-batch-print	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-batch-print:1.1.0	2	1024	896	128	768	88	128
mod-copycat	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-copycat:1.6.0	2	1024	512	128	768	88	128
mod-lists	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-lists:2.0.0	2	3000	2600	128	2048	384	512
mod-entities-links	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-entities-links:3.0.0	2	2592	2480	400	1440	0	1024
mod-permissions	2	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-permissions:6.5.0	2	1684	1544	512	1024	384	512
pub-edge	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/pub-edge:2023.06.14	2	1024	896	128	768	0	0
mod-orders	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-orders:12.8.0	2	2048	1440	1024	1024	384	512
edge-patron	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-patron:5.1.0	2	1024	896	256	768	88	128
edge-ncip	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-ncip:1.9.2	2	1024	896	128	768	88	128
mod-users-bl	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-users-bl:7.7.0	2	1440	1152	512	922	88	128
mod-invoice	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-invoice:5.8.0	2	1440	1152	512	922	88	128
mod-inventory-storage	2	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-inventory-storage:27.2.0-SNAPSHOT.738	2	4096	3690	2048	3076	384	512
mod-user-import	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-user-import:3.8.0	2	1024	896	128	768	88	128
mod-sender	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-sender:1.12.0	2	1024	896	128	768	88	128
edge-oai-pmh	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-oai-pmh:2.9.0	2	1512	1360	1024	1440	384	512
mod-data-export-worker	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-data-export-worker:3.2.1	2	3072	2048	1024	2048	384	512
mod-rtac	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-rtac:3.6.0	2	1024	896	128	768	88	128
mod-circulation-storage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-circulation-storage:17.2.0	2	2880	2592	1536	1814	384	512
mod-source-record-storage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-source-record-storage:5.8.0	2	5600	5000	2048	3500	384	512
mod-calendar	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-calendar:3.1.0	2	1024	896	128	768	88	128
mod-event-config	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-event-config:2.7.0	2	1024	896	128	768	88	128
mod-courses	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-courses:1.4.10	2	1024	896	128	768	88	128
mod-circulation-item	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-circulation-item:1.0.0	2	1024	896	128	0	0	0
mod-inventory	3	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-inventory:20.2.0	2	2880	2592	1024	1814	384	512
mod-email	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-email:1.17.0	2	1024	896	128	768	88	128
mod-circulation	2	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-circulation:24.2.1	2	2880	2592	1536	1814	384	512
mod-pubsub	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-pubsub:2.13.0	2	1536	1440	1024	922	384	512
mod-di-converter-storage	2	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-di-converter-storage:2.2.2	2	1024	896	128	768	88	128
edge-orders	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-orders:3.0.0	2	1024	896	128	768	88	128
edge-rtac	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-rtac:2.7.1	2	1024	896	128	768	88	128
mod-users	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-users:19.3.1	2	1024	896	128	768	88	128
mod-template-engine	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-template-engine:1.20.0	2	1024	896	128	768	88	128
mod-patron-blocks	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-patron-blocks:1.10.0	2	1024	896	1024	768	88	128
mod-audit	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-audit:2.9.0	2	1024	896	128	768	88	128
edge-fqm	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-fqm:2.0.0	2	1024	896	128	768	88	128
mod-source-record-manager	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-source-record-manager:3.8.0	2	5600	5000	2048	3500	384	512
nginx-edge	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/nginx-edge:2023.06.14	2	1024	896	128	0	0	0
mod-quick-marc	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-quick-marc:5.1.0	1	2288	2176	128	1664	384	512
nginx-okapi	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/nginx-okapi:2023.06.14	2	1024	896	128	0	0	0
okapi-b	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/okapi:5.3.0	3	1684	1440	1024	922	384	512
mod-feesfines	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-feesfines:19.1.0	2	1024	896	128	768	88	128
mod-invoice-storage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-invoice-storage:5.8.0	2	1872	1536	1024	1024	384	512
mod-service-interaction	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-service-interaction:4.0.1	2	2048	1844	256	1290	384	512
mod-dcb	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-dcb:1.1.0	2	1024	896	128	768	88	128
mod-patron	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-patron:6.1.0	2	1024	896	128	768	88	128
mod-data-export	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-data-export:5.0.0	1	2048	1524	1024	0	0	0
mod-oai-pmh	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-oai-pmh:3.13.0	2	4096	3690	2048	3076	384	512
edge-connexion	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/edge-connexion:1.2.0	2	1024	896	128	768	88	128
mod-notes	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-notes:5.2.0	2	1024	896	128	952	384	512
mod-kb-ebsco-java	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-kb-ebsco-java:4.0.0	2	1024	896	128	768	88	128
mod-login	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-login:7.11.0	2	1440	1298	1024	768	384	512
mod-organizations-storage	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-organizations-storage:4.7.0	2	1024	896	128	700	88	128
mod-data-export-spring	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-data-export-spring:3.2.0	1	2048	1844	256	1536	384	512
pub-okapi	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/pub-okapi:2023.06.14	2	1024	896	128	768	0	0
mod-eusage-reports	1	579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-eusage-reports:2.1.1	2	1024	896	128	768	88	128

Additional links and Errors

Test №5 had one failed record for Tenant 2(qcp1-01) when processed 50k files.

09:55:16 [526300/metadata-provider] [fs07000001] [] [mod-authtoken] ERROR Api Access for user 'folio' (9eb67301-6f6e-468f-9b1a-6134dc39a684) requires permission: metadata-provider.incomingrecords.get
09:55:16 [815600/metadata-provider] [fs07000001] [9eb67301-6f6e-468f-9b1a-6134dc39a684] [mod_source_record_manager] ERROR PostgresClient queryAndAnalyze: ERROR: invalid input syntax for type uuid: "undefined" (22P02) - SELECT * FROM get_record_processing_log('3e63f944-40ea-477c-ac21-79bb24780bc5', 'undefined')
09:55:16 [526300/metadata-provider] [fs07000001] [] [mod-authtoken] ERROR FilterApi Permission missing in []

Also we used different order for Tenants when load files, we decided started load files from Tenant 3(qcp1-02) → Tenant 2(qcp1-01) → Tenant 1(qcp1-00) to avoid problem when mod-permissions spiked and system stacked.

CPU Utilization when mod-permissions spiked and system stacked.

Methodology/Approach

Data Export tests scenario using the profiles Default instances export job profile and srs - holdings and items were started from UI on Quesnelia (qcon) ecs environment.

...

Version	Old Version 16	New Version 17
Changes made by	Stanislav Nehrii	Stanislav Nehrii
Saved on	Jun 01, 2024	Jun 01, 2024

Versions Compared

Key

Additional links and Errors

Methodology/Approach

Page Comparison

Versions Compared

Key

Additional links and Errors

Methodology/Approach