[FOLIO-3157] Configure mod-data-import in ref env with recommended settings Created: 10/May/21  Updated: 25/May/21  Resolved: 25/May/21

Status: Closed
Project: FOLIO
Components: None
Affects versions: None
Fix versions: None

Type: Task Priority: TBD
Reporter: John Malconian Assignee: John Malconian
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Sprint: DevOps Sprint 114
Development Team: FOLIO DevOps

 Description   

Configuration of mod-data-import has changed for the Iris and post-Iris releases. Review recommendations documented here: https://folio-org.atlassian.net/wiki/display/FOLIJET/Checklist+for+Data-Import+application+setup+on+a+new+environment%3A+Iris and implement accordingly for FOLIO reference builds (Iris release and snapshot builds)



 Comments   
Comment by John Malconian [ 10/May/21 ]

From what I can discern, the reference environment configuration matches the recommended configuration described in https://folio-org.atlassian.net/wiki/display/FOLIJET/Checklist+for+Data-Import+application+setup+on+a+new+environment%3A+Iris with the following exceptions:

  • Kafka broker configured with default 'num.network.threads=3' instead of '5'.
  • mod-inventory configured with default value ('5') for 'inventory.kafka.DataImportConsumerVerticle.instancesNumber' and
    'inventory.kafka.MarcBibInstanceHridSetConsumerVerticle.instancesNumber' instead of the recommended '10'.

Not sure if those settings have any relational relevance to the number of kafka replicas running. The reference environments only run one zookeeper instance and one kafka broker.

In reference environment, we have only one instance of mod-data-import running. It is running with no container CPU limit and a RAM limit of 512MB of which 338MB is dedicated to JVM heap size.

'data.import.storage.type' and 'data.import.storage.path' are not defined. I assume there are sane defaults.

Generated at Thu Feb 08 23:26:02 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.