Modules that were analyzed during test runs:

• mod-orders
• data-import
• mod-circulation
• mod-oai-pmh
• mod-bulk-edit
• mod-ebsconet
• mod-kb-ebsco-java
• mod-quick-marc
• cross-modules
• mod-finance
• mod-patron-blocks
• edge-inn-reach

Modules that always show stability:

• mod-oai-pmh
• mod-bulk-edit
• cross-modules
• mod-finance
• mod-patron-blocks

Kafka StatefulSet

During running tests, Kafka pod restarts several times before and during tests. Pod restarts with OOMKilled status. 

After resizing limit memory to 4096M and Xmx parameters to 2662m several modules show more stable result:

• mod-orders
• mod-circulation
• mod-ebsconet
• edge-inn-reach

Not stable modules

After resizing memory for Kafka several modules have float issues:

• data-import
• mod-kb-ebsco-java
• mod-quick-marc

data-import module

A lot of issues look like this:

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/322/cucumber-html-reports/report-feature_138_1684211029.html

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/319/cucumber-html-reports/report-feature_141_2494525229.html

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/312/cucumber-html-reports/report-feature_138_1684211029.html

And issues that I don`t understand https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/324/cucumber-html-reports/report-feature_138_1684211029.html

mod-kb-ebsco-java module

Not all tests start due to issues:

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/326/cucumber-html-reports/report-feature_203_1387567880.html

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/322/cucumber-html-reports/report-feature_203_1387567880.html

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/319/cucumber-html-reports/report-feature_203_1387567880.html

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/318/cucumber-html-reports/report-feature_203_1387567880.html

mod-quick-mark module

Timeout issue:

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/322/cucumber-html-reports/report-feature_242_3577100403.html

Different status codes:

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/334/cucumber-html-reports/report-feature_226_3577100403.html

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/326/cucumber-html-reports/report-feature_242_3577100403.html

https://jenkins-aws.indexdata.com/job/Testing/job/Karate%20tests/317/cucumber-html-reports/report-feature_242_3577100403.html

Pods restart

Before starting tests sometimes have restart pods:

• mod-agreements
• mod-oa

But I don`t find the root cause of these restarts. 

So, maybe better also resize memory or CPU. These values need monitor.

More information about runs: