Memory utilisation issues
Description
defines
relates to
Checklist
hideTestRail: Results
Activity

Varun Javalkar November 11, 2021 at 3:25 PMEdited
Thank you for releasing this fix in v4.2.2. I was able to deploy this change in PTF's kcp1 env https://pre-kiwi-cap1.int.aws.folio.org/
Following are the result for v4.2.2 after running a few tests against the export of 100K instances:
On average, Data export takes 51 minutes for 100K for items and holdings job profile which is around 15 minutes faster than previous release
Consumes around 50% less CPU than previous release
Before:
After:
Memory is stable around 120%
mod-data-export logged 322K log messages vs 42 Million log messages for 100K export
Before
After
Total memory used by unreferenced JVM Garbage Collector reduced by 11%. Complete JXRay Report for reference:
Before
After
Overall, this is a good performance improvement compared to the previous release.

Victoria_Smelova November 11, 2021 at 10:19 AM
I've updated it to Awaiting deployment as it was included into Kiwi Bugfix Release.
We should reopen in case verification fails.

Magda Zacharska November 1, 2021 at 6:45 PM
Assigning to for validation and marking the story as Blocked for now until the testing environment becomes available

Varun Javalkar November 1, 2021 at 5:34 PMEdited
Currently we don't have a spare Kiwi env to verify this ticket. Once we are freed up with DI testing in Kiwi we can get back to this.
Cc:

Magda Zacharska November 1, 2021 at 1:54 PM
Hi - any progress on verifying this story?
Details
Details
Assignee

Reporter

Purpose/Overview:
Memory utilisation issues were identified during MDEXP-394. These issues are described in the JXRay report:
Requirements/Scope:
Memory issues should be analyzed and identified what can be fixed.
Acceptance criteria:
Memory issues are fixed (if possible)
There is a confirmation of more effective memory utilisation (for example, with using of JXRay or some other memory analysing tool)