<!-- 
RSS generated by JIRA (1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d) at Thu Feb 08 22:26:42 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary add field=key&field=summary to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>FOLIO Jira</title>
    <link>https://folio-org.atlassian.net</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>1001.0.0-SNAPSHOT</version>
        <build-number>100246</build-number>
        <build-date>07-02-2024</build-date>
    </build-info>

<item>
            <title>[FOLIO-974] proxyRequestResponse failure</title>
                <link>https://folio-org.atlassian.net/browse/FOLIO-974</link>
                <project id="10290" key="FOLIO">FOLIO</project>
                    <description>&lt;p&gt;I am seeing this kind of thing quite a bit:&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
GET http:&lt;span class=&quot;code-comment&quot;&gt;//localhost:9130/codex-instances?limit=30&amp;amp;query=cql.allRecords%3D1%20sortby%20title
&lt;/span&gt;
500 Internal Server Error
proxyRequestResponse failure: http:&lt;span class=&quot;code-comment&quot;&gt;//10.0.2.15:9146: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /10.0.2.15:9146 Connection refused: /10.0.2.15:9146&lt;/span&gt;
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;Here&apos;s how it manifests. First, a request to mod-codex-mock will hang for a long time &amp;#8211; 100 seconds or so &amp;#8211; then return with the failure as documented. Subsequent to this, any further requests are rejected with the same diagnostic, but immediately.&lt;/p&gt;</description>
                <environment></environment>
        <key id="80426">FOLIO-974</key>
            <summary>proxyRequestResponse failure</summary>
                <type id="10001" iconUrl="https://folio-org.atlassian.net/rest/api/2/universal_avatar/view/type/issuetype/avatar/10303?size=medium">Bug</type>
                                            <priority id="10001" iconUrl="https://dev.folio.org/assets/jira-priority/jira-p2.svg">P2</priority>
                        <status id="6" iconUrl="https://folio-org.atlassian.net/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="green"/>
                                    <resolution id="10003">Done</resolution>
                                                        <assignee accountid="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c">shale99</assignee>
                                                                <reporter accountid="5bffed52a1b46046f530c8f7">Mike Taylor</reporter>
                                    <labels>
                            <label>sprint28</label>
                    </labels>
                <created>Tue, 5 Dec 2017 14:50:04 +0000</created>
                <updated>Mon, 12 Nov 2018 14:23:52 +0000</updated>
                            <resolved>Wed, 17 Jan 2018 12:39:32 +0000</resolved>
                                                                        <due></due>
                            <votes>0</votes>
                                    <watches>9</watches>
                                                    <timespent seconds="32400">1 day, 1 hour</timespent>
                                <comments>
                                                            <comment id="190856" author="712020:38d1a08f-86a8-4df2-9191-239b16b0a81a" created="Thu, 7 Dec 2017 10:19:38 +0000"  >&lt;p&gt;I tried to reproduce this by running a tight loop of curl requests (get one, list all, the query from above), as fast as curl could output on the screen, on four console windows in parallel, for thousands of iterations. Nothing crashed, and I did not see any 500-results. This was on a local installation, on a Okapi with just this one module loaded. Your setup is more complex.&lt;/p&gt;

&lt;p&gt;I don&apos;t have the ansible setup on my laptop. Is there any way you could look in the logs, and verify that the port 9146 is indeed used by mod-codex-mock, and not some other module (you have at least mod-authtoken involved in your stack). &lt;/p&gt;

&lt;p&gt;I would like to know more about when and how this happens. Does it happen at the first request, or after some time? Can you get to the logs, and see around the first 500-error that hangs, if there is anything suspicious, especially near the beginning of the request? If you can identify the request-id, could you grep the logs for that, and paste here - that should tell a bit more.&lt;/p&gt;</comment>
                                                            <comment id="190859" author="712020:38d1a08f-86a8-4df2-9191-239b16b0a81a" created="Thu, 7 Dec 2017 10:41:39 +0000"  >&lt;p&gt;I filed 
    &lt;span class=&quot;jira-issue-macro resolved&quot; data-jira-key=&quot;OKAPI-476&quot; &gt;
                &lt;a href=&quot;https://folio-org.atlassian.net/browse/OKAPI-476&quot; class=&quot;jira-issue-macro-key issue-link&quot;  title=&quot;Improve error reporting for proxyRequestResponse&quot; &gt;
            &lt;img class=&quot;icon&quot; src=&quot;https://folio-org.atlassian.net/rest/api/2/universal_avatar/view/type/issuetype/avatar/10303?size=medium&quot; /&gt;
            OKAPI-476
        &lt;/a&gt;
                                                    &lt;span class=&quot;aui-lozenge aui-lozenge-subtle aui-lozenge-success jira-macro-single-issue-export-pdf&quot;&gt;Closed&lt;/span&gt;
            &lt;/span&gt;
 to get more info in that error message.&lt;/p&gt;</comment>
                                                            <comment id="190862" author="5bffed52a1b46046f530c8f7" created="Thu, 7 Dec 2017 10:49:23 +0000"  >&lt;p&gt;Thanks for looking into this.&lt;/p&gt;

&lt;p&gt;It doesn&apos;t happen on the first request, but randomly at some later time.&lt;/p&gt;

&lt;p&gt;At present, we have a plague of 500s, not only in mod-codex-mock. They seem to appear at random, and as soon as a module emits one of them, it keeps doing so.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5c706fbb47a54a6728e59df2&quot; class=&quot;user-hover&quot; rel=&quot;5c706fbb47a54a6728e59df2&quot; data-account-id=&quot;5c706fbb47a54a6728e59df2&quot; accountid=&quot;5c706fbb47a54a6728e59df2&quot; rel=&quot;noreferrer&quot;&gt;Wayne Schneider&lt;/a&gt; and &lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=712020%3A32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; class=&quot;user-hover&quot; rel=&quot;712020:32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; data-account-id=&quot;712020:32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; accountid=&quot;712020:32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; rel=&quot;noreferrer&quot;&gt;shale99&lt;/a&gt; think it&apos;s an out-of-memory problem in the VM configuration. They&apos;re looking into it. I think you can put this on hold until they&apos;ve confirmed or denied.&lt;/p&gt;</comment>
                                                            <comment id="190863" author="712020:38d1a08f-86a8-4df2-9191-239b16b0a81a" created="Thu, 7 Dec 2017 11:01:16 +0000"  >&lt;p&gt;I tried to kill a module, and provoke Okapi to report this error, mostly to see Okapi.476 work. It did so, but the report came immediately, no long timeout. That is what happens when the module is not running. &lt;/p&gt;

&lt;p&gt;I wonder what happens in the first failing request that takes so long. Probably the module accepts the request, and then crashes hard. So hard that it stops listening at all.&lt;/p&gt;</comment>
                                                            <comment id="190867" author="712020:38d1a08f-86a8-4df2-9191-239b16b0a81a" created="Thu, 7 Dec 2017 11:11:28 +0000"  >&lt;p&gt;Ok, I put this on hold for today. If need be, I can look at it again tomorrow - but then I will be away for a week.&lt;/p&gt;

&lt;p&gt;At least I got the excuse to improve Okapi error reporting.&lt;/p&gt;</comment>
                                                            <comment id="190868" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Thu, 7 Dec 2017 18:26:07 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5bffed52a1b46046f530c8f7&quot; class=&quot;user-hover&quot; rel=&quot;5bffed52a1b46046f530c8f7&quot; data-account-id=&quot;5bffed52a1b46046f530c8f7&quot; accountid=&quot;5bffed52a1b46046f530c8f7&quot; rel=&quot;noreferrer&quot;&gt;Mike Taylor&lt;/a&gt; - just to make sure i understand - if you hit the codex and at one point start hitting 500&apos;s, from that point on, do all modules in the vm also throw 500&apos;s , or do they work properly? &lt;/p&gt;</comment>
                                                            <comment id="190876" author="5bffed52a1b46046f530c8f7" created="Thu, 7 Dec 2017 22:43:26 +0000"  >&lt;p&gt;Once any give module gives a 500 once, it will keep doing it forever. Other modules may be unaffected at that time.&lt;/p&gt;</comment>
                                                            <comment id="190877" author="5f8314dfbdef80006f6f572d" created="Fri, 8 Dec 2017 11:06:06 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5bffed52a1b46046f530c8f7&quot; class=&quot;user-hover&quot; rel=&quot;5bffed52a1b46046f530c8f7&quot; data-account-id=&quot;5bffed52a1b46046f530c8f7&quot; accountid=&quot;5bffed52a1b46046f530c8f7&quot; rel=&quot;noreferrer&quot;&gt;Mike Taylor&lt;/a&gt; .. It would be helpful if you could dig out the okapi.log  .. If you run the Ansible log locally you can do &quot;vagrant ssh&quot; and fetch /var/log/folio/okapi/okapi.log .. &lt;/p&gt;</comment>
                                                            <comment id="190878" author="5bffed52a1b46046f530c8f7" created="Fri, 8 Dec 2017 11:21:38 +0000"  >&lt;p&gt;Sorry, it&apos;s long gone: I&apos;ve got into the habit now of almost reflexively doing a &lt;tt&gt;vagrant destroy -f &amp;amp;&amp;amp; vagrant up&lt;/tt&gt; once I start seeing 500s. I will try to remember not to do this the next time it happens, until I&apos;ve pulled out the logs first.&lt;/p&gt;

&lt;p&gt;(&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5c706fbb47a54a6728e59df2&quot; class=&quot;user-hover&quot; rel=&quot;5c706fbb47a54a6728e59df2&quot; data-account-id=&quot;5c706fbb47a54a6728e59df2&quot; accountid=&quot;5c706fbb47a54a6728e59df2&quot; rel=&quot;noreferrer&quot;&gt;Wayne Schneider&lt;/a&gt;: it occurs to me &amp;#8211; can Ansible/Vagrant be set up so that it runs a custom script when you destroy a VM, and could we have it copy the Okapi log somewhere well-known on the host system, so that we have it available if we want it subsequently?)&lt;/p&gt;</comment>
                                                            <comment id="190881" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Sat, 9 Dec 2017 16:57:52 +0000"  >&lt;p&gt;would it be possible to get the /var/log/messages after the 500&apos;s start appearing for a specific module?&lt;br/&gt;
it is a possibility that the memory limit is getting reached somehow, and something like the OOM (out of memory) killer is triggered by linux which kills the the specific process hence leading to the module being down (linux issues a kill -9 in such a case) - hence okapi returns a 500 since it can not reach the module?&lt;br/&gt;
not sure i have all the details to say the above is correct , but if we can also see the /var/log/messages we can see what is happening on the os side as well&lt;/p&gt;</comment>
                                                            <comment id="190884" author="5bffed52a1b46046f530c8f7" created="Sat, 9 Dec 2017 16:59:46 +0000"  >&lt;p&gt;Yep, I&apos;ll try to get everything the next time this happens.&lt;/p&gt;

&lt;p&gt;&amp;#8211; Mike.&lt;/p&gt;</comment>
                                                            <comment id="190885" author="615afd1cd9820f0070a09ef0" created="Mon, 11 Dec 2017 12:07:06 +0000"  >&lt;p&gt;I&apos;ve seen the same symptoms as @mike; once a 500 hits then it&apos;s all 500s thereafter. Bumping the RAM for the VM from the default to 8192MB has mitigated the problem.&lt;/p&gt;

&lt;p&gt;Here&apos;s a snip from &lt;tt&gt;/var/log/folio/okapi/okapi.log&lt;/tt&gt; from folio/testing-backend 5.0.0-20171205.272 the log last week: &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;/rest/api/3/attachment/content/63999&quot; title=&quot;20171206_var-log-folio-okapi-okapi.log attached to FOLIO-974&quot; data-attachment-type=&quot;file&quot; data-attachment-name=&quot;20171206_var-log-folio-okapi-okapi.log&quot; data-media-services-type=&quot;file&quot; data-media-services-id=&quot;42fafcfd-fc5f-41c9-9935-9e2bc24fcfb3&quot; rel=&quot;noreferrer&quot;&gt;20171206_var-log-folio-okapi-okapi.log&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; &lt;/p&gt;</comment>
                                                            <comment id="190888" author="615afd1cd9820f0070a09ef0" created="Mon, 11 Dec 2017 12:35:55 +0000"  >&lt;p&gt;Lending credence to the out-of-memory theory: &lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
$ vagrant ssh

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms &lt;span class=&quot;code-keyword&quot;&gt;for&lt;/span&gt; each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Tue Dec  5 16:55:59 2017 from 10.0.2.2
-bash: fork: Cannot allocate memory
vagrant@contrib-jessie:~$ sudo su -
-bash: fork: Cannot allocate memory
vagrant@contrib-jessie:~$ logout
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;</comment>
                                                            <comment id="190890" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 12:52:15 +0000"  >&lt;p&gt;See attached okapi.log, messages.log and inventory-storage.log from &lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5bffed5e2434bf3a1a91d37a&quot; class=&quot;user-hover&quot; rel=&quot;5bffed5e2434bf3a1a91d37a&quot; data-account-id=&quot;5bffed5e2434bf3a1a91d37a&quot; accountid=&quot;5bffed5e2434bf3a1a91d37a&quot; rel=&quot;noreferrer&quot;&gt;Niels Erik Nielsen&lt;/a&gt;&apos;s VM. At  Dec 11 10:20:01 the VM OOM killer goes into action. It destroys PID 2045. After this point inventory-storage-docker.log is silent and Okapi starts to return 500s for requests to it.&lt;/p&gt;</comment>
                                                            <comment id="190892" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 12:54:38 +0000"  >&lt;p&gt;See 
    &lt;span class=&quot;jira-issue-macro resolved&quot; data-jira-key=&quot;FOLIO-976&quot; &gt;
                &lt;a href=&quot;https://folio-org.atlassian.net/browse/FOLIO-976&quot; class=&quot;jira-issue-macro-key issue-link&quot;  title=&quot;Use real module jar rather than module.jar in Docker container&quot; &gt;
            &lt;img class=&quot;icon&quot; src=&quot;https://folio-org.atlassian.net/rest/api/2/universal_avatar/view/type/issuetype/avatar/10318?size=medium&quot; /&gt;
            FOLIO-976
        &lt;/a&gt;
                                                    &lt;span class=&quot;aui-lozenge aui-lozenge-subtle aui-lozenge-success jira-macro-single-issue-export-pdf&quot;&gt;Closed&lt;/span&gt;
            &lt;/span&gt;
 for a something to be desired when debugging this.&lt;/p&gt;</comment>
                                                            <comment id="190894" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Mon, 11 Dec 2017 12:58:44 +0000"  >&lt;p&gt;nice! so this is legit from that standpoint &lt;br/&gt;
i think we need to start integrating monitoring into this - suggest nmon or just making sure sar keeps history. also, if we can run the /admin/memory and save into a file we can also see the memory behavior of the modules (not a ton of info , but a start)&lt;/p&gt;</comment>
                                                            <comment id="190896" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 13:15:43 +0000"  >&lt;p&gt;I started a frew folio/testing VM and I get:&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
            total       used       free     shared    buffers     cached
Mem:       4058872    3927480     131392      21888      12276     194164
-/+ buffers/cache:    3721040     337832
Swap:       473084       4468     468616
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;that&apos;s 3 percent free of RAM according to nmon.. Not a lot to eat from as the system gets used, so definitely we should beef up those VMs.&lt;/p&gt;</comment>
                                                            <comment id="190898" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Mon, 11 Dec 2017 13:22:13 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5f8314dfbdef80006f6f572d&quot; class=&quot;user-hover&quot; rel=&quot;5f8314dfbdef80006f6f572d&quot; data-account-id=&quot;5f8314dfbdef80006f6f572d&quot; accountid=&quot;5f8314dfbdef80006f6f572d&quot; rel=&quot;noreferrer&quot;&gt;Adam Dickmeiss&lt;/a&gt; look at the second line - buffers / cache - this would indicate almost 10% free - the OS can free up the buffers/cache if needed. but i agree this is low, and digging into those 10% will potentially impact performance&lt;/p&gt;</comment>
                                                            <comment id="190900" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 13:24:08 +0000"  >&lt;p&gt;It doesn&apos;t take more than few minutes to break things memory wise.. This time, mod-authtoken was the first one to stop. Not because of OOM but because the JVM could not allocate more memory.. docker logs .. show:&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
INFO: No &lt;span class=&quot;code-quote&quot;&gt;&apos;user_id&apos;&lt;/span&gt; field found in token
#
# There is insufficient memory &lt;span class=&quot;code-keyword&quot;&gt;for&lt;/span&gt; the Java &lt;span class=&quot;code-object&quot;&gt;Runtime&lt;/span&gt; Environment to &lt;span class=&quot;code-keyword&quot;&gt;continue&lt;/span&gt;.
# Native memory allocation (malloc) failed to allocate 880096 bytes &lt;span class=&quot;code-keyword&quot;&gt;for&lt;/span&gt; Chunk::&lt;span class=&quot;code-keyword&quot;&gt;new&lt;/span&gt;
# Can not save log file, dump to screen..
#
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
</comment>
                                                            <comment id="190902" author="5bffed52a1b46046f530c8f7" created="Mon, 11 Dec 2017 13:34:39 +0000"  >&lt;p&gt;Great that you guys are getting to the bottom of this.&lt;/p&gt;

&lt;p&gt;If there anything Okapi, or another component, could do differently to make such failures more polite or explicit?&lt;/p&gt;</comment>
                                                            <comment id="190904" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 13:38:53 +0000"  >&lt;p&gt;Having beef&apos;ed up to 8GB and using the UI.. That is just clicking &apos;Users&apos; , &apos;Items&apos; and &apos;Checkout&apos;  and pretty much nothing else, I see certain increased RSS increase for at least two modules.&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
1229 folio     20   0 4672544 1.016g  20440 S   0.0 13.0   1:36.41 java                                                                                                                       
1825 folio     20   0 4680964 804312  20912 S   0.0  9.8   0:24.20 java             
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;1229 is mod-permissions:latest and 1825 is mod-inventory-storage:latest.&lt;/p&gt;</comment>
                                                            <comment id="190907" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Mon, 11 Dec 2017 13:49:51 +0000"  >&lt;p&gt;i wonder if this is just java which will continue to allocate memory as long as there is no memory pressure? i dont know when it will run a garbage collection, if objects are long lived (which may be problematic) and are moving to the old gen and gc isnt running then maybe this would lead to the memory ballooning - although this memory maybe freeable by a gc - it would be great to add the gclog cmd line argument as well so we can see the memory behavior of the modules - i honestly have not done that (which , now that i think about it, is quite unreasonable to not know the rmb memory behavior from a gc standpoint)&lt;/p&gt;

&lt;p&gt;can we add the gc logs arg to the command line of the modules?&lt;/p&gt;

&lt;p&gt;something like this?!?!&lt;/p&gt;

&lt;p&gt;-XX:+HeapDumpOnOutOfMemoryError -XX:+PrintGCDetails -Xloggc:&amp;lt;path_2_logs&amp;gt;/gclogs&lt;/p&gt;</comment>
                                                            <comment id="190910" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Mon, 11 Dec 2017 13:55:33 +0000"  >&lt;p&gt;thinking about this - in the past i have had the gc logs generated by each running module, and this was fed into an ELK server - which made this info viewable via a browser and you could see how the internal memory in the jvm was behaving during different situations in the modules.. maybe something to think about&lt;/p&gt;</comment>
                                                            <comment id="190911" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 14:00:11 +0000"  >&lt;p&gt;After more interaction with the UI, the stat is now:&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
 1229 folio     20   0 4672544 1.060g  20440 S   0.3 13.6   4:46.55 java                                                                                                                       
  817 okapi     20   0 4584008 933812  18620 S   0.0 11.4   1:34.31 java    
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;Okapi now in second place.&lt;/p&gt;</comment>
                                                            <comment id="190914" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Mon, 11 Dec 2017 14:21:41 +0000"  >&lt;p&gt;any chance to run jstat on the process?&lt;/p&gt;</comment>
                                                            <comment id="190917" author="712020:f8a80db2-7815-4fda-b77b-2f2682812a00" created="Wed, 13 Dec 2017 00:47:00 +0000"  >&lt;p&gt;Hi all,&lt;/p&gt;

&lt;p&gt;I found an interesting article that might be related, &lt;a href=&quot;https://developers.redhat.com/blog/2017/03/14/java-inside-docker/&quot; class=&quot;external-link&quot; rel=&quot;nofollow noreferrer&quot;&gt;Java Inside Docker&lt;/a&gt;.&lt;/p&gt;

&lt;blockquote&gt;&lt;p&gt;What if the value of the Heap could be calculated based on the container restriction automatically?&lt;/p&gt;

&lt;p&gt;This is actually possible if you use a base Docker image provided by the Fabric8 community. The image fabric8/java-jboss-openjdk8-jdk uses a script that calculates the container restriction and uses 50% of the available memory as an upper boundary.&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;Best,&lt;br/&gt;
Nate&lt;/p&gt;</comment>
                                                            <comment id="190922" author="712020:32bb56ac-50e7-4787-b4af-ed3089d9401c" created="Mon, 25 Dec 2017 13:05:03 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5c706fbb47a54a6728e59df2&quot; class=&quot;user-hover&quot; rel=&quot;5c706fbb47a54a6728e59df2&quot; data-account-id=&quot;5c706fbb47a54a6728e59df2&quot; accountid=&quot;5c706fbb47a54a6728e59df2&quot; rel=&quot;noreferrer&quot;&gt;Wayne Schneider&lt;/a&gt; , &lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=5f9abc1eb45b2e007453f423&quot; class=&quot;user-hover&quot; rel=&quot;5f9abc1eb45b2e007453f423&quot; data-account-id=&quot;5f9abc1eb45b2e007453f423&quot; accountid=&quot;5f9abc1eb45b2e007453f423&quot; rel=&quot;noreferrer&quot;&gt;John Malconian&lt;/a&gt; - i would like to close this issue , or should I move it to one of you?&lt;/p&gt;</comment>
                                                            <comment id="190924" author="5c706fbb47a54a6728e59df2" created="Tue, 26 Dec 2017 14:12:44 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=712020%3A32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; class=&quot;user-hover&quot; rel=&quot;712020:32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; data-account-id=&quot;712020:32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; accountid=&quot;712020:32bb56ac-50e7-4787-b4af-ed3089d9401c&quot; rel=&quot;noreferrer&quot;&gt;shale99&lt;/a&gt; &amp;#8211; I believe this issue can be closed. Relevant work is going on 
    &lt;span class=&quot;jira-issue-macro resolved&quot; data-jira-key=&quot;FOLIO-968&quot; &gt;
                &lt;a href=&quot;https://folio-org.atlassian.net/browse/FOLIO-968&quot; class=&quot;jira-issue-macro-key issue-link&quot;  title=&quot;Container RAM usage is getting out of control on blackbox VMs&quot; &gt;
            &lt;img class=&quot;icon&quot; src=&quot;https://folio-org.atlassian.net/rest/api/2/universal_avatar/view/type/issuetype/avatar/10303?size=medium&quot; /&gt;
            FOLIO-968
        &lt;/a&gt;
                                                    &lt;span class=&quot;aui-lozenge aui-lozenge-subtle aui-lozenge-success jira-macro-single-issue-export-pdf&quot;&gt;Closed&lt;/span&gt;
            &lt;/span&gt;
. Thanks!&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10003">
                    <name>Relates</name>
                                            <outwardlinks description="relates to">
                                        <issuelink>
            <issuekey id="80428">FOLIO-968</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="61772">STCOR-119</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="80439">FOLIO-976</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="53737">OKAPI-477</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="relates to">
                                        <issuelink>
            <issuekey id="80443">FOLIO-979</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="53738">OKAPI-478</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="53736">OKAPI-476</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="63999" name="20171206_var-log-folio-okapi-okapi.log" size="75918" author="615afd1cd9820f0070a09ef0" created="Mon, 11 Dec 2017 12:05:13 +0000"/>
                            <attachment id="64000" name="inventory-storage-docker.log" size="16449" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 12:49:00 +0000"/>
                            <attachment id="64001" name="messages.log" size="265376" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 12:49:01 +0000"/>
                            <attachment id="64002" name="okapi.log" size="1679173" author="5f8314dfbdef80006f6f572d" created="Mon, 11 Dec 2017 12:49:01 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10000" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummarycf">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10019" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>0|hzy4h3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10020" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10024" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>[CHART] Date of First Response</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 7 Dec 2017 10:19:38 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10025" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>[CHART] Time in Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>