<!-- 
RSS generated by JIRA (1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d) at Fri Feb 09 00:37:29 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary add field=key&field=summary to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>FOLIO Jira</title>
    <link>https://folio-org.atlassian.net</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>1001.0.0-SNAPSHOT</version>
        <build-number>100246</build-number>
        <build-date>07-02-2024</build-date>
    </build-info>

<item>
            <title>[UXPROD-4127] Improve Data export performance </title>
                <link>https://folio-org.atlassian.net/browse/UXPROD-4127</link>
                <project id="10000" key="UXPROD">UX Product</project>
                    <description>&lt;p&gt;&lt;b&gt;Current situation or problem&lt;/b&gt;:&lt;br/&gt;
The existing implementation of users can export up to 2 M records with the default mapping profile but significantly less when exporting with a custom mapping profile that includes data coming from holdings and item records. The performance deteriorates further when triggered by a CQL query and recommended number of records is 300K. However, the limits not enforced programmatically and are causing additional work for librarians who must manually create a files with the specified number of records UUIDs to trigger the export.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;In scope&lt;/b&gt;&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Performance improvements for exporting:
	&lt;ul&gt;
		&lt;li&gt;instances and SRS records&lt;/li&gt;
		&lt;li&gt;holdings&lt;/li&gt;
		&lt;li&gt;authority records&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;Export of 22M SRS records in 24 hours without significantly impacting the performance of other FOLIO modules (cataloging, check in, check out, data import)&lt;/li&gt;
	&lt;li&gt;Support multiple concurrent exports:
	&lt;ul&gt;
		&lt;li&gt;daily&lt;/li&gt;
		&lt;li&gt;monthly&lt;/li&gt;
		&lt;li&gt;annually&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;Large exports are split into smaller files:
	&lt;ul&gt;
		&lt;li&gt;Number of records per file can be configured on the tenant level through API  &lt;b&gt;nice to have&lt;/b&gt;&lt;/li&gt;
		&lt;li&gt;The number of records in the file is consistent throughout all exports&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;Compress all files generated in one export job into one directory and provide the link to it similarly as it is done currently for single files.&lt;/li&gt;
	&lt;li&gt;Performance confirmed by PTF tests meets expectations.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;&lt;b&gt;Out of scope&lt;/b&gt;&lt;br/&gt;
 *Support an easy way for triggering the export of all instances/SRS records without the need to first list UUIDs of matching records.&lt;/p&gt;</description>
                <environment></environment>
        <key id="13773">UXPROD-4127</key>
            <summary>Improve Data export performance </summary>
                <type id="10002" iconUrl="https://folio-org.atlassian.net/rest/api/2/universal_avatar/view/type/issuetype/avatar/10322?size=medium">New Feature</type>
                            <parent id="13650">UXPROD-652</parent>
                                    <priority id="10001" iconUrl="https://dev.folio.org/assets/jira-priority/jira-p2.svg">P2</priority>
                        <status id="3" iconUrl="https://folio-org.atlassian.net/images/icons/statuses/inprogress.png" description="This issue is being actively worked on at the moment by the assignee.">In Progress</status>
                    <statusCategory id="4" key="indeterminate" colorName="yellow"/>
                                    <resolution id="-1">Unresolved</resolution>
                                                        <assignee accountid="557058:8629b273-56f1-466d-b7c7-5cbac0c3379b">Magda Zacharska</assignee>
                                                                <reporter accountid="557058:8629b273-56f1-466d-b7c7-5cbac0c3379b">Magda Zacharska</reporter>
                                    <labels>
                            <label>LC-priority2</label>
                            <label>galileo</label>
                            <label>loc</label>
                    </labels>
                <created>Mon, 13 Mar 2023 22:52:34 +0000</created>
                <updated>Mon, 5 Feb 2024 11:15:47 +0000</updated>
                                                            <fixVersion>Quesnelia (R1 2024)</fixVersion>
                                        <due></due>
                            <votes>0</votes>
                                    <watches>4</watches>
                                                                <comments>
                                                            <comment id="18305" author="62a96ae7192edb006f9f1bf9" created="Sun, 14 May 2023 21:59:23 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; class=&quot;user-hover&quot; rel=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; data-account-id=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; accountid=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; rel=&quot;noreferrer&quot;&gt;Magda Zacharska&lt;/a&gt; - is this PTF only work? &lt;/p&gt;</comment>
                                                            <comment id="18306" author="557058:8629b273-56f1-466d-b7c7-5cbac0c3379b" created="Mon, 15 May 2023 16:38:01 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=62a96ae7192edb006f9f1bf9&quot; class=&quot;user-hover&quot; rel=&quot;62a96ae7192edb006f9f1bf9&quot; data-account-id=&quot;62a96ae7192edb006f9f1bf9&quot; accountid=&quot;62a96ae7192edb006f9f1bf9&quot; rel=&quot;noreferrer&quot;&gt;Khalilah Gambrell&lt;/a&gt; - this feature will require some functional changes to support full export and performance improvements so that the larger than 1M records can be supported at once.  The stories will be added after 
    &lt;span class=&quot;jira-issue-macro resolved&quot; data-jira-key=&quot;MDEXP-594&quot; &gt;
                &lt;a href=&quot;https://folio-org.atlassian.net/browse/MDEXP-594&quot; class=&quot;jira-issue-macro-key issue-link&quot;  title=&quot;Spike - investigate options for improving data export performance&quot; &gt;
            &lt;img class=&quot;icon&quot; src=&quot;https://folio-org.atlassian.net/rest/api/2/universal_avatar/view/type/issuetype/avatar/10309?size=medium&quot; /&gt;
            MDEXP-594
        &lt;/a&gt;
                                                    &lt;span class=&quot;aui-lozenge aui-lozenge-subtle aui-lozenge-success jira-macro-single-issue-export-pdf&quot;&gt;Closed&lt;/span&gt;
            &lt;/span&gt;
 is completed.  This will be a major re-work for data export.&lt;/p&gt;</comment>
                                                            <comment id="18307" author="63519767d66d8108a1226c09" created="Wed, 28 Jun 2023 09:16:31 +0000"  >&lt;p&gt;Re-estimated to XXXL taking into account refactoring &lt;a href=&quot;https://folio-org.atlassian.net/wiki/display/FOLIJET/Data+Export+redesign&quot; class=&quot;external-link&quot; rel=&quot;nofollow noreferrer&quot;&gt;https://folio-org.atlassian.net/wiki/display/FOLIJET/Data+Export+redesign&lt;/a&gt; + Data export performance improvement &lt;a href=&quot;https://folio-org.atlassian.net/browse/MDEXP-612&quot; class=&quot;external-link&quot; rel=&quot;nofollow noreferrer&quot;&gt;https://folio-org.atlassian.net/browse/MDEXP-612&lt;/a&gt;&lt;/p&gt;</comment>
                                                            <comment id="18308" author="62a96ae7192edb006f9f1bf9" created="Mon, 10 Jul 2023 21:26:26 +0000"  >&lt;p&gt;Hey &lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; class=&quot;user-hover&quot; rel=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; data-account-id=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; accountid=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; rel=&quot;noreferrer&quot;&gt;Magda Zacharska&lt;/a&gt;. Will this feature be done for &quot;Q&quot; or Poppy release?&lt;/p&gt;</comment>
                                                            <comment id="18309" author="557058:de4eac47-6d4e-4b50-9c3c-4a82ed705e52" created="Mon, 29 Jan 2024 12:15:43 +0000"  >&lt;ul&gt;
	&lt;li&gt;Support multiple concurrent exports:
	&lt;ul&gt;
		&lt;li&gt;daily&lt;/li&gt;
		&lt;li&gt;monthly&lt;/li&gt;
		&lt;li&gt;annually&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; class=&quot;user-hover&quot; rel=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; data-account-id=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; accountid=&quot;557058:8629b273-56f1-466d-b7c7-5cbac0c3379b&quot; rel=&quot;noreferrer&quot;&gt;Magda Zacharska&lt;/a&gt;, it would be great if we could agree on a particular number here regarding how many concurrent export processes should be supported per tenant.&lt;/p&gt;</comment>
                                                            <comment id="18310" author="557058:8629b273-56f1-466d-b7c7-5cbac0c3379b" created="Wed, 31 Jan 2024 19:22:44 +0000"  >&lt;p&gt;&lt;a href=&quot;https://folio-org.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3Ade4eac47-6d4e-4b50-9c3c-4a82ed705e52&quot; class=&quot;user-hover&quot; rel=&quot;557058:de4eac47-6d4e-4b50-9c3c-4a82ed705e52&quot; data-account-id=&quot;557058:de4eac47-6d4e-4b50-9c3c-4a82ed705e52&quot; accountid=&quot;557058:de4eac47-6d4e-4b50-9c3c-4a82ed705e52&quot; rel=&quot;noreferrer&quot;&gt;Taras Spashchenko&lt;/a&gt; please see: &lt;a href=&quot;https://folio-org.atlassian.net/wiki/x/WX0V&quot; class=&quot;external-link&quot; rel=&quot;nofollow noreferrer&quot;&gt;https://folio-org.atlassian.net/wiki/x/WX0V&lt;/a&gt;&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10008">
                    <name>Defines</name>
                                                                <inwardlinks description="is defined by ">
                                        <issuelink>
            <issuekey id="26615">PERF-493</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="63533">MDEXP-110</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="63588">MDEXP-677</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="63635">MDEXP-641</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64044">MDEXP-678</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="63756">MDEXP-109</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64021">MDEXP-612</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64085">MDEXP-623</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64087">MDEXP-624</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64053">MDEXP-634</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64059">MDEXP-642</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64041">MDEXP-672</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64086">MDEXP-622</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64091">MDEXP-626</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64090">MDEXP-627</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64089">MDEXP-628</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64092">MDEXP-629</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64094">MDEXP-630</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64093">MDEXP-631</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64095">MDEXP-632</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="64058">MDEXP-640</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="63617">MDEXP-621</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10006">
                    <name>Gantt End to Start</name>
                                                                <inwardlinks description="has to be done after">
                                        <issuelink>
            <issuekey id="12562">UXPROD-4110</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10003">
                    <name>Relates</name>
                                                                <inwardlinks description="relates to">
                                        <issuelink>
            <issuekey id="64022">MDEXP-611</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Back End Estimate</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10125"><![CDATA[XXXL: 30-45 days]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10054" key="com.atlassian.jira.plugin.system.customfieldtypes:userpicker">
                        <customfieldname>Back End Estimator</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>63519767d66d8108a1226c09</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10055" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Back-End Confidence factor</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10135"><![CDATA[80%]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummarycf">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10057" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Development Team</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10152"><![CDATA[Firebird]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10014" key="com.pyxis.greenhopper.jira:gh-epic-link">
                        <customfieldname>Epic Link</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue key="$xmlutils.escape($text)">Metadata Record Export</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10050" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Front End Estimate</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10097"><![CDATA[Medium < 5 days]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10051" key="com.atlassian.jira.plugin.system.customfieldtypes:userpicker">
                        <customfieldname>Front End Estimator</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>557058:8629b273-56f1-466d-b7c7-5cbac0c3379b</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Front-End Confidence factor</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10109"><![CDATA[20%]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10063" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>PO Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>0.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10019" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>0|i06mkr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10069" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Rank: Cornell (Full Sum 2021)</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10213"><![CDATA[R1]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10020" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10024" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>[CHART] Date of First Response</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Sun, 14 May 2023 21:59:23 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                </customfields>
    </item>
</channel>
</rss>