NOTES: This Poppy Jira clones the Orchid CSP Jira MODORDERS-908

Overview:

If tenant contains large number of Organizations (possibly >5000, tested on PTF NLA env with almost 80 000) - request to load organizations for mapping fails
Steps to Reproduce:

1. Log into PTF NLA env (or any other with large number of organizations, make sure the orders.cache.mapping.parameters.settings.limit is overwritten to be large than number of organizations)

2. Try to run DI job creating Orders

Expected Results:

DI job completes successfully, Orders are created, Vendors are mapped correctly
Actual Results:

Job completes with errors (see screenshot and attached log)

Additional Information:

Default limit for loading Organizations is set to 1000 and needs to be overwritten for larger data sets as specified in release notes for Orchid https://folio-org.atlassian.net/wiki/display/REL/Orchid+%28R1+2023%29+Release+Notes

• NLA has ca. 80K Orgs (plan for 100K)

• LOC has ca. 40K Orgs (plan for 50K)

• Other libraries have 15-20K Orgs

Interested parties: owners of mod-orders and mod-organizations 

BE notes: measure how much memory would the cache of 90k organizations take. Possible reuse the solution for acquiring necessary data in a series of requests (see example https://github.com/folio-org/mod-invoice/commit/42542eaad9c81722a99684f98397ac86f71203ff). Test on PTF NLA env. If cache takes too much memory, think of another solution for Poppy (if so - create separate Jira).