Record Export Limit set in LDP App Settings does not change the export limit in app

Description

Overview:
Steps to Reproduce:

  1. Log into some FOLIO environment

  2. Go to Settings > LDP App

  3. Set "Maximum number to export" to 100,000

  4. Click Save

  5. Go to LDP App

  6. Run a report that results in the message, "Found more than 1000 records". 

  7. Click the CSV button to export the results

  8. Open the CSV file

  9. Only 1000 results are exported, the last line of the CSV file states, "...More records..."

Expected Results:

The ** total number of records, up to 10,000 will be exported

 

LDP produced reports should export up to 10,000 rows as a csv file
Actual Results:

LDP export stops at 1,000 records
Additional Information:
URL:
Interested parties:

CSP Request Details

None

CSP Rejection Details

None

Potential Workaround

None

Checklist

hide

TestRail: Results

Activity

Show:

Mike Taylor September 1, 2023 at 9:33 PM

Not at present, no. If that's a requirement, please feel free to file a new issue, and we'll see what happens with prioritization.

(The reason this isn't trivial: although there are no hard limits on how many records can be fetched from the backend in a single request, at some point a response is just going to be too big for something in the system. So to support arbitrarily large responses in downloads we'll need to add paging to the download system. That's not rocket science, but it's complex enough to be its own whole thing.)

Lisa McColl September 1, 2023 at 6:58 PM

Are there any plans to allow more than 10,000 rows to export in a report? 

Nassib Nassar March 13, 2023 at 3:17 PM

Note that the table public.srs_marctab should not be enabled at present with this app, as documented at: https://github.com/folio-org/ui-ldp/blob/master/README.md#database-issues

Mike Taylor February 9, 2023 at 5:23 PM

I've modified the UI code to explicitly request a limit equal to the maximum number to export. This works up to the 2923 records in SRS MARCtab.

Mike Taylor February 9, 2023 at 4:29 PM

Anyway the solution on the client side is for the CSV download routine to explicitly request the number of record specified in the limits page. I'll get on that.

Done

Details

Assignee

Reporter

Tester Assignee

Labels

Priority

Sprint

Development Team

Thor

Fix versions

Release

Orchid (R1 2023) Bug Fix

RCA Group

Interface dependency mismatch

Affected Institution

!!!ALL!!!

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs
Created October 18, 2022 at 12:18 PM
Updated September 1, 2023 at 9:33 PM
Resolved February 9, 2023 at 5:23 PM
TestRail: Cases
TestRail: Runs

Flag notifications