[MODEXPW-255] Bulk edit: 10528 upstream timed out (110: Connection timed out) Error Created: 15/Sep/22 Updated: 07/Nov/22 Resolved: 27/Oct/22 |
|
| Status: | Closed |
| Project: | mod-data-export-worker |
| Components: | None |
| Affects versions: | None |
| Fix versions: | 2.0.0 |
| Type: | Bug | Priority: | P2 |
| Reporter: | Olga Kondratenko | Assignee: | Siarhei Charniak |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original estimate: | Not Specified | ||
| Environment: |
https://ptf-rmb.int.aws.folio.org/(lcp2) |
||
| Attachments: |
|
||||||||||||||||||||||||||||||||||||
| Issue links: |
|
||||||||||||||||||||||||||||||||||||
| Sprint: | Firebird - Sprint 150, Firebird - Sprint 151 | ||||||||||||||||||||||||||||||||||||
| Story Points: | 3 | ||||||||||||||||||||||||||||||||||||
| Development Team: | Firebird | ||||||||||||||||||||||||||||||||||||
| Release: | Nolana (R3 2022) | ||||||||||||||||||||||||||||||||||||
| RCA Group: | TBD | ||||||||||||||||||||||||||||||||||||
| Description |
|
If there are multiple concurrent bulk edit jobs of the larger data sets (~10k records) and some of them have subset of records that do not need change in value then the Preview on the "Are you sure" form takes a long time to load and fails on timeout, due to [error] 50#50: *10528 upstream timed out (110: Connection timed out) Steps to Reproduce:
Expected Results: *"Are you sure?" form opens "Preview of the records to be changed" is NOT uploaded, request fails on timeout Log 2022/09/15 11:44:07 [error] 50#50: *10528 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.23.35.53, server: , request: "POST /mod-data-export-worker/bulk-edit/abfe0d91-7fb0-4599-9d73-c6331b55ad0c/items-content-update/upload HTTP/1.1", upstream: "http://127.0.0.1:8082/bulk-edit/abfe0d91-7fb0-4599-9d73-c6331b55ad0c/items-content-update/upload", host: "pvt.lb.lcp2.folio-eis.us-east-1:8051" Response time for POST /bulk-edit/$ {jobId}/items-content-update/upload For 100 records - about 10-20 seconds Attached log files Additional information: |
| Comments |
| Comment by Ann-Marie Breaux (Inactive) [ 16/Sep/22 ] |
|
HI Magda Zacharska There was no dev team on this bug, but I think it's Firebird. Please adjust if that's not correct. Thank you! |
| Comment by Mikita Siadykh [ 20/Sep/22 ] |
|
expected to be fixed in
|
| Comment by Magda Zacharska [ 26/Sep/22 ] |
|
The issue will be fixed in Nolana as it closely relates to
|
| Comment by Magda Zacharska [ 07/Oct/22 ] |
|
Hi Siarhei Charniak - can this ticket be verified on bulk edit rancher environment? |
| Comment by Magda Zacharska [ 10/Oct/22 ] |
|
Hi Siarhei Charniak - snapshot environments don't have enough data to do the verification. How this fix could be verified? |
| Comment by Siarhei Charniak [ 12/Oct/22 ] |
|
Hi Magda Zacharska, Yauheniya Kryshtafovich Verified on folio-snapshot-2 environment. Response for POST /bulk-edit/$ {jobId}/items-content-update/upload for 10k items was received in a few seconds: |
| Comment by Yauheniya Kryshtafovich [ 12/Oct/22 ] |
|
Hi, Magda Zacharska and Siarhei Charniak The story verified on snapshot-2: 6. The "Are you sure?" form is uploading (approximately 5 sec) |
| Comment by Magda Zacharska [ 14/Oct/22 ] |
|
Hi Yauheniya Kryshtafovich and Siarhei Charniak - I uploaded 10k item barcodes (file attached) After one hour, the response returned 504 and Are you sure? form shows 0 records: There is still no entry in the Export Manager. Please check the logs on the server side - to see if there is an explanation for this behavior. |
| Comment by Siarhei Charniak [ 14/Oct/22 ] |
|
Hi Magda Zacharska, those changes are not yet deployed on perf environment. |
| Comment by Yauheniya Kryshtafovich [ 17/Oct/22 ] |
|
Hi, Magda Zacharska and Siarhei Charniak The story was checking on https://folio-dev-firebird-diku.ci.folio.org/ , the "Are you sure" form is populated in several seconds (~5 sec), but after clicking on "Commit changes" button* the process of updating takes a long time*. For example, I've uploaded file with 10K Items barcodes >> Changed Available status and Temporary location to the same values >> The progress bar appeared >>* In 1 hour* (according to DevTools) only 1100 Items were updated (approx. 11%) |
| Comment by Yauheniya Kryshtafovich [ 25/Oct/22 ] |
|
Hi, Magda Zacharska |