...
Retesting of EDIFACT for Nolana release in scope of PERF-311. EDIFACT is one of data-export-worker workflows that includes organisations and orders export to FTP server.
...
- EDIFACT is stable and it can successfully export up to 3000 orders if it's one job at the time;
- For 3-10 jobs EDIFACT export is unstable due to FTP server issues;
- We still can observe same behavior as it was in previous report EDIFACT Order Export workflow report 3 [Morning Glory]. The higher number of orders causes higher success rate. However for Nolana release we wasn't able to reach success rate higher than 60% due to FTP issues.
- Duration of exports decreased in comparison to Morning Glory.
- Most of resource usage decreased in comparison to Morning Glory release.
- Ticket to investigate FTP server issue
Jira Legacy server System JiraJIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODEXPW-302
Note: right now FTP server is located in US.EAST-1 region while our env is located in US.WEST-2 which might cause higher failure rate. In future we'll retest EDIFACT with new FTP server on US.WEST-2.
Summary after retest
- EDIFACT after fixing
is able to complete 3000 orders 10 jobs simultaneously;Jira Legacy server System JIRA serverId 01505d01-b853-3c2e-90f1-ee9b165564fc key MODEXPW-302 - FTP issue is no longer reproducible;
- No additional issues were found;
- We still can observe small memory leak on mod-data-export-worker (1-2% per jobs set) We'll investigate it in scope of PERF-359
Test Results
| Test # | Concurrent jobs | Orders per job | Success rate | Time | ERRORS |
|---|---|---|---|---|---|
1 | 3 | 1000 | 2/3 | 1min 17s | File upload failed. 450 PASV: data transfer in progress (FtpException) |
| 2 | 5 | 1000 | 2/5 | 1min 17s | null (NullPointerException) |
| 3 | 10 | 1000 | 2/10 | 1min 20s | (FtpException) File upload failed. 450 PASV: data transfer in progress (FtpException) File upload failed. 226 Transfer complete (FtpException) |
| 4 | 10 | 2000 | 6/10 | 2m 54 s | Connection is not open (IOException) null (NullPointerException) Socket closed (SocketException) |
| 5 | 10 | 3000 | 6/10 | 4min 30s | Socket closed (SocketException) Connection closed without indication. (FTPConnectionClosedException) Connection is not open (IOException) |
...
In scope of
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
...
We still can observe increasing of memory usage on mod-data-export-worker module. We'll investigate it in scope of PERF-359
