...
Bulk Edits - Establish a performance baseline for Items bulk updates PERF-406 in the Orchid release that has architectural changes that were implemented in UXPROD-3842. The goal is to make sure the performance did not deteriorate in comparison to Nolana release. Some questions can help us to determine the performance and stability of the new Bulk Edits implemenationimplementation:
- How long does it take to export 100, 1000, 10k, and 100K records?
- Can it be used with up to 5 concurrent users?
- Run consecutively four jobs editing 10k item records
- Run simultaneously four jobs editing 10k item records
- Look for a memory trend and CPU usage
...
More than 50% of jobs FAILED in about 28-33 min.
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
From time to time Job FAILED with the error from the s3 bucket
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Results
Test Runs
...
| Number of records | Duration | Comments | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 1 min 9 s | |||||||||
| 1000 | 2 min 36 s | |||||||||
| 10k | 17 min 50 s | |||||||||
| 50k | 1 hour 58 min | or Error in about 28-33 min Connection reset (SocketException)
| ||||||||
| 100k | always FAILD | Error in about 28-33 min Connection reset (SocketException)
|
2# Items App 10k records 3, 4, and 5 concurrent jobs
...
| "BARCODE". Records number per 1 user | Orchid (Total Time) | Nolana (Total Time) | Morning Glory (Total Time) | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 1 min 10 s | 18 sec | 25-27 sec | ||||||||
| 1000 | 2 min 57 s | 3 min | 4 min | ||||||||
| 10k | 20 min 20 s | 28 min | 30 min | ||||||||
| 25k | Results are not representative because of
| 1 hour 3 min | 50 min | ||||||||
| 50k | Results are not representative because of
| about 2 hours for successful jobs. | - |
...