Overview
Bulk Edit - Establish a performance baseline for Items bulk updates PERF-406
- How long does it take to export 100, 1000, 10k, and 100K records?
- Use it for up to 5 concurrent users.
- Run consecutively four jobs editing 10k item records
- Run simultaneously four jobs editing 10k item records
- Look for a memory trend and CPU usage
Summary
Test report for Bulk Edits items-app functionality 2023-03-08.
- 10k records per user, 5 users simultaneously (50k records total) can be uploaded and edited in about 20 minutes which is about 8 min faster compared to Nolana (about 28 min).
- The memory of mod-inventory-storage was high at 109% but stable. No memory leaks were found.
- CPU for mod-users was up to 125% (5 concurrent jobs 10k records updating). For all other modules did not exceed 65% for all of the tests.
- For all records number (100, 1k,10k), and 5 concurrent jobs - RDS CPU utilization did not exceed 60%.
Results
Test Runs
1#
| 1 concurrent job | ||
|---|---|---|
| Number of records | Duration | Comments |
| 100 | 1 min 9 s | |
| 1000 | 2 min 36 s | |
| 10k | 17 min 50 s | |
| 50k | 1 hour 58 min | or Error in about 28-33 min Connection reset (SocketException) PERF-334 - Getting issue details... STATUS |
| 100k | always FAILD | Error in about 28-33 min Connection reset (SocketException) PERF-334 - Getting issue details... STATUS |
2#
Items App 10k records 3, 4, and 5 concurrent jobs
| 10k records for each job | |
| Number of concurrent jobs | Duration |
|---|---|
| 1 | 17 min 50 s |
| 3 | 18 min 50 s |
| 4 | 19 min 10 s |
| 5 | 20 min 20 s |
3#
consecutively four jobs editing 10k item records
| Job # | Job duration (run 2) | Job duration (run 1) |
|---|---|---|
| 1 | 17 min 47 s | 18 min 49 s |
| 2 | 17 min 53 s | 18 min 26 s |
| 3 | 17 min 45 s | 20 min 44 s |
| 4 | 18 min 5 s | ERROR occurs: We encountered an internal error. Please try again. (Service: S3, Status Code: 500, Request ID: 5W7F75FMHHH3KDWT, Extended Request ID: 36K8tkhFQHS1Mjt7sZc4jYrBduBWO/psei+33ZIIOnhrytq7Eie3mjDALtBplhZxSJv4CfrZpnw8Z6nqmz03ZB7b3yiRdecyXfZ/ZtEmN4g=) (S3Excepti |
4#
Items App 5 concurrent jobs
| 5 concurrent jobs | Orchid | Nolana | Morning Glory |
|---|---|---|---|
"BARCODE". Records number per 1 user | Total time | Total time | Total time |
| 100 | 1 min 10 s | 18 sec | 25-27 sec |
| 1000 | 2 min 40 s | 3 min | 4 min |
| 10k | 20 min 20 s | 28 min | 30 min |
| 25k | Results are not representative because of | 1 hour 3 min | 50 min |
| 50k | Results are not representative because of | about 2 hours for successful jobs. | - |
* "-" test was not performed due to errors that occurred
Memory usage
For all test runs
The memory of mod-inventory-storage was high at 109% but stable. No memory leaks were found.
Instance CPU utilization
Run #1
Run #2 & #3
Service CPU utilization
Run #1
Run #2 & #3
RDS CPU utilization
Run #1
Run #2 & #3
