[Orchid] Combined Bulk edit + Check-in-check-out
Overview
Test goal is to assess performance impact and dependency between Check-in/Check-out and Bulk Edit functionality.
Ticket: - PERF-402Getting issue details... STATUS
Summary
Test results showed next influence on performance of two scenarios being run in parallel:
- Degradation for Bulk Edit is between -2.1% and +14.9%. Degradation for Check-in is between -0.6% and +26%. Degradation for Check-out is between -1% and +6%.
- The highest degradation (absolute numbers) was observed for Bulk Edit operation for 100k Items. Degradation was 10 minutes (+7.8%).
- Average Service CPU consumption increase (for parallel tests) is about 10%, DB CPU consumption increase is about 5%.
- Overall, there is no specific tendency in results comparison. Additional tests may be required for further investigation.
There are some errors observed during testing of Bulk Edit operation for 100k Items. Errors are connected to the items being processed, about 0.03% of the whole amount. Possible cause of these errors is that some items were duplicated in CICO script and were reused there. It didn't have any impact on the performance.
Test Runs
Test number | Test | Duration of CI/CO | Timeframe Bulk Edit | Timeframe CICO |
---|---|---|---|---|
1. | Bulk edit 10k Items | - | 3/30/2023, 7:44 AM - 3/30/2023, 7:59 AM | - |
2. | Bulk edit 100k Items | - | 3/31/2023, 4:08 PM - 3/31/2023, 6:29 PM | - |
3. | Bulk edit 10k Users | - | 3/30/2023, 8:33 AM - 3/30/2023, 8:43 AM | - |
4. | Bulk edit 10k Holdings | - | 3/30/2023, 9:11 AM - 3/30/2023, 9:26 AM | - |
5. | Bulk edit 10k Items + 10k Users + 10k Holdings | - | 4/3/2023, 12:02 PM - 4/3/2023, 12:18 PM Items 4/3/2023, 12:03 PM - 4/3/2023, 12:13 PM Users 4/3/2023, 12:03 PM - 4/3/2023, 12:18 PM Holdings | - |
6. | CI/CO 8 users | 30 mins | - | |
7. | CI/CO 8 users + Bulk edit 10k Items | 30 mins | 3/29/2023, 10:44 AM - 3/29/2023, 11:00 AM | |
8. | CI/CO 8 users + Bulk edit 100k Items | 180 mins | 4/2/2023, 7:15 PM - 4/2/2023, 9:56 PM | 4/2/2023, 7:08 PM - 4/2/2023, 10:09 PM |
9. | CI/CO 8 users + Bulk edit 10k Users | 30 mins | 3/29/2023, 11:39 AM - 3/29/202 |