[Orchid] Combined Bulk edit + Check-in-check-out

Overview

Test goal is to assess performance impact and dependency between Check-in/Check-out and Bulk Edit functionality.

Ticket: PERF-402 - Getting issue details... STATUS

Summary

Test results showed next influence on performance of two scenarios being run in parallel:

  • Degradation for Bulk Edit is between -2.1% and +14.9%. Degradation for Check-in is between -0.6% and +26%. Degradation for Check-out is between -1% and +6%. 
  • The highest degradation (absolute numbers) was observed for Bulk Edit operation for 100k Items. Degradation was 10 minutes (+7.8%).
  • Average Service CPU consumption increase (for parallel tests) is about 10%, DB CPU consumption increase is about 5%.
  • Overall, there is no specific tendency in results comparison. Additional tests may be required for further investigation.

There are some errors observed during testing of Bulk Edit operation for 100k Items. Errors are connected to the items being processed, about 0.03% of the whole amount. Possible cause of these errors is that some items were duplicated in CICO script and were reused there. It didn't have any impact on the performance.

Test Runs 

Test number

Test

Duration of CI/CO

Timeframe Bulk EditTimeframe CICO

1.

Bulk edit 10k Items -3/30/2023, 7:44 AM - 3/30/2023, 7:59 AM-

2.

Bulk edit 100k Items -3/31/2023, 4:08 PM - 3/31/2023, 6:29 PM-

3.

Bulk edit 10k Users-3/30/2023, 8:33 AM - 3/30/2023, 8:43 AM

-

4.Bulk edit 10k Holdings-3/30/2023, 9:11 AM - 3/30/2023, 9:26 AM-
5.Bulk edit 10k Items + 10k Users + 10k Holdings-

4/3/2023, 12:02 PM - 4/3/2023, 12:18 PM Items

 4/3/2023, 12:03 PM - 4/3/2023, 12:13 PM Users 

4/3/2023, 12:03 PM - 4/3/2023, 12:18 PM Holdings

-
6.CI/CO 8 users30 mins-

3/29/2023, 09:42 AM - 3/29/2023, 10:12 AM

7.CI/CO 8 users + Bulk edit 10k Items 30 mins3/29/2023, 10:44 AM - 3/29/2023, 11:00 AM

3/29/2023, 10:41 AM - 3/29/2023, 11:12 AM

8.CI/CO 8 users + Bulk edit 100k Items 180 mins

4/2/2023, 7:15 PM -  4/2/2023, 9:56 PM

4/2/2023, 7:08 PM -  4/2/2023, 10:09 PM
9.CI/CO 8 users + Bulk edit 10k Users30 mins3/29/2023, 11:39 AM - 3/29/202