/
PTF- Performance testing of Individual Big Workflows

PTF- Performance testing of Individual Big Workflows

Overview

 

 

Summary

 

Recommendations & Jiras

 

 

Test Runs

Test 1. OAI - PMH. Tenant: cs00000001_0003(https://park-university.folio.ebsco.com). Number of virtual users- 1.
Test 2. Bulk Holdings edit. Number of loops: 4. Consists of 4 actions: 1) Upload file; 2) Edit; 3) Rollback upload; 4) Edit

Test 3. Bulk Items edit. Number of loops: 4. Consists of 4 actions: 1) Upload file; 2) Edit; 3) Rollback upload; 4) Edit

Test 4. Bulk Users edit. Number of loops: 4. Consists of 4 actions: 1) Upload file; 2) Edit; 3) Rollback upload; 4) Edit

Test 5. List App refresh list. 1 virtual user updates 20 lists in sequence.
Test 6. Data export. 1 virtual user doing data export 2 times with a custom profile and 6 times with a default profile in sequence.

 

Results

Test 1.

transaction

Number Of Samples

Average

Median

pct90

pct95

pct99

Min

Max

TC_RQ_OPIH_/oai/records?verb=ListRecords&apikey=[APIKey]&resumptionToken=[resumptionToken] cs00000001_0002

2745

372 ms

309 ms

434ms

1.22 s

1.70 s

263 ms

1.70 s

TC_RQ_OPIH_/oai/records?verb=ListRecords&metadataPrefix=marc21_withholdings&apikey=[APIKey]

29

808 ms

662 ms

3.17 s

5.75 s

6.61 s

286ms

6.61 s

Test 2.

TC_BE: HOLDINGS_RECORD upload cs00000001_0003

4.00

1.06 min

1.04 min

1.17 min

1.17 min

1.17 min

56.55 s

1.17 min

TC_BE: HOLDINGS_RECORD_rollback In-app edit cs00000001_0003

4.00

2.50 min

2.50 min

2.55 min

2.55 min

2.55 min

2.38 min

2.55 min

TC_BE: HOLDINGS_RECORD_rollback upload cs00000001_0003

4.00

56.61 s

56.60 s

56.82 s

56.82 s

56.82 s

56.28 s

56.82 s

TC_main_BE: HOLDINGS_RECORD In-app edit cs00000001_0003

4.00

2.36 min

2.38 min

2.46 min

2.46 min

2.46 min

2.30 min

2.46 min

transaction

NumberOfSamples

Average

Median

pct90

pct95

pct99

Min

Max

BE_GET - HOLDINGS_RECORD- update - preview

8.00

328.20 ms

320.88 ms

421.00 ms

421.00 ms

421.00 ms

229.00 ms

421.00 ms

BE_GET- HOLDINGS_RECORD - update  - download preview items file

8.00

277.68 ms

264.57 ms

344.00 ms

344.00 ms

344.00 ms

142.00 ms

344.00 ms

BE_GET-HOLDINGS_RECORD - update - preview-commit

8.00

335.21 ms

327.88 ms

375.00 ms

375.00 ms

375.00 ms

253.00 ms

375.00 ms

BE_GET_locations

8.00

100.65 ms

106.94 ms

182.00 ms

182.00 ms

182.00 ms

48.00 ms

182.00 ms

BE_HOLDINGS_RECORD  - GET errors

8.00

67.52 ms

64.00 ms

115.00 ms

115.00 ms

115.00 ms

14.00 ms

115.00 ms

BE_HOLDINGS_RECORD  - GET preview

8.00

603.27 ms

502.80 ms

1.18 s

1.18 s

1.18 s

182.00 ms

1.18 s

BE_HOLDINGS_RECORD - GET errors

8.00

53.01 ms

52.10 ms

62.00 ms

62.00 ms

62.00 ms

44.00 ms

62.00 ms

BE_HOLDINGS_RECORD- start bulk edit job

8.00

870.99 ms

774.48 ms

1.60 s

1.60 s

1.60 s

359.00 ms

1.60 s

BE_HOLDINGS_RECORD_ GET_bulk-operations

8.00

74.06 ms

69.45 ms

124.00 ms

124.00 ms

124.00 ms

15.00 ms

124.00 ms

BE_HOLDINGS_RECORD_ GET_bulk-operations_progress

8.00

33.58 ms

30.38 ms

47.00 ms

47.00 ms

47.00 ms

17.00 ms

47.00 ms

BE_HOLDINGS_RECORD_ GET_bulk-operations_prview_progress

8.00

24.68 ms

23.94 ms

131.00 ms

131.00 ms

131.00 ms

13.00 ms

131.00 ms

BE_HOLDINGS_RECORD_POST_bulk-operations_upload

8.00

392.91 ms

320.33 ms

838.00 ms

838.00 ms

838.00 ms

130.00 ms

838.00 ms

BE_ITEM -GET location

8.00

195.67 ms

164.45 ms

354.00 ms

354.00 ms

354.00 ms

26.00 ms

354.00 ms

BE_Identifiers - HOLDINGS_RECORD - download-MATCHED_RECORDS_FILE

8.00

534.87 ms

517.35 ms

672.00 ms

672.00 ms

672.00 ms

312.00 ms

672.00 ms

BE_POST - HOLDINGS_RECORD - update - start

16.00

47.68 ms

43.20 ms

101.00 ms

101.00 ms

101.00 ms

13.00 ms

101.00 ms

BE_POST - HOLDINGS_RECORD -update

8.00

120.99 ms

105.30 ms

219.00 ms

219.00 ms

219.00 ms

32.00 ms

219.00 ms

BE_While-HOLDINGS_RECORD_ GET_bulk-operations

17.00

30.99 ms

31.80 ms

82.00 ms

82.00 ms

82.00 ms

16.00 ms

82.00 ms

BE_While-HOLDINGS_RECORD_ GET_bulk-operations_progress

196.00

24.16 ms

21.34 ms

37.00 ms

71.80 ms

991.52 ms

14.00 ms

1.00 s

GET /holdings-note-types READ COMMENT

4.00

1.10 s

920.42 ms

1.90 s

1.90 s

1.90 s

61.00 ms

1.90 s

TC_BE: HOLDINGS_RECORD upload cs00000001_0003

4.00

1.06 min

1.04 min

1.17 min

1.17 min

1.17 min

56.55 s

1.17 min

TC_BE: HOLDINGS_RECORD_rollback In-app edit cs00000001_0003

4.00

2.50 min

2.50 min

2.55 min

2.55 min

2.55 min

2.38 min

2.55 min

TC_BE: HOLDINGS_RECORD_rollback upload cs00000001_0003

4.00

56.61 s

56.60 s

56.82 s

56.82 s

56.82 s

56.28 s

56.82 s

TC_main_BE: HOLDINGS_RECORD In-app edit cs00000001_0003

4.00

2.36 min

2.38 min

2.46 min

2.46 min

2.46 min

2.30 min

2.46 min

Test 3

TC_BE: ITEM upload cs00000001_0003

4.00

3.86 min

3.85 min

4.06 min

4.06 min

4.06 min

3.36 min

4.06 min

TC_BE: ITEM_rollback upload cs00000001_0003

4.00

3.60 min

3.60 min

3.64 min

3.64 min

3.64 min

3.45 min

3.64 min

TC_BE: ITEM_rollback_ in-app edit cs00000001_0003

4.00

53.21 s

1.03 min

1.54 min

1.54 min

1.54 min

22.22 s

1.54 min

TC_main_BE: ITEM_ in-app edit cs00000001_0003