/
PTF - Performance testing of CPU=0 for Services (mcpt)

PTF - Performance testing of CPU=0 for Services (mcpt)

Sep 03, 2024

Overview

  • In this report, PTF investigates the impact of setting CPU allocations to 0 units across all tasks within an AWS ECS cluster. The purpose of this study is to determine whether removing CPU constraints reveals the actual CPU usage of the tasks and to assess how this adjustment affects overall performance. By comparing key workflows across different environments, we aim to identify any potential changes in efficiency, throughput, or resource utilization that may result from setting CPU = 0. The findings from these tests will help inform best practices for resource allocation and performance optimization within ECS clusters.

PERF-959: Test CPU = 0Closed 

Summary

  • During the tests Parameter CPU=0 improved performance for a several workflows, like MSF_TC: mod search by auth query, MSF_TC: mod search by contributors, MSF_TC: mod search by title query and ULR_TC: Users loan Renewal Transaction.

  • No memory leaks, memory consumption was stable during all of the tests.

  • Tests had 100% errors count for AIE_TC: Create Invoices, AIE_TC: Invoices Approve, AIE_TC: Paying Invoices, TC: Receiving-an-Order-Line, Unreceiving-a-Piece and Unreceiving-a-Piece Workflows because data was not regenerated.  

Test Runs

Test #

Description

Status

Test #

Description

Status

Test 1

The Baseline MCPT Environment configuration was applied, and CPU=0 was set for all modules,  Fixed Load (average case) MOBIUS test was run.

Completed

Test 2

The Baseline MCPT Environment configuration was applied, and CPU=0 was set for all modules,  Fixed Load (high load case) MOBIUS test was run.

Completed

Test 3

The Baseline MCPT Environment configuration was applied, and CPU=0 was set for all modules,  Fixed Load (average case) MOBIUS test was run (rerun Test 1).

Completed

Test 4

The Baseline MCPT Environment configuration was applied, and CPU=1 was set for all modules,  Fixed Load (average case) MOBIUS test was run.

Completed

Test 5

The Baseline MCPT Environment configuration was applied, and CPU=2 was set for all modules,  Check In\Check Out with 20 users for one tenant on 30 minutes test was run.

Completed

Test 6

The Baseline MCPT Environment configuration was applied, and CPU=2 was set for all modules,  Data Import - Create with 25k and 100k records files tests were run.

Completed

Test 7

The Baseline QCP1 Environment configuration was applied, and CPU=2 was set for all modules,  Check In\Check Out with 20 users for one tenant on 30 minutes test was run.

Completed

Test 8

The Baseline QCP1 Environment configuration was applied, and CPU=2 was set for all modules,  Data Import - Create with 25k and 100k records files tests were run.

Completed

Test 9

The Baseline QCP1 Environment configuration was applied, and CPU=0 was set for all modules,  Check In\Check Out with 20 users for one tenant on 30 minutes test was run.

Completed

Test 10

The Baseline QCP1 Environment configuration was applied, and CPU=0 was set for all modules,  Data Import - Create with 25k and 100k records files tests were run.

Completed

Test Results

This table contains durations for all Workflows. 

Workflow

Test 1
(average case)

CPU=0

Test 2
(high load)

CPU=0

Test 3
(average case) 

CPU=0

Test 4
(average case) 

CPU=1

Workflow

Test 1
(average case)

CPU=0

Test 2
(high load)

CPU=0

Test 3
(average case) 

CPU=0

Test 4
(average case) 

CPU=1

 

Average
(milliseconds)

Errors

Average
(milliseconds)

Errors

Average
(milliseconds)

Errors

Average
(milliseconds)

Errors

AIE_TC: Create Invoices

8350

100%

13458

100%

7421

100%

8251

100%

AIE_TC: Invoices Approve

3180

100%

5251

100%

2960

100%

3088

100%

AIE_TC: Paying Invoices

3289

100%

4919

100%

3060

100%

3285

100%

CICO_TC_Check-In Controller

2323

0%

3322

7%

2228

0%

2313

0%

CICO_TC_Check-Out Controller

4154

0%

5700

10%

3896

0%

3985

0%

CSI_TC:Share local instance

13008

19%

14781

14%

12969

20%

13022

19%

DE_Exporting MARC Bib records custom workflow

52983

0%

379912

95%

78759

0%

100700

0%

DE_Exporting MARC Bib records workflow

42785

0%

402026

98%

73957

0%

109794

0%

EVA_TC: View Account

803

3%

962

3%

700

1%

832

3%

ILR_TC: Create ILR

1527

0%

2215

4%

1451

0%

1518

0%

MSF_TC: mod search by auth query

672

0%

1830

7%

3096

4%

1023

0%

MSF_TC: mod search by boolean query

165

0%

485

2%

737

1%

212

0%

MSF_TC: mod search by contributors

398

0%

1063

3%

1664

2%

604

0%

MSF_TC: mod search by filter query

286

0%

713

2%

1070

2%

417

0%

MSF_TC: mod search by keyword query

284

0%

658

1%

1006

1%

422

0%

MSF_TC: mod search by subject query

407

0%

1112

1%

1530

2%

623

0%

MSF_TC: mod search by title query

1031

0%

2449

1%

2907

1%

1758

0%

OPIH_/oai/records

6042

0%

4649

100%

3587

0%

5448

0%

POO_TC: Add Order Lines

55334

0%

99076

19%

54440

0%

55224

0%

POO_TC: Approve Order

42567

0%

79022

12%

42191

0%

42907

0%

POO_TC Create Order

31933

0%

56468

13%

31406

0%

32166

0%

RTAC_TC: edge-rtac

4150

0%

4726

0%

4084

0%

4099

0%

SDIC_Single Record Import (Create)

13777

19%

20475

13%

13773

20%

13873

19%

SDIU_Single Record Import (Update)

19549

0%

36639

16%

19582

1%

19568

0%

TC: Receiving-an-Order-Line

45895

100%

83735

100%

45888

100%

46890

100%

Serials-Receiving-Workflow

48584

100%

86692

100%

47338

100%

48019

100%

Unreceiving-a-Piece

8080

100%

13729

100%

8013

100%

8297

100%

ULR_TC: Users loan Renewal Transaction

3189

0%

4818

6%

2970

0%

3125

0%