Data Export Test Report (Mobius)

Owned by Mykhailo Petryshyn
Last updated: Mar 04, 2024
16 min read

Overview

This document contains the results of testing Data Export tests on 61 tenants (excluding the central tenant) on MCPT environment:

  • DE_instances T1(500-1K-2k). (MARC BIB) on Mobius environment with Data Export tests for 500, 1k, 2k. with Default instances export profile.

  • DE_instances T2(Max). (MARC BIB) on Mobius environment with Data Export tests for a maximal number of instances on each member tenant(The exact number of instances is in the section “Errors / Additional information”). with Default instances export profile.

  • DE_holdings T3(500-1K-2k).Holdings on Mobius environment with Data Export tests for 500, 1k, 2k. with Default holdings export profile.

  • DE_holdings T4(Max). Holdings on Mobius environment with Data Export tests for a maximal number of instances on each member tenant(The exact number of instances is in the section “Errors / Additional information”) with Default holdings export profile.

  • DE_authority T5(500-1K-2k). Authority on Mobius environment with Data Export tests for 500, 1k, 2k. with Default authority export profile.

Ticket: PERF-777: MOBIUS baseline tests: Data ExportClosed

Recommendations & Jiras

Add more CPU for

Summary

The total duration:

  • DE_instances T1 for: 500 records is 473 seconds; 1000 records is 922 seconds; and 2000 is 1724 seconds;

  • DE_instances T2(Max) about 23 hours;

  • DE_holdings T3 for: 500 records is 445 seconds; 1000 records is 508 seconds; and 2000 is 842 seconds;

  • DE_holdings T4(Max) about 9 hours and 45 minutes;

  • DE_authority T5 for: 500 records is 331 seconds; 1000 records is 335 seconds; and 2000 is 432 seconds.

Data-export duration statistics:

 

Data export

Instances

Holdings

Authority

500,

sec

1000 ,

sec

2000 ,

sec

500 ,

sec

1000 ,

sec

2000,

sec

500 ,

sec

1000 ,

sec

2000,

sec

Average duration

83

426

1184

10

87

405

5,9

6,2

10,6

Minimal duration

12

32

127

5

16

32

5,8

5,7

1,15

Maximal duration

131

571

1372

29

127

504

6,6

11,7

15,8

75t percentile

114

539

1350

12

113

490

5,8

6,1

14,4

90t percentile

126

553

1362

19

119

500

5,9

6,5

15,5

DE_instances T1(500-1K-2k). The duration of instance date-export for 500 recordings increased from 12 seconds for the first tenant to about 100 for the 33rd tenant, then the processing time was approximately unity from 100 to 120 for tenants 33 to 62. The situation was similar for export dates of 1000 and 2000 records.

DE_holdings T3(500-1K-2k) For 2000 records Holdings data export duration increased from 32 seconds for the first tenant to about 420 sec for the 22nd tenant, then the processing time was approximately from 420 to 470 sec for tenants 23 - 61.

DE_instances T2(Max) and DE_holdings T4(Max) Both tests show a delay in the start time, but for DE_holdings T4(Max) maximal delay is 8 minutes for the files with the largest number of id (Tenant 42, export 640K records). The delay for the instances data-export for the same tenant is 9 hours and 50 minutes.

The duration of the longest data-export for holdings is 7 hours and 40 minutes, and 12 hours and 30 minutes for instances on 42nd tenants.

Recommendations & Jiras

Test Results

DE_instances T1(500-1K-2k). This table contains durations for Data-export for jobs with “Default instances export profile” on 61 tenants with 3 sets of data(500 records; 1000 records; 2000 records). 

Transaction name

DE 500, sec

DE 1K, sec

DE 2K, sec

DE_Exporting MARC Bib records workflow Transaction cs00000001_0001

12

32

127

DE_Exporting MARC Bib records workflow Transaction cs00000001_0002

16

51

207

DE_Exporting MARC Bib records workflow Transaction cs00000001_0003

23

73

330

DE_Exporting MARC Bib records workflow Transaction cs00000001_0004

22

100

494

DE_Exporting MARC Bib records workflow Transaction cs00000001_0005

27

122

606

DE_Exporting MARC Bib records workflow Transaction cs00000001_0006

29

131

704

DE_Exporting MARC Bib records workflow Transaction cs00000001_0007

28

154

782

DE_Exporting MARC Bib records workflow Transaction cs00000001_0008

34

170

875

DE_Exporting MARC Bib records workflow Transaction cs00000001_0009

39

191

936

DE_Exporting MARC Bib records workflow Transaction cs00000001_0010

38

216

965

DE_Exporting MARC Bib records workflow Transaction cs00000001_0011

40

228

1022

DE_Exporting MARC Bib records workflow Transaction cs00000001_0012

45

261

1054

DE_Exporting MARC Bib records workflow Transaction cs00000001_0013

45

277

1082

DE_Exporting MARC Bib records workflow Transaction cs00000001_0014

45

293

1108

DE_Exporting MARC Bib records workflow Transaction cs00000001_0015

52

308

1163

DE_Exporting MARC Bib records workflow Transaction cs00000001_0016

51

331

1161

DE_Exporting MARC Bib records workflow Transaction cs00000001_0017

56

372

1183

DE_Exporting MARC Bib records workflow Transaction cs00000001_0018

56

374

1209

DE_Exporting MARC Bib records workflow Transaction cs00000001_0019

63

399

1232

DE_Exporting MARC Bib records workflow Transaction cs00000001_0020

63

419

1254

DE_Exporting MARC Bib records workflow Transaction cs00000001_0021

68

432

1275

DE_Exporting MARC Bib records workflow Transaction cs00000001_0022

69

457

1271

DE_Exporting MARC Bib records workflow Transaction cs00000001_0023

72

479

1290

DE_Exporting MARC Bib records workflow Transaction cs00000001_0024

74

475

1306

DE_Exporting MARC Bib records workflow Transaction cs00000001_0025

74

489

1300

DE_Exporting MARC Bib records workflow Transaction cs00000001_0026

75

506

1319

DE_Exporting MARC Bib records workflow Transaction cs00000001_0027

85

503

1336

DE_Exporting MARC Bib records workflow Transaction cs00000001_0028

80

502

1331

DE_Exporting MARC Bib records workflow Transaction cs00000001_0029

91

535

1347

DE_Exporting MARC Bib records workflow Transaction cs00000001_0030

87

532

1344

DE_Exporting MARC Bib records workflow Transaction cs00000001_0031

87

530

1357

DE_Exporting MARC Bib records workflow Transaction cs00000001_0032

93

539

1349

DE_Exporting MARC Bib records workflow Transaction cs00000001_0033

97

535

1363

DE_Exporting MARC Bib records workflow Transaction cs00000001_0034

97

547

1357

DE_Exporting MARC Bib records workflow Transaction cs00000001_0035

97

560

1373

DE_Exporting MARC Bib records workflow Transaction cs00000001_0036

107

554

1349

DE_Exporting MARC Bib records workflow Transaction cs00000001_0037

102

557

1359

DE_Exporting MARC Bib records workflow Transaction cs00000001_0038

103

563

1370

DE_Exporting MARC Bib records workflow Transaction cs00000001_0039

109

571

1363

DE_Exporting MARC Bib records workflow Transaction cs00000001_0040

104

548

1364

DE_Exporting MARC Bib records workflow Transaction cs00000001_0041

109

552

1365

DE_Exporting MARC Bib records workflow Transaction cs00000001_0042

115

553

1362

DE_Exporting MARC Bib records workflow Transaction cs00000001_0043

119

497

1363

DE_Exporting MARC Bib records workflow Transaction cs00000001_0044

126

555

1363

DE_Exporting MARC Bib records workflow Transaction cs00000001_0045

121

550

1356

DE_Exporting MARC Bib records workflow Transaction cs00000001_0046

126

553

1352

DE_Exporting MARC Bib records workflow Transaction cs00000001_0047

120

544

1352

DE_Exporting MARC Bib records workflow Transaction cs00000001_0048

131

551

1347

DE_Exporting MARC Bib records workflow Transaction cs00000001_0049

126

546

1340

DE_Exporting MARC Bib records workflow Transaction cs00000001_0050

130

538

1336

DE_Exporting MARC Bib records workflow Transaction cs00000001_0051

127

533

1341

DE_Exporting MARC Bib records workflow Transaction cs00000001_0052

128

533

1337

DE_Exporting MARC Bib records workflow Transaction cs00000001_0053

127

529

1334

DE_Exporting MARC Bib records workflow Transaction cs00000001_0054

123

527

1320

DE_Exporting MARC Bib records workflow Transaction cs00000001_0055

122

516

1320

DE_Exporting MARC Bib records workflow Transaction cs00000001_0056

119

516

1316

DE_Exporting MARC Bib records workflow Transaction cs00000001_0057

114

508

1315

DE_Exporting MARC Bib records workflow Transaction cs00000001_0058

110

503

1306

DE_Exporting MARC Bib records workflow Transaction cs00000001_0059

108

501

1302

DE_Exporting MARC Bib records workflow Transaction cs00000001_0060

101

493

1298

DE_Exporting MARC Bib records workflow Transaction cs00000001_0061

98

487

1289

image-20240206-125717.png

DE_instances T2(Max). The table below contains durations for Data-export for jobs with “Default instances export profile” on 61 tenants with 1 set of data(all of the instances on each tenant). 

 

Tenant

Number of exported instances

Duration

Shift of the start time

 cs00000001_0001

65359

08:34:11.924

0:00:00

 cs00000001_0002

22370

02:01:17.113

00:00:04.576

 cs00000001_0003

136291

15:38:26.969

00:20:55.783

 cs00000001_0004

77785

10:42:11.942

00:02:52.106

 cs00000001_0005

110093

13:57:20.399

00:12:33.693

 cs00000001_0006

293580

17:24:21.58

02:58:03.642

 cs00000001_0007

279493

17:15:17.802

02:55:41.421

 cs00000001_0008

160024

16:21:18.866

00:56:26.929

 cs00000001_0009

110918

14:01:42.358

00:25:51.269

 cs00000001_0010

83254

11:36:56.235

00:14:09.228

 cs00000001_0011

94171

12:43:36.487

00:20:24.292

 cs00000001_0012

227489

16:52:02.623

02:24:44.754

 cs00000001_0013

19131

01:58:23.547

00:01:37.648

 cs00000001_0014

20746

02:16:27.599

00:01:52.916

 cs00000001_0015

26899

03:24:08.545

00:03:01.837

 cs00000001_0016

153333

15:46:35.492

01:22:21.469

 cs00000001_0017

16492

01:41:43.743

00:02:40.122

 cs00000001_0018

22263

02:43:54.315

00:04:28.863

 cs00000001_0019

5312

00:14:46.338

00:02:05.943

 cs00000001_0020

44259

06:30:26.536

00:12:04.781

 cs00000001_0021

83988

11:46:23.477

00:33:39.156

 cs00000001_0022

86900

12:03:06.865

00:36:22.655

 cs00000001_0023

91517

12:27:03.606

00:40:56.469

 cs00000001_0024

385123

15:35:51.105

05:43:10.805

 cs00000001_0025

84215

11:47:31.81

00:36:33.173

 cs00000001_0026

153912

15:32:54.171

01:42:36.675

 cs00000001_0027

48176

07:11:08.729

00:16:44.682

 cs00000001_0028

64556

09:30:37.567

00:25:12.347

 cs00000001_0029

5140

00:16:41.394

00:03:41.85

 cs00000001_0030

97589

12:52:29.07

00:50:52.289

 cs00000001_0031

71895

10:26:16.656

00:31:10.105

 cs00000001_0032

80074

11:22:00.789

00:37:31.626

 cs00000001_0033

45886

06:52:06.447

00:17:36.951

 cs00000001_0034

18240

02:14:18.252

00:07:47.49

 cs00000001_0035

135704

14:55:28.661

01:29:32.543

 cs00000001_0036

114170

13:56:14.427

01:08:43.67

 cs00000001_0037

24226

03:18:25.02

00:09:57.63

 cs00000001_0038

225563

16:13:32.965

03:06:16.602

 cs00000001_0039

128523

14:37:45.055

01:24:25.093

 cs00000001_0040

111992

13:47:45.898

01:08:36.465

 cs00000001_0041

61091

09:03:29.08

00:27:37.435

 cs00000001_0042

634675

12:24:24.995

09:48:38.838

 cs00000001_0043

2831

00:02:12.583

00:04:22.427

 cs00000001_0044

70871

10:19:26.438

00:35:14.19

 cs00000001_0045

78320

11:10:12.277

00:41:17.857

 cs00000001_0046

109677

13:38:14.993

01:08:58.069

 cs00000001_0047

48531

07:19:11.872

00:22:04.318

 cs00000001_0048

53346

08:01:00.977

00:24:42.919

 cs00000001_0049

6952

00:31:27.638

00:06:36.51

 cs00000001_0050

190736

15:54:19.153

02:34:40.768

 cs00000001_0051

351325

15:41:17.61

05:23:26.089

 cs00000001_0052

137940

14:54:13.405

01:39:56.924

 cs00000001_0053

61834

09:11:33.182

00:31:14.104

 cs00000001_0054

16297

02:00:46.997

00:09:40.899

 cs00000001_0055

176009

15:42:52.69

02:21:13.276

 cs00000001_0056

160976

15:28:32.362

02:06:05.583

 cs00000001_0057

22596

03:06:34.087

00:12:13.641

 cs00000001_0058

123819

14:19:45.503

01:27:29.477

 cs00000001_0059

37715

05:38:43.984

00:18:51.151

 cs00000001_0060

38395

05:45:32.811

00:19:17.503

 cs00000001_0061

87117

12:00:00.92

00:53:34.119

DE_holdings T3(500-1K-2k). The table below contains durations for Data-export for jobs with “Default holdings export profile” on 61 tenants with 1 set of data(all of the instances on each tenant). 

Transaction name

DE 500, sec

DE 1K, sec

DE 2K, sec

 Transaction cs00000001_0001

12,03

17,061

32,266

 Transaction cs00000001_0002

5,971

16,078

41,161

 Transaction cs00000001_0003

5,802

16,698

71,987

 Transaction cs00000001_0004

5,783

16,35

93,43

 Transaction cs00000001_0005

5,794

16,898

140,136

 Transaction cs00000001_0006

15,828

41,487

170,289

 Transaction cs00000001_0007

16,312

52,774

213,028

 Transaction cs00000001_0008

27,108

62,747

238,285

 Transaction cs00000001_0009

28,276

70,228

276,41

 Transaction cs00000001_0010

25,084

68,12

296,711

 Transaction cs00000001_0011

19,922

66,926

312,214

 Transaction cs00000001_0012

16,599

69,383

335,515

 Transaction cs00000001_0013

12,316

71,261

356,475

 Transaction cs00000001_0014

12,311

70,142

378,825

 Transaction cs00000001_0015

6,092

68,883

388,384

 Transaction cs00000001_0016

5,824

73,112

394,735

 Transaction cs00000001_0017

5,797

69,045

407,792

 Transaction cs00000001_0018

5,804

67,941

431,42

 Transaction cs00000001_0019

5,817

69,48

438,995

 Transaction cs00000001_0020

5,831

73,761

449,61

 Transaction cs00000001_0021

5,816

74,199

460,276

 Transaction cs00000001_0022

5,821

77,851

465,855

 Transaction cs00000001_0023

5,813

83,318

479,238

 Transaction cs00000001_0024

10,84

88,868

475,196

 Transaction cs00000001_0025

11,293

89,018

490,799

 Transaction cs00000001_0026

11,038

93,308

485,915

 Transaction cs00000001_0027

11,219

96,048

498,511

 Transaction cs00000001_0028

5,809

94,417

489,845

 Transaction cs00000001_0029

15,859

99,562

502,401

 Transaction cs00000001_0030

16,784

104,167

498,288

 Transaction cs00000001_0031

12,269

105,609

499,723

 Transaction cs00000001_0032

11,023

106,738

499,772

 Transaction cs00000001_0033

6,045

107,321

503,951

 Transaction cs00000001_0034

5,806

113,227

501,034

 Transaction cs00000001_0035

5,819

108,428

502,329

 Transaction cs00000001_0036

10,828

112,202

498,247

 Transaction cs00000001_0037

6,033

112,399

500,752

 Transaction cs00000001_0038

5,809

112,614

499,992

 Transaction cs00000001_0039

5,807

113,384

496,618

 Transaction cs00000001_0040

10,818

117,861

496,336

 Transaction cs00000001_0041

5,803

117,082

492,608

 Transaction cs00000001_0042

20,808

118,138

488,454

 Transaction cs00000001_0043

16,492

101,24

259,409

 Transaction cs00000001_0044

17,04

120,386

485,127

 Transaction cs00000001_0045

12,07

126,264

479,953

 Transaction cs00000001_0046

11,083

119,817

478,629

 Transaction cs00000001_0047

6,015

120,362

475,184

 Transaction cs00000001_0048

5,802

119,653

468,99

 Transaction cs00000001_0049

5,793

119,383

466,177

 Transaction cs00000001_0050

10,85

118,167

464,681

 Transaction cs00000001_0051

11,061

114,231

460,583

 Transaction cs00000001_0052

11,104

114,2

456,234

 Transaction cs00000001_0053

6,182

108,869

449,397

 Transaction cs00000001_0054

5,786

110,435

445,084

 Transaction cs00000001_0055

10,821

105,359

442,16

 Transaction cs00000001_0056

11,028

100,307

437,662

 Transaction cs00000001_0057

5,826

95,456

428,7

 Transaction cs00000001_0058

5,799

91,63

424,068

 Transaction cs00000001_0059

5,794

86,413

420,401

 Transaction cs00000001_0060

5,795

79,905

414,678

 Transaction cs00000001_0061

10,935

74,89

407,285

image-20240212-103612.png

 

DE_holdings T4(Max). The table below contains durations for Data-export for jobs with “Default holdings export profile” on 61 tenants with 1 set of data(all of the instances on each tenant). 

Tenant

Number of exported instances

Duration

Shift of the start time

 cs00000001_0001

66697

04:47:40.032

00:07:07.001

 cs00000001_0002

22477

01:46:16.222

00:00:00.895

 cs00000001_0003

136679

07:11:34.247

00:07:06.999

 cs00000001_0004

78347

05:21:32.462

00:06:56.961

 cs00000001_0005

110669

06:32:25.987

00:07:06.999

 cs00000001_0006

354865

09:08:03.315

00:07:14.627

 cs00000001_0007

281879

08:44:44.905

00:07:14.627

 cs00000001_0008

183455

07:56:22.925

00:07:07.001

 cs00000001_0009

113451

06:37:35.114

00:06:58.234

 cs00000001_0010

85930

05:41:41.91

00:07:06.989

 cs00000001_0011

96350

06:04:40.493

00:07:07.001

 cs00000001_0012

234350

08:25:25.455

00:07:14.626

 cs00000001_0013

20385

01:35:23.336

00:00:01.088

 cs00000001_0014

20971

01:47:21.388

00:01:56.992

 cs00000001_0015

32559

02:42:56.589

00:03:28.627

 cs00000001_0016

153429

07:30:21.621

00:07:06.999

 cs00000001_0017

17052

01:17:15.902

00:00:00.652

 cs00000001_0018

22781

01:56:54.12

00:02:09.495

 cs00000001_0019

5959

00:11:46.132

00:00:01.087

 cs00000001_0020

45940

03:37:46.61

00:05:30.563

 cs00000001_0021

90206

05:52:00.395

00:06:58.233

 cs00000001_0022

87358

05:45:21.752

00:07:07.001

 cs00000001_0023

92097

05:55:59.4

00:07:07.001

 cs00000001_0024

393084

09:14:09.688

00:07:14.627

 cs00000001_0025

85689

05:41:10.838

00:06:58.234

 cs00000001_0026

155147

07:32:07.59

00:07:07.002

 cs00000001_0027

49392

03:50:53.104

00:06:08.168

 cs00000001_0028

66640

04:47:37.357

00:06:58.234

 cs00000001_0029

7958

00:25:20.682

00:00:00.653

 cs00000001_0030

102042

06:16:01.035

00:06:58.234

 cs00000001_0031

76243

05:15:13.512

00:06:58.234

 cs00000001_0032

86817

05:43:58.799

00:07:07.001

 cs00000001_0033

47651

03:44:36.908

00:05:48.33

 cs00000001_0034

19994

01:32:52.325

00:00:00.737

 cs00000001_0035

136563

07:11:27.804

00:07:07.002

 cs00000001_0036

115912

06:41:36.881

00:07:07.001

 cs00000001_0037

25969

02:13:07.978

00:02:36.213

 cs00000001_0038

244420

08:30:13.075

00:07:14.627

 cs00000001_0039

130262

07:03:14.774

00:07:07.001

 cs00000001_0040

116735

06:42:50.786

00:07:06.988

 cs00000001_0041

61472

04:31:30.09

00:07:07.001

 cs00000001_0042

650197

09:32:34.768

00:07:14.627

 cs00000001_0043

830

00:00:50.612

00:00:00.814

 cs00000001_0044

71477

05:01:47.812

00:06:58.234

 cs00000001_0045

92823

05:57:44.596

00:06:54.272

 cs00000001_0046

126251

06:57:56.793

00:06:58.233

 cs00000001_0047

49518

03:51:26.841

00:06:08.004

 cs00000001_0048

53596

04:05:29.871

00:07:06.989

 cs00000001_0049

7458

00:26:40.751

00:00:47.596

 cs00000001_0050

208836

08:11:54.75

0:07:07

 cs00000001_0051

363363

09:10:02.246

0:07:07

 cs00000001_0052

148889

07:25:35.755

00:07:07.001

 cs00000001_0053

62321

04:34:11.182

0:07:07

 cs00000001_0054

17155

01:26:12.309

00:01:39.154

 cs00000001_0055

182363

07:55:36.678

0:07:07

 cs00000001_0056

167863

07:43:34.721

00:07:14.627

 cs00000001_0057

23743

02:01:53.176

00:02:20.403

 cs00000001_0058

124395

06:55:00.179

00:07:06.988

 cs00000001_0059

38685

03:08:57.995

00:04:22.604

 cs00000001_0060

38775

03:09:17.833

00:04:27.063

 cs00000001_0061

88457

05:47:58.582

00:07:07.002

DE_authority T5(500-1K-2k). The table below contains durations for Data-export for jobs with “Default authority export profile” on 61 tenants with 1 set of data(all of the instances on each tenant). 

Transaction name

DE 500, sec

DE 1K, sec

DE 2K, sec

DE_Exporting AuthorityTransaction cs00000001_0001

6796

7119

11516

DE_Exporting AuthorityTransaction cs00000001_0002

5962

5779

16226

DE_Exporting AuthorityTransaction cs00000001_0003

5836

6311

21968

DE_Exporting AuthorityTransaction cs00000001_0004

5865

5750

26586

DE_Exporting AuthorityTransaction cs00000001_0005

5886

5745

28384

DE_Exporting AuthorityTransaction cs00000001_0006

5877

5753

28288

DE_Exporting AuthorityTransaction cs00000001_0007

5884

5737

33628

DE_Exporting AuthorityTransaction cs00000001_0008

5868

5730

39163

DE_Exporting AuthorityTransaction cs00000001_0009

5902

5751

44187

DE_Exporting AuthorityTransaction cs00000001_0010

5956

5869

44396

DE_Exporting AuthorityTransaction cs00000001_0011

5893

5787

49254

DE_Exporting AuthorityTransaction cs00000001_0012

5902

5858

55799

DE_Exporting AuthorityTransaction cs00000001_0013

5881

5756

54919

DE_Exporting AuthorityTransaction cs00000001_0014

5891

5739

61341

DE_Exporting AuthorityTransaction cs00000001_0015

5866

5755

66577

DE_Exporting AuthorityTransaction cs00000001_0016

5902

5732

66923

DE_Exporting AuthorityTransaction cs00000001_0017

5863

5928

70759

DE_Exporting AuthorityTransaction cs00000001_0018

5854

6484

77038

DE_Exporting AuthorityTransaction cs00000001_0019

5876

6102

83432

DE_Exporting AuthorityTransaction cs00000001_0020

5868

6468

82352

DE_Exporting AuthorityTransaction cs00000001_0021

5879

6918

90676

DE_Exporting AuthorityTransaction cs00000001_0022

5857

6046

94664

DE_Exporting AuthorityTransaction cs00000001_0023

5943

6604

85713

DE_Exporting AuthorityTransaction cs00000001_0024

5860

6171

105028

DE_Exporting AuthorityTransaction cs00000001_0025

5899

6299

105846

DE_Exporting AuthorityTransaction cs00000001_0026

5868

6131

115376

DE_Exporting AuthorityTransaction cs00000001_0027

5874

5944

111442

DE_Exporting AuthorityTransaction cs00000001_0028

5879

6011

117511

DE_Exporting AuthorityTransaction cs00000001_0029

5878

5792

127511

DE_Exporting AuthorityTransaction cs00000001_0030

5863

5840

128740

DE_Exporting AuthorityTransaction cs00000001_0031

5879

5820

128969

DE_Exporting AuthorityTransaction cs00000001_0032

5866

6501

132437

DE_Exporting AuthorityTransaction cs00000001_0033

5867

11505

138441

DE_Exporting AuthorityTransaction cs00000001_0034

5859

11731

144630

DE_Exporting AuthorityTransaction cs00000001_0035

5877

7080

144332

DE_Exporting AuthorityTransaction cs00000001_0036

5849

10923

145234

DE_Exporting AuthorityTransaction cs00000001_0037

5897

6041

151330

DE_Exporting AuthorityTransaction cs00000001_0038

5894

6145

150469

DE_Exporting AuthorityTransaction cs00000001_0039

5877

5739

155768

DE_Exporting AuthorityTransaction cs00000001_0040

5904

5744

156220

DE_Exporting AuthorityTransaction cs00000001_0041

5874

6202

156766

DE_Exporting AuthorityTransaction cs00000001_0042

5879

5816

157841

DE_Exporting AuthorityTransaction cs00000001_0043

6608

5880

158721

DE_Exporting AuthorityTransaction cs00000001_0044

5866

5771

156396

DE_Exporting AuthorityTransaction cs00000001_0045

5892

5854

157477

DE_Exporting AuthorityTransaction cs00000001_0046

5876

5738

152934

DE_Exporting AuthorityTransaction cs00000001_0047

5902

5750

153392

DE_Exporting AuthorityTransaction cs00000001_0048

5838

5745

149484

DE_Exporting AuthorityTransaction cs00000001_0049

5872

5860

149659

DE_Exporting AuthorityTransaction cs00000001_0050

5852

5795

149111

DE_Exporting AuthorityTransaction cs00000001_0051

5866

6178

143901

DE_Exporting AuthorityTransaction cs00000001_0052

5916

5882

144713

DE_Exporting AuthorityTransaction cs00000001_0053

5858

5747

139844

DE_Exporting AuthorityTransaction cs00000001_0054

5840

6032

135910

DE_Exporting AuthorityTransaction cs00000001_0055

5917

5903

136991

DE_Exporting AuthorityTransaction cs00000001_0056

5893

6455

132152

DE_Exporting AuthorityTransaction cs00000001_0057

5843

5769

126592

DE_Exporting AuthorityTransaction cs00000001_0058

5864

5814

125191

DE_Exporting AuthorityTransaction cs00000001_0059

5860

6123

120351

DE_Exporting AuthorityTransaction cs00000001_0060

5840

5844

118520

DE_Exporting AuthorityTransaction cs00000001_0061

5840

5890

114587

 

Service CPU Utilization

DE_instances T1(500-1K-2k). Service CPU usage during the test was quite low, only the mod-data-export-b okapi-b mod-permissions-b services had a slight increase up to 13%.

2024-02-05 19:52 Local time Top 10 CPU-consuming services
mod-consortia-b 19.4813457932
mod-data-export-b 13.0495252091
mod-permissions-b 11.8486188099
mod-pubsub-b 11.3424816303
okapi-b 11.0208864888
mod-inventory-b 8.95271167462
mod-users-b 8.38095871043
mod-configuration-b 8.00652350057
mod-quick-marc-b 6.94299935374

 

DE_instances T2(Max).

DE_instances T2(MAX). Service CPU usage during the test was less than 15%, and one spike was on mod-consortia with CPU usage 1600%

DE_holdings T3(500-1K-2k).Service CPU usage during the test 500-1000-2000 was quite low, only the mod-data-export-b okapi-b mod-permissions-b services had a slight increase up to 16%.

DE_holdings T4(Max).

Service CPU usage during the test was less than 20%, and small spikes were on mod-data-export with CPU usage 35% at the beginning of the text.

DE_authority T5(500-1K-2k).

Service CPU usage during the test was stable and correlated with the number of exported records. Mod-consortia service increases CPU usage for a few seconds from 20 to 30%.

 


Memory Utilization

DE_instances T1(500-1K-2k). During testing, the memory usage does not increase

DE_instances T2(Max). During testing, the memory usage does not increase, only mod-data-export at the begging of the test change the memory usage from 55 to 85%.

DE_holdings T3(500-1K-2k). During testing, the memory usage does not increase

DE_holdings T4(Max). During testing, the memory usage(MU) does not increase. Only mod-inventory change MU from 20 to 27 and mod-data-export from 40 to 90%

DE_authority T5(500-1K-2k). During testing, the memory usage does not increase

 

DB CPU Utilization

DE_instances T1(500-1K-2k). Except for the database spikes that started at 18:15 and repeated every 30 minutes. CPU usage before tets was about 2.5%, during all Data Export of 500, 1000, and 2000 instances, CPU usage increased up to 4%;

DE_instances T2(Max). CPU usage was about 4%, during all Data Exports. Spike about 18% correlate with high CPU usage on mod-consortia

DE_holdings T3(500-1K-2k). CPU usage before tets was about 2.5%, during all Data Export of 500, 1000, and 2000 holdings, CPU usage increased up to 5%;

DE_holdings T4(Max). CPU usage before tets was about 2.5%, during all Data Export holdings, CPU usage increased up to 5.3%;

DE_authority T5(500-1K-2k). During 3 tests CPU varied within 4-5%.

 

DB Connections

DE_instances T1(500-1K-2k). Maximal number of DB connections was 1190 for 500 DE; 1270 for 1000DE and 1340 for 2000 DE.

DE_instances T2(Max). The number of DB connections at the beginning of the test was about 1200 and evenly decreased to 700 at the end of the test

DE_holdings T3(500-1K-2k). The maximal number of DB connections was 100 for 500 DE; 1220 for 1000DE and 1400 for 2000 DE holdings.

DE_holdings T4(Max). The number of DB connections at the beginning of the test was about 1500 and evenly decreased to 850 at the end of the test

DE_authority T5(500-1K-2k). During 3 tests NUmber of DB connections varied from 700 to 1100

 

DB Load

DE_instances T1(500-1K-2k).

DE_instances T2(Max).

DE_holdings T3(500-1K-2k).

DE_holdings T4(Max).

DE_authority T5(500-1K-2k).

 

SQL queries

DE_instances T1(500-1K-2k).

DE_instances T2(Max).

DE_holdings T3(500-1K-2k).

DE_holdings T4(Max).

DE_authority T5(500-1K-2k).

 

Errors / Additional information

Number of instances and holdings on each of the 62 tenant

Tenant

Instances

Holdings

 cs00000001_0001

65359

66697

 cs00000001_0002

22370

22477

 cs00000001_0003

136291

136679

 cs00000001_0004

77785

78347

 cs00000001_0005

110093

110669

 cs00000001_0006

293580

354865

 cs00000001_0007

279493

281879

 cs00000001_0008

160024

183455

 cs00000001_0009

110918

113451

 cs00000001_0010

83254

85930

 cs00000001_0011

94171

96350

 cs00000001_0012

227489

234350

 cs00000001_0013

19131

20385

 cs00000001_0014

20746

20971

 cs00000001_0015

26899

32559

 cs00000001_0016

153333

153429

 cs00000001_0017

16492

17052

 cs00000001_0018

22263

22781

 cs00000001_0019

5312

5959

 cs00000001_0020

44259

45940

 cs00000001_0021

83988

90206

 cs00000001_0022

86900

87358

 cs00000001_0023

86900

92097

 cs00000001_0024

385123

393084

 cs00000001_0025

84215

85689

 cs00000001_0026

153912

155147

 cs00000001_0027

48176

49392

 cs00000001_0028

64556

66640

 cs00000001_0029

5140

7958

 cs00000001_0030

97589

102042

 cs00000001_0031

71895

76243

 cs00000001_0032

80074

86817

 cs00000001_0033

45886

47651

 cs00000001_0034

18240

19994

 cs00000001_0035

135704

136563

 cs00000001_0036

114170

115912

 cs00000001_0037

24226

25969

 cs00000001_0038

225563

244420

 cs00000001_0039

128523

130262

 cs00000001_0040

111992

116735

 cs00000001_0041

61091

61472

 cs00000001_0042

634675

650197

 cs00000001_0043

2831

830

 cs00000001_0044

70871

71477

 cs00000001_0045

78320

92823

 cs00000001_0046

109677

126251

 cs00000001_0047

48531

49518

 cs00000001_0048

53346

53596

 cs00000001_0049

6952

7458

 cs00000001_0050

190736

208836

 cs00000001_0051

351325

363363

 cs00000001_0052

137940

148889

 cs00000001_0053

61834

62321

 cs00000001_0054

16297

17155

 cs00000001_0055

176009

182363

 cs00000001_0056

160976

167863

 cs00000001_0057

22596

23743

 cs00000001_0058

123819

124395

 cs00000001_0059

37715

38685

 cs00000001_0060

38395

38775

 cs00000001_0061

87117

88457

Methodology/Approach

All tests were run using the JMeter script. Data has been pre-generated for all tenants

Infrastructure

PTF -environment mcpt

  • 11 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1

  • 1 database instance, writer

    Name Memory GIBv CPUsmax_connections

    db.r6g.4xlarge 128 GiB; 16 vCPU

  • MSK tenant

    • 2 m5.2xlarge brokers in 1 zones

    • Apache Kafka version 2.8.0

    • EBS storage volume per broker 300 GiB

The table contains modules, memory, and CPU parameters

Module

Task Def. Revision

Module Version

Task Count

Mem Hard Limit

Mem Soft limit

CPU units

Xmx

MetaspaceSize

MaxMetaspaceSize

R/W split enabled

mcpt-pvt 

mod-consortia

11

mod-consortia:1.0.3

2

2048

1802

128

768

88

128

FALSE

mod-organizations

6

mod-organizations:1.8.0

2

1024

896

128

700

88

128

FALSE

mod-data-import

7

mod-data-import:3.0.7

1

2048

1844

256

1292

384

512

FALSE

mod-search

12

mod-search:3.0.5

2

2592

2480

2048

1440

512

1024

FALSE

mod-configuration

6

mod-configuration:5.9.2

2

1024

896

128

768

88

128

FALSE

mod-permissions

14

mod-permissions:6.4.0

2

1684

1544

512

1024

384

512

FALSE

mod-entities-links

10

mod-entities-links:2.0.4

2

2592

2480

400

1440

0

1024

FALSE

mod-inventory-storage

10

mod-inventory-storage:27.0.4

2

4096

3690

2048

3076

384

512

FALSE

mod-data-export-worker

9

mod-data-export-worker:3.1.2

2

3072

2800

1024

2048

384

512

FALSE

mod-source-record-storage

10

mod-source-record-storage:5.7.5

2

5600

5000

2048

3500

384

512

FALSE

mod-inventory

10

mod-inventory:20.1.6

2

2880

2592

1024

1814

384

512

FALSE

mod-di-converter-storage

9

mod-di-converter-storage:2.1.5

2

1024

896

128

768

88

128

FALSE

mod-users

11

mod-users:19.2.2

2

1024

896

128

768

88

128

FALSE

mod-source-record-manager

10

mod-source-record-manager:3.7.7

2

5600

5000

2048

3500

384

512

FALSE

mod-quick-marc

10

mod-quick-marc:5.0.1

1

2288

2176

128

1664

384

512

FALSE

nginx-okapi

2

nginx-okapi:2023.06.14

2

1024

896

512

0

0

0

FALSE

okapi-b

1

okapi:5.1.2

3

1684

1440

1024

922

384

512

FALSE

mod-data-export

10

mod-data-export:4.8.7

1

1024

896

1024

768

88

128

FALSE