Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Ticket:

Jira Legacy
serverSystem Jira
serverId01505d01-b853-3c2e-90f1-ee9b165564fc
keyPERF-803

Summary

  • The tested Data-export jobs are quite light for the system and cause an increase in CPU on the services: mod-data-export, okapi and mod-inventory-storage up to 17%;

  • No memory leaks, memory consumption was stable during all of the tests;

  • Database CPU usage varied up to a maximum of 8%;

  • The number of failed DE jobs during concurrent testing was about 7% all with the same errors, but the duration of failed jobs was like the duration of completed, error messages are at the end of the report

  • The behavior of the export date was the same as in the first part of the report, with the latest processes starting with a delay. On the first tenants, where the file with instance ids was downloaded the data-export process is completed the fastest, but the data-export on the last tenants lasts the longest, as can be seen from the graphs below the tables

  • General metrics can be found in the tables below

Data-export duration statistics:

 

Data export

T1-DE_instances(500-1K-2k)(DEP)+DE_instancesCS42(MAX)(DEP).

T2-DE_instances(500-1K-2k)(CJP)+DE_instancesCS42(MAX)(DEP).

T3-DE_instances(500-1K-2k)(DEP)+DE_authorityCS00(MAX)(DEP)

500,

sec

1000 ,

sec

2000 ,

sec

500 ,

sec

1000 ,

sec

2000,

sec

500 ,

sec

1000 ,

sec

2000,

sec

Average duration

80

256

830

956

2110

4441

215

533

1281

Minimal duration

21

19

74

384

982

1863

45

14

12

Maximal duration

1028

360

987

1075

2257

4624

254

558

1374

75t percentile

77

339

968

1029

2223

4603

244

657

1362

90t percentile

108

356

982

1037

2241

4618

249

661

1368

CS42(MAX RECORDS)

1 hrs 56 min

1 hrs 49 min

2hrs 18 min

2hrs 10 min

2hrs 30 min

1 hrs 49 min

32 min 7 sec

44 min 3 sec

55 min 31 sec

...

  • T1-DE_instances(500-1K-2k)(DEP)+DE_instancesCS42(MAX)(DEP). This table contains durations for Data-export for jobs with “Default instances export profile” on 61 tenants with 3 sets of data(500 records; 1000 records; 2000 records) except tenant 42, on this tenant data-export run with the largest number of instances and “Default instances export profile”. Additional information about failed jobs is in the Additional informationInformation/Error section

Tenant

500

1000

2000

Status

Started Date

Compl Date

Duration

Status

Started Date

Compl Date

Duration

Status

Started Date

Compl Date

Duration

 cs00000001_0001

COMPLETED

08:41:18.306

08:41:42.679

00:00:24.373

COMPLETED

16:12:56.192

16:13:15.479

00:00:19.287

COMPLETED

20:43:32.753

20:44:47.318

00:01:14.565

 cs00000001_0002

COMPLETED

08:41:25.000

08:41:47.885

00:00:22.885

COMPLETED

16:13:01.591

16:13:34.742

00:00:33.151

COMPLETED

20:43:37.932

20:45:58.223

00:02:20.291

 cs00000001_0003

COMPLETED

08:41:31.646

08:41:53.671

00:00:22.025

COMPLETED

16:13:09.258

16:13:52.747

00:00:43.489

COMPLETED

20:43:46.351

20:47:26.980

00:03:40.629

 cs00000001_0004

COMPLETED

08:41:36.937

08:41:58.192

00:00:21.255

COMPLETED

16:13:17.224

16:14:11.263

00:00:54.039

COMPLETED

20:43:56.513

20:49:11.379

00:05:14.866

 cs00000001_0005

COMPLETED

08:41:42.698

08:42:03.951

00:00:21.253

COMPLETED

16:13:24.351

16:14:36.431

00:01:12.08

COMPLETED

20:44:03.713

20:50:33.894

00:06:30.181

 cs00000001_0006

COMPLETED

08:41:47.885

08:42:08.914

00:00:21.029

COMPLETED

16:13:30.177

16:14:50.495

00:01:20.318

COMPLETED

20:44:12.660

20:51:55.779

00:07:43.119

 cs00000001_0007

FAIL

08:41:53.167

08:42:15.317

00:00:22.15

COMPLETED

16:13:38.634

16:15:12.011

00:01:33.377

COMPLETED

20:44:21.387

20:53:27.125

00:09:05.738

 cs00000001_0008

COMPLETED

08:41:59.692

08:42:25.276

00:00:25.584

COMPLETED

16:13:43.573

16:15:26.623

00:01:43.05

COMPLETED

20:44:29.600

20:54:27.147

00:09:57.547

 cs00000001_0009

COMPLETED

08:42:04.965

08:42:33.644

00:00:28.679

COMPLETED

16:13:52.774

16:15:50.168

00:01:57.394

COMPLETED

20:44:37.979

20:55:25.725

00:10:47.746

 cs00000001_0010

COMPLETED

08:42:10.940

08:42:42.604

00:00:31.664

COMPLETED

16:13:59.297

16:16:09.067

00:02:09.77

COMPLETED

20:44:46.845

20:56:21.134

00:11:34.289

 cs00000001_0011

FAIL

08:42:17.625

08:42:50.114

00:00:32.489

COMPLETED

16:14:05.996

16:16:27.609

00:02:21.613

COMPLETED

20:44:54.729

20:57:13.442

00:12:18.713

 cs00000001_0012

COMPLETED

08:42:25.296

08:43:00.791

00:00:35.495

COMPLETED

16:14:13.919

16:16:50.901

00:02:36.982

COMPLETED

20:45:00.316

20:57:40.427

00:12:40.111

 cs00000001_0013

COMPLETED

08:42:30.529

08:43:09.030

00:00:38.501

COMPLETED

16:14:19.843

16:17:03.193

00:02:43.35

COMPLETED

20:45:09.757

20:58:33.223

00:13:23.466

 cs00000001_0014

COMPLETED

08:42:36.508

08:43:19.801

00:00:43.293

COMPLETED

16:14:26.105

16:17:15.922

00:02:49.817

COMPLETED

20:45:16.057

20:58:58.640

00:13:42.583

 cs00000001_0015

FAIL

08:42:43.408

08:43:29.083

00:00:45.675

COMPLETED

16:14:35.856

16:17:41.369

00:03:05.513

COMPLETED

20:45:23.453

20:59:23.966

00:14:00.513

 cs00000001_0016

COMPLETED

08:42:50.139

08:43:35.961

00:00:45.822

COMPLETED

16:14:41.975

16:17:57.570

00:03:15.595

COMPLETED

20:45:34.973

20:59:48.715

00:14:13.742

 cs00000001_0017

COMPLETED

08:42:56.821

08:43:44.103

00:00:47.282

COMPLETED

16:14:50.522

16:18:22.953

00:03:32.431

COMPLETED

20:45:42.889

21:00:13.600

00:14:30.711

 cs00000001_0018

COMPLETED

08:43:01.562

08:43:55.090

00:00:53.528

COMPLETED

16:14:57.741

16:18:43.230

00:03:45.489

COMPLETED

20:45:50.660

21:00:37.526

00:14:46.866

 cs00000001_0019

FAIL

08:43:09.901

08:44:00.858

00:00:50.957

FAIL

16:15:03.898

16:18:54.326

00:03:50.428

COMPLETED

20:45:58.742

21:01:00.588

00:15:01.846

 cs00000001_0020

COMPLETED

08:43:15.211

08:44:12.492

00:00:57.281

COMPLETED

16:15:11.436

16:19:20.244

00:04:08.808

COMPLETED

20:46:07.696

21:01:24.518

00:15:16.822

 cs00000001_0021

COMPLETED

08:43:24.138

08:44:18.231

00:00:54.093

FAIL

16:15:18.252

16:19:36.126

00:04:17.874

COMPLETED

20:46:17.326

21:01:47.076

00:15:29.75

 cs00000001_0022

COMPLETED

08:43:29.110

08:44:24.802

00:00:55.692

COMPLETED

16:15:25.017

16:19:44.324

00:04:19.307

COMPLETED

20:46:26.716

21:02:09.121

00:15:42.405

 cs00000001_0023

COMPLETED

08:43:34.515

08:44:37.741

00:01:03.226

COMPLETED

16:15:33.244

16:20:21.071

00:04:47.827

COMPLETED

20:46:37.567

21:02:30.237

00:15:52.67

 cs00000001_0024

FAIL

08:43:44.103

08:44:44.705

00:01:00.602

COMPLETED

16:15:41.477

16:20:41.820

00:05:00.343

COMPLETED

20:46:41.029

21:02:51.477

00:16:10.448

 cs00000001_0025

COMPLETED

08:43:49.254

08:44:52.111

00:01:02.857

FAIL

16:15:48.498

16:20:56.085

00:05:07.587

COMPLETED

20:46:48.851

21:02:52.107

00:16:03.256

 cs00000001_0026

FAIL

08:43:55.090

08:44:58.450

00:01:03.36

COMPLETED

16:15:50.199

16:21:02.441

00:05:12.242

COMPLETED

20:47:00.344

21:03:11.997

00:16:11.653

 cs00000001_0027

COMPLETED

08:44:00.862

08:45:05.258

00:01:04.396

COMPLETED

16:15:59.021

16:21:21.831

00:05:22.81

COMPLETED

20:47:13.135

21:03:30.979

00:16:17.844

 cs00000001_0028

COMPLETED

08:44:06.633

08:45:18.533

00:01:11.9

FAIL

16:16:08.034

16:21:28.734

00:05:20.7

COMPLETED

20:47:13.641

21:03:31.564

00:16:17.923

 cs00000001_0029

COMPLETED

08:44:13.255

08:45:25.471

00:01:12.216

COMPLETED

16:16:17.182

16:21:45.894

00:05:28.712

COMPLETED

20:47:26.502

21:03:48.240

00:16:21.738

 cs00000001_0030

COMPLETED

08:44:19.680

08:45:32.942

00:01:13.262

COMPLETED

16:16:27.637

16:21:58.230

00:05:30.593

COMPLETED

20:47:39.164

21:04:04.837

00:16:25.673

 cs00000001_0031

COMPLETED

08:44:26.226

08:45:40.800

00:01:14.574

COMPLETED

16:16:28.185

16:22:14.855

00:05:46.67

COMPLETED

20:47:40.264

21:04:05.925

00:16:25.661

 cs00000001_0032

COMPLETED

08:44:31.947

08:45:47.403

00:01:15.456

COMPLETED

16:16:38.980

16:22:22.245

00:05:43.265

COMPLETED

20:47:54.143

21:04:21.329

00:16:27.186

 cs00000001_0033

COMPLETED

08:44:37.766

08:45:54.482

00:01:16.716

COMPLETED

16:16:49.355

16:22:31.415

00:05:42.06

COMPLETED

20:47:54.165

21:04:21.329

00:16:27.164

 cs00000001_0034

FAIL

08:44:44.734

08:46:02.199

00:01:17.465

COMPLETED

16:16:50.900

16:22:47.503

00:05:56.603

COMPLETED

20:48:11.145

21:04:37.074

00:16:25.929

 cs00000001_0035

COMPLETED

08:44:51.413

08:46:10.557

00:01:19.144

COMPLETED

16:17:02.150

16:22:48.836

00:05:46.686

COMPLETED

20:48:10.524

21:04:35.934

00:16:25.41

 cs00000001_0036

FAIL

08:44:58.453

08:46:18.757

00:01:20.304

COMPLETED

16:17:03.192

16:23:02.021

00:05:58.829

COMPLETED

20:48:27.791

21:04:49.677

00:16:21.886

 cs00000001_0037

COMPLETED

08:45:04.009

08:46:18.767

00:01:14.758

FAIL

16:17:14.904

16:23:15.294

00:06:00.39

COMPLETED

20:48:28.325

21:04:50.943

00:16:22.618

 cs00000001_0038

COMPLETED

08:45:10.759

08:46:26.979

00:01:16.22

COMPLETED

16:17:15.921

16:23:15.297

00:05:59.376

COMPLETED

20:48:47.245

21:05:02.441

00:16:15.196

 cs00000001_0039

COMPLETED

08:45:17.825

08:46:34.947

00:01:17.122

COMPLETED

16:17:27.367

16:23:27.219

00:05:59.852

COMPLETED

20:48:47.272

21:05:03.655

00:16:16.383

 cs00000001_0040

COMPLETED

08:45:24.020

08:46:43.387

00:01:19.367

COMPLETED

16:17:37.584

16:23:27.815

00:05:50.231

COMPLETED

20:49:07.141

21:05:16.105

00:16:08.964

 cs00000001_0041

COMPLETED

08:45:25.495

08:46:51.713

00:01:26.218

COMPLETED

16:17:40.856

16:23:38.234

00:05:57.378

COMPLETED

20:49:07.932

21:05:16.106

00:16:08.174

 cs00000001_0042

COMPLETED

08:47:41.141

10:44:05.834

01:56:24.693

COMPLETED

16:24:30.590

18:13:37.660

01:49:07.07

COMPLETED

21:06:03.875

00:24:43.478

02:18:39.603

 cs00000001_0043

COMPLETED

08:45:39.452

08:46:59.947

00:01:20.495

COMPLETED

16:17:41.400

16:23:02.020

00:05:20.62

COMPLETED

20:48:29.519

20:56:20.036

00:07:50.517

 cs00000001_0044

COMPLETED

08:45:46.640

08:47:06.799

00:01:20.159

COMPLETED

16:18:06.311

16:23:49.211

00:05:42.9

COMPLETED

20:49:28.535

21:05:26.314

00:15:57.779

 cs00000001_0045

FAIL

08:45:54.498

08:47:12.755

00:01:18.257

COMPLETED

16:18:09.871

16:23:58.163

00:05:48.292

COMPLETED

20:49:48.172

21:05:34.512

00:15:46.34

 cs00000001_0046

COMPLETED

08:46:02.202

08:47:18.442

00:01:16.24

COMPLETED

16:18:10.926

16:23:58.164

00:05:47.238

COMPLETED

20:49:48.196

21:05:36.270

00:15:48.074

 cs00000001_0047

COMPLETED

08:46:02.225

08:47:18.442

00:01:16.217

FAIL

16:18:24.123

16:24:01.782

00:05:37.659

FAIL

20:50:09.653

21:05:38.160

00:15:28.507

 cs00000001_0048

COMPLETED

08:46:10.574

08:47:22.681

00:01:12.107

COMPLETED

16:18:26.401

16:24:06.366

00:05:39.965

COMPLETED

20:50:09.701

21:05:43.870

00:15:34.169

 cs00000001_0049

COMPLETED

08:46:18.761

08:47:29.539

00:01:10.778

COMPLETED

16:18:40.848

16:24:13.867

00:05:33.019

COMPLETED

20:50:09.679

21:05:42.628

00:15:32.949

 cs00000001_0050

COMPLETED

08:46:26.232

08:47:32.182

00:01:05.95

COMPLETED

16:18:42.610

16:24:13.868

00:05:31.258

FAIL

20:50:33.358

21:05:49.392

00:15:16.034

 cs00000001_0051

COMPLETED

08:46:26.260

08:47:34.374

00:01:08.114

COMPLETED

16:18:58.924

16:24:19.617

00:05:20.693

COMPLETED

20:50:33.400

21:05:50.748

00:15:17.348

 cs00000001_0052

COMPLETED

08:46:34.943

08:47:34.375

00:00:59.432

COMPLETED

16:18:58.900

16:24:13.870

00:05:14.97

COMPLETED

20:50:33.380

21:05:50.748

00:15:17.368

 cs00000001_0053

COMPLETED

08:46:43.383

08:47:36.503

00:00:53.12

COMPLETED

16:19:00.681

16:24:19.617

00:05:18.936

COMPLETED

20:50:58.398

21:05:56.115

00:14:57.717

 cs00000001_0054

COMPLETED

08:46:51.739

08:47:37.351

00:00:45.612

COMPLETED

16:19:17.924

16:24:19.618

00:05:01.694

COMPLETED

20:50:58.420

21:05:56.115

00:14:57.695

 cs00000001_0055

COMPLETED

08:46:02.225

08:47:18.442

00:02:11.391

COMPLETED

16:19:17.967

16:24:19.621

00:05:01.654

COMPLETED

20:50:57.826

21:05:51.800

00:14:53.974

 cs00000001_0056

COMPLETED

08:46:10.574

08:47:22.681

00:01:57.137

COMPLETED

16:19:36.191

16:24:22.672

00:04:46.481

COMPLETED

20:51:25.458

21:05:58.811

00:14:33.353

 cs00000001_0057

COMPLETED

08:46:18.761

08:47:29.539

00:01:57.114

COMPLETED

16:19:37.364

16:24:25.511

00:04:48.147

COMPLETED

20:51:24.836

21:05:56.115

00:14:31.279

 cs00000001_0058

COMPLETED

08:46:26.232

08:47:32.182

00:01:59.658

COMPLETED

16:19:38.715

16:24:25.510

00:04:46.795

COMPLETED

20:51:25.482

21:05:59.833

00:14:34.351

 cs00000001_0059

COMPLETED

08:46:26.260

08:47:34.374

00:01:59.169

COMPLETED

16:19:57.118

16:24:27.002

00:04:29.884

COMPLETED

20:51:26.048

21:05:59.833

00:14:33.785

 cs00000001_0060

COMPLETED

08:46:34.943

08:47:34.375

00:01:48.399

COMPLETED

16:19:57.176

16:24:27.003

00:04:29.827

COMPLETED

20:51:54.664

21:05:59.837

00:14:05.173

 cs00000001_0061

COMPLETED

08:46:43.383

08:47:36.503

00:01:44.223

COMPLETED

16:19:58.846

16:24:27.006

00:04:28.16

COMPLETED

20:51:54.644

21:05:59.833

00:14:05.189

...

Data-exports jobs failed with the same errors.

...

Expand
titleData export failed

This XML file does not appear to have any style information associated with it. The document tree is shown below.

<Error>

<Code>NoSuchKey</Code>

<Message>The specified key does not exist.</Message>

<Key>cs00000001_0010/3fa36a65-40fa-49d9-b028-62485ed48c1a/cs00000001_0010_1k_mrc_bib-368.mrc</Key>

<RequestId>44DP9SJ9FK9RJ4GP</RequestId>

<HostId>tzFaRcMEHCtq7ZuHDxueqpq2uE+w6W7S2jGSoRSRNskejfvcI4T3azSiy786C26Z/Io/oOjSgzA=</HostId>

</Error>

...