...
The number of DB connections before the tests were about 750 during DI_T1(CT-2k_MT-SRI-50/50) maximal number was about 1750 and during DI_T2(CT-10k_MT-SRI-50/50) maximal number was about 2300.
...
DB Load
The graph on Database Load provides an illustration of the resource utilization database over a period of time when 2 tests were running. The key SQL queries that were sent are located in the right section of the figure
...
SQL queries
...
Methodology/Approach
All tests were run using the JMeter The SQL Queries section provides detailed information about the SQL queries executed on mcpt database. It includes metrics like the number of times each query was executed, the average time taken to execute each query, and the utilization of resources by each query.
...
Methodology/Approach
All tests were run using the JMeter script for single record import, large data import on the central tenant was started manually.
...
11 m6g.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 database instance, writer
Name Memory GIBv CPUsmax_connections
db.r6g.4xlarge 128 GiB; 16 vCPU
MSK tenant
...
2 m5.2xlarge brokers in 1 zones
...
Apache Kafka version 2.8.0
...
title | Number of instances and holdings on each of the tenant |
---|
|
Tenant | Number of instance records | Number of holdings records | cs00000001_0001 | 65359 | 66698 | cs00000001_0002 | 22370 | 22478 | cs00000001_0003 | 136291 | 136680 | cs00000001_0004 | 77785 | 78348 | cs00000001_0005 | 110093 | 110670 | cs00000001_0006 | 293580 | 354866 | cs00000001_0007 | 279493 | 281880 | cs00000001_0008 | 160024 | 183456 | cs00000001_0009 | 110918 | 113452 | cs00000001_0010 | 83254 | 85931 | cs00000001_0011 | 94171 | 96351 | cs00000001_0012 | 227489 | 234351 | cs00000001_0013 | 19131 | 20386 | cs00000001_0014 | 20746 | 20972 | cs00000001_0015 | 26899 | 32560 | cs00000001_0016 | 153333 | 153430 | cs00000001_0017 | 16492 | 17053 | cs00000001_0018 | 22263 | 22782 | cs00000001_0019 | 5312 | 5960 | cs00000001_0020 | 44259 | 45941 | cs00000001_0021 | 83988 | 90207 | cs00000001_0022 | 86900 | 87359 | cs00000001_0023 | 91517 | 92098 | cs00000001_0024 | 385123 | 393085 | cs00000001_0025 | 84215 | 85690 | cs00000001_0026 | 153912 | 155148 | cs00000001_0027 | 48176 | 49393 | cs00000001_0028 | 64556 | 66641 | cs00000001_0029 | 5140 | 7959 | cs00000001_0030 | 97589 | 102043 | cs00000001_0031 | 71895 | 76244 | cs00000001_0032 | 80074 | 86818 | cs00000001_0033 | 45886 | 47652 | cs00000001_0034 | 18240 | 19995 | cs00000001_0035 | 135704 | 136564 | cs00000001_0036 | 114170 | 115913 | cs00000001_0037 | 24226 | 25970 | cs00000001_0038 | 225563 | 244421 | cs00000001_0039 | 128523 | 130263 | cs00000001_0040 | 111992 | 116736 | cs00000001_0041 | 61091 | 61473 | cs00000001_0042 | 634675 | 650198 | cs00000001_0043 | 2831 | 831 | cs00000001_0044 | 70871 | 71478 | cs00000001_0045 | 78320 | 92824 | cs00000001_0046 | 109677 | 126252 | cs00000001_0047 | 48531 | 49519 | cs00000001_0048 | 53346 | 53597 | cs00000001_0049 | 6952 | 7459 | cs00000001_0050 | 190736 | 208837 | cs00000001_0051 | 351325 | 363364 | cs00000001_0052 | 137940 | 148890 | cs00000001_0053 | 61834 | 62324 | cs00000001_0054 | 16297 | 17156 | cs00000001_0055 | 176009 | 182364 | cs00000001_0056 | 160976 | 167864 | cs00000001_0057 | 22596 | 23744 | cs00000001_0058 | 123819 | 124396 | cs00000001_0059 | 37715 | 38686 | cs00000001_0060 | 38395 | 38776 | cs00000001_0061 | 87117 | 88458 | cs00000001_0062 | 1 | 1 |
|
MSK “ptf-mobius-testing2“
2 m5.2xlarge brokers in 1 zone
Apache Kafka version 2.8.0
EBS storage volume per broker 300 GiB
Task definitions of related modules were changed to use shared Kafka topics.
Expand |
---|
title | Additional kafka configs |
---|
|
Code Block |
---|
{ "name": "KAFKA_PRODUCER_TENANT_COLLECTION",
"value": "ALL" },
|
|
Kafka topics were created with the suffix “mcpt.Default.ALL.” and used 2 partitions for involved topics topics,
The table contains modules, memory, and CPU parameters
...