...
This document contains the results of the testing Data Import (batch imports) on 62 tenants with the following scenarios onthe MCPT cluster
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
DI_T1(CT-2k_MT-SRI-50/50). Central tenant(CT) performs a large update batch import with 2K MARC BIB records; 30% member Member tenants(MT) does single record imports(SRI) where 50% of them doing Create and 50% doing Update of single records.
DI_T2(CT-10k_MT-SRI-50/50). Central tenant(CT) performs a large update batch import with 10K MARC BIB records; 100% Member tenants(MT) does single record imports(SRI) where 50% ofthem of them doing Create and 50% doing Update of single records.
...
All Data-import finished with the status “Completed“
Most CPU consuming services were mod-consortia-b , mod-quick-marc-b, mod-inventory-b, mod-di-converter-storage-b, mod-source-record-storage-b, mod-inventory-storage-b, okapi-b, mod-source-record-manager-b it`s their values are in Service CPU Utilization section
During 2 tests few services showed changes in memory utilization: mod-data-import-b(36%-50%), mod-search-b(24%-31%), mod-inventory-b(15%-28%), mod-source-record-manager-b(14%-22%), mod-inventory-storage-b(13%-23%),mod-source-record-storage-bits values are in Service Memory Utilization section(12%-16%). No memory leaks.
DB CPU usage during DI_T1(CT-2k_MT-SRI-50/50) has increased up to 80% and during DI_T2(CT-10k_MT-SRI-50/50) increased up to 95%.
...
Tenant | Duration |
DI_Importing MARC 2K records | 1 minute |
SDIU_(Update) cs00000001_0022 | 12275.012 sec |
SDIU_(Update) cs00000001_0016 | 13087.013 sec |
SDIU_(Update) cs00000001_0013 | 13900.013,9 sec |
SDIU_(Update) cs00000001_0010 | 13340.013,3 sec |
SDIU_(Update) cs00000001_0008 | 10973.011 sec |
SDIU_(Update) cs00000001_0006 | 11200.011 sec |
SDIU_(Update) cs00000001_0005 | 10832.011 sec |
SDIU_(Update) cs00000001_0002 | 11448.011,5 sec |
SDIC_(Create) cs00000001_0021 | 12036.012 sec |
SDIC_(Create) cs00000001_0020 | 11906.012 sec |
SDIC_(Create) cs00000001_0019 | 11090.011 sec |
SDIC_(Create) cs00000001_0018 | 12009.012 sec |
SDIC_(Create) cs00000001_0017 | 12395.012 sec |
SDIC_(Create) cs00000001_0015 | 12139.012 sec |
SDIC_(Create) cs00000001_0014 | 12710.012,7 sec |
SDIC_(Create) cs00000001_0012 | 12025.012 sec |
SDIC_(Create) cs00000001_0011 | 12063.012 sec |
SDIC_(Create) cs00000001_0009 | 10323.010 sec |
SDIC_(Create) cs00000001_0007 | 5057.05 sec |
SDIC_(Create) cs00000001_0004 | 5398.05,3 sec |
SDIC_(Create) cs00000001_0003 | 5854.05,8 sec |
The table below contains metrics for single record Data-import with “Inventory Single Record - Default Update Instance” and ”Inventory Single Record - Default Create Instance” profiles.
...
Tenant | Duration |
DI_Importing MARC records workflow Transaction | 5 minutes |
SDIC_Single Record Import (Create) cs00000001_0002 | 5163.05 sec |
SDIC_Single Record Import (Create) cs00000001_0003 | 5156.05 sec |
SDIC_Single Record Import (Create) cs00000001_0006 | 5672.05,6 sec |
SDIC_Single Record Import (Create) cs00000001_0007 | 4240.04,2 sec |
SDIC_Single Record Import (Create) cs00000001_0008 | 4108.04,1 sec |
SDIC_Single Record Import (Create) cs00000001_0010 | 9930.010 sec |
SDIC_Single Record Import (Create) cs00000001_0012 | 6010.06 sec |
SDIC_Single Record Import (Create) cs00000001_0015 | 10533.010 sec |
SDIC_Single Record Import (Create) cs00000001_0017 | 11315.011,3 sec |
SDIC_Single Record Import (Create) cs00000001_0018 | 11665.011,6 sec |
SDIC_Single Record Import (Create) cs00000001_0021 | 12022.012 sec |
SDIC_Single Record Import (Create) cs00000001_0022 | 10825.011 sec |
SDIC_Single Record Import (Create) cs00000001_0023 | 16624.016 sec |
SDIC_Single Record Import (Create) cs00000001_0024 | 16185.016 sec |
SDIC_Single Record Import (Create) cs00000001_0025 | 16557.016,5 sec |
SDIC_Single Record Import (Create) cs00000001_0026 | 16172.016,1 sec |
SDIC_Single Record Import (Create) cs00000001_0030 | 15672.015,6 sec |
SDIC_Single Record Import (Create) cs00000001_0031 | 15733.015,7 sec |
SDIC_Single Record Import (Create) cs00000001_0032 | 15748.015,7 sec |
SDIC_Single Record Import (Create) cs00000001_0033 | 15163.015,1 sec |
SDIC_Single Record Import (Create) cs00000001_0034 | 15585.015,5 sec |
SDIC_Single Record Import (Create) cs00000001_0036 | 14865.014,8 sec |
SDIC_Single Record Import (Create) cs00000001_0039 | 15693.015,6 sec |
SDIC_Single Record Import (Create) cs00000001_0041 | 15893.015,8 sec |
SDIC_Single Record Import (Create) cs00000001_0047 | 15149.015,1 sec |
SDIC_Single Record Import (Create) cs00000001_0048 | 14920.014,9 sec |
SDIC_Single Record Import (Create) cs00000001_0049 | 15412.015,4 sec |
SDIC_Single Record Import (Create) cs00000001_0052 | 15820.015,8 sec |
SDIC_Single Record Import (Create) cs00000001_0055 | 15334.015,3 sec |
SDIC_Single Record Import (Create) cs00000001_0061 | 15792.015,7 sec |
SDIC_Single Record Import (Create) cs00000001_0062 | 15885.015,8 sec |
SDIU_Single Record Import (Update) cs00000001_0004 | 11596.011,6 sec |
SDIU_Single Record Import (Update) cs00000001_0005 | 10354.010,3 sec |
SDIU_Single Record Import (Update) cs00000001_0009 | 11572.011,7 sec |
SDIU_Single Record Import (Update) cs00000001_0011 | 11884.011,8 sec |
SDIU_Single Record Import (Update) cs00000001_0013 | 11458.011,4 sec |
SDIU_Single Record Import (Update) cs00000001_0014 | 11672.011,6 sec |
SDIU_Single Record Import (Update) cs00000001_0016 | 12129.012,1 sec |
SDIU_Single Record Import (Update) cs00000001_0019 | 11302.011,3 sec |
SDIU_Single Record Import (Update) cs00000001_0020 | 12091.012,1 sec |
SDIU_Single Record Import (Update) cs00000001_0027 | 16105.016,1 sec |
SDIU_Single Record Import (Update) cs00000001_0028 | 16928.016,9 sec |
SDIU_Single Record Import (Update) cs00000001_0029 | 17151.017,1 sec |
SDIU_Single Record Import (Update) cs00000001_0035 | 16954.016,9 sec |
SDIU_Single Record Import (Update) cs00000001_0037 | 16585.016,5 sec |
SDIU_Single Record Import (Update) cs00000001_0038 | 16069.016 sec |
SDIU_Single Record Import (Update) cs00000001_0040 | 17904.018 sec |
SDIU_Single Record Import (Update) cs00000001_0042 | 16827.016,8 sec |
SDIU_Single Record Import (Update) cs00000001_0043 | 17005.017 sec |
SDIU_Single Record Import (Update) cs00000001_0044 | 17192.017,1 sec |
SDIU_Single Record Import (Update) cs00000001_0045 | 16593.016,5 sec |
SDIU_Single Record Import (Update) cs00000001_0046 | 17086.017,1 sec |
SDIU_Single Record Import (Update) cs00000001_0050 | 16416.016,5 sec |
SDIU_Single Record Import (Update) cs00000001_0051 | 16409.016,5 sec |
SDIU_Single Record Import (Update) cs00000001_0053 | 15979.016 sec |
SDIU_Single Record Import (Update) cs00000001_0054 | 16308.016,3 sec |
SDIU_Single Record Import (Update) cs00000001_0056 | 15553.015,5 sec |
SDIU_Single Record Import (Update) cs00000001_0057 | 16380.016,3 sec |
SDIU_Single Record Import (Update) cs00000001_0058 | 16634.016,6 sec |
SDIU_Single Record Import (Update) cs00000001_0059 | 16209.016,2 sec |
SDIU_Single Record Import (Update) cs00000001_0060 | 15943.015,9 sec |
The table below contains metrics for single record Data-import with “Inventory Single Record - Default Update Instance” and ”Inventory Single Record - Default Create Instance” profiles.
...