...
DE_instances T1(500-1K-2k). (MARC BIB) on Mobius environment with Data Export tests for 500, 1k, 2k. Three CSV files were prepared to run Data Export with Default instances export profile.
DE_instances T2(Max). (MARC BIB) on Mobius environment with Data Export tests for maximal number of instances on each member tenant(The exact number of instances is in the section “Errors / Additional information”). Three CSV files were prepared to run Data Export with Default instances export profile.
DE_holdings T3(500-1K-2k).Holdings on Mobius environment with Data Export tests for 500, 1k, 2k. Three CSV files were prepared to run Data Export with Default holdings export profile.
Ticket:
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
...
Tenant | Number of exported instances | Duration | Shift of the start time |
cs00000001_0001 | 65359 | 08:34:11.924 | 0:00:00 |
cs00000001_0002 | 22370 | 02:01:17.113 | 00:00:04.576 |
cs00000001_0003 | 136291 | 15:38:26.969 | 00:20:55.783 |
cs00000001_0004 | 77785 | 10:42:11.942 | 00:02:52.106 |
cs00000001_0005 | 110093 | 13:57:20.399 | 00:12:33.693 |
cs00000001_0006 | 293580 | 17:24:21.58 | 02:58:03.642 |
cs00000001_0007 | 279493 | 17:15:17.802 | 02:55:41.421 |
cs00000001_0008 | 160024 | 16:21:18.866 | 00:56:26.929 |
cs00000001_0009 | 110918 | 14:01:42.358 | 00:25:51.269 |
cs00000001_0010 | 83254 | 11:36:56.235 | 00:14:09.228 |
cs00000001_0011 | 94171 | 12:43:36.487 | 00:20:24.292 |
cs00000001_0012 | 227489 | 16:52:02.623 | 02:24:44.754 |
cs00000001_0013 | 19131 | 01:58:23.547 | 00:01:37.648 |
cs00000001_0014 | 20746 | 02:16:27.599 | 00:01:52.916 |
cs00000001_0015 | 26899 | 03:24:08.545 | 00:03:01.837 |
cs00000001_0016 | 153333 | 15:46:35.492 | 01:22:21.469 |
cs00000001_0017 | 16492 | 01:41:43.743 | 00:02:40.122 |
cs00000001_0018 | 22263 | 02:43:54.315 | 00:04:28.863 |
cs00000001_0019 | 5312 | 00:14:46.338 | 00:02:05.943 |
cs00000001_0020 | 44259 | 06:30:26.536 | 00:12:04.781 |
cs00000001_0021 | 83988 | 11:46:23.477 | 00:33:39.156 |
cs00000001_0022 | 86900 | 12:03:06.865 | 00:36:22.655 |
cs00000001_0023 | 91517 | 12:27:03.606 | 00:40:56.469 |
cs00000001_0024 | 385123 | 15:35:51.105 | 05:43:10.805 |
cs00000001_0025 | 84215 | 11:47:31.81 | 00:36:33.173 |
cs00000001_0026 | 153912 | 15:32:54.171 | 01:42:36.675 |
cs00000001_0027 | 48176 | 07:11:08.729 | 00:16:44.682 |
cs00000001_0028 | 64556 | 09:30:37.567 | 00:25:12.347 |
cs00000001_0029 | 5140 | 00:16:41.394 | 00:03:41.85 |
cs00000001_0030 | 97589 | 12:52:29.07 | 00:50:52.289 |
cs00000001_0031 | 71895 | 10:26:16.656 | 00:31:10.105 |
cs00000001_0032 | 80074 | 11:22:00.789 | 00:37:31.626 |
cs00000001_0033 | 45886 | 06:52:06.447 | 00:17:36.951 |
cs00000001_0034 | 18240 | 02:14:18.252 | 00:07:47.49 |
cs00000001_0035 | 135704 | 14:55:28.661 | 01:29:32.543 |
cs00000001_0036 | 114170 | 13:56:14.427 | 01:08:43.67 |
cs00000001_0037 | 24226 | 03:18:25.02 | 00:09:57.63 |
cs00000001_0038 | 225563 | 16:13:32.965 | 03:06:16.602 |
cs00000001_0039 | 128523 | 14:37:45.055 | 01:24:25.093 |
cs00000001_0040 | 111992 | 13:47:45.898 | 01:08:36.465 |
cs00000001_0041 | 61091 | 09:03:29.08 | 00:27:37.435 |
cs00000001_0042 | 634675 | 12:24:24.995 | 09:48:38.838 |
cs00000001_0043 | 2831 | 00:02:12.583 | 00:04:22.427 |
cs00000001_0044 | 70871 | 10:19:26.438 | 00:35:14.19 |
cs00000001_0045 | 78320 | 11:10:12.277 | 00:41:17.857 |
cs00000001_0046 | 109677 | 13:38:14.993 | 01:08:58.069 |
cs00000001_0047 | 48531 | 07:19:11.872 | 00:22:04.318 |
cs00000001_0048 | 53346 | 08:01:00.977 | 00:24:42.919 |
cs00000001_0049 | 6952 | 00:31:27.638 | 00:06:36.51 |
cs00000001_0050 | 190736 | 15:54:19.153 | 02:34:40.768 |
cs00000001_0051 | 351325 | 15:41:17.61 | 05:23:26.089 |
cs00000001_0052 | 137940 | 14:54:13.405 | 01:39:56.924 |
cs00000001_0053 | 61834 | 09:11:33.182 | 00:31:14.104 |
cs00000001_0054 | 16297 | 02:00:46.997 | 00:09:40.899 |
cs00000001_0055 | 176009 | 15:42:52.69 | 02:21:13.276 |
cs00000001_0056 | 160976 | 15:28:32.362 | 02:06:05.583 |
cs00000001_0057 | 22596 | 03:06:34.087 | 00:12:13.641 |
cs00000001_0058 | 123819 | 14:19:45.503 | 01:27:29.477 |
cs00000001_0059 | 37715 | 05:38:43.984 | 00:18:51.151 |
cs00000001_0060 | 38395 | 05:45:32.811 | 00:19:17.503 |
cs00000001_0061 | 87117 | 12:00:00.92 | 00:53:34.119 |
cs00000001_0062 | 1 |
...
DE_instances T1holdings T3(500-1K-2k). Service CPU usage during the test was quite low, only the mod-data-export-b okapi-b mod-permissions-b services had a slight increase up to 13%.
...
2024-02-05 19:52 Local time Top 10 CPU-consuming services
mod-consortia-b 19.4813457932
mod-data-export-b 13.0495252091
mod-permissions-b 11.8486188099
mod-pubsub-b 11.3424816303
okapi-b 11.0208864888
mod-inventory-b 8.95271167462
mod-users-b 8.38095871043
mod-configuration-b 8.00652350057
mod-quick-marc-b 6.94299935374
DE_instances T2(Max).
...
DE_instances T1(500-1K-2k). During testing, the memory usage does not increase
...
The table below contains durations for Data-export for jobs with “Default holdings export profile” on 61 tenants with 1 set of data(all of the instances on each tenant).
Transaction | DE 500 | DE 1K | DE 2K |
Transaction cs00000001_0001 | 12,03 | 17,061 | 32,266 |
Transaction cs00000001_0002 | 5,971 | 16,078 | 41,161 |
Transaction cs00000001_0003 | 5,802 | 16,698 | 71,987 |
Transaction cs00000001_0004 | 5,783 | 16,35 | 93,43 |
Transaction cs00000001_0005 | 5,794 | 16,898 | 140,136 |
Transaction cs00000001_0006 | 15,828 | 41,487 | 170,289 |
Transaction cs00000001_0007 | 16,312 | 52,774 | 213,028 |
Transaction cs00000001_0008 | 27,108 | 62,747 | 238,285 |
Transaction cs00000001_0009 | 28,276 | 70,228 | 276,41 |
Transaction cs00000001_0010 | 25,084 | 68,12 | 296,711 |
Transaction cs00000001_0011 | 19,922 | 66,926 | 312,214 |
Transaction cs00000001_0012 | 16,599 | 69,383 | 335,515 |
Transaction cs00000001_0013 | 12,316 | 71,261 | 356,475 |
Transaction cs00000001_0014 | 12,311 | 70,142 | 378,825 |
Transaction cs00000001_0015 | 6,092 | 68,883 | 388,384 |
Transaction cs00000001_0016 | 5,824 | 73,112 | 394,735 |
Transaction cs00000001_0017 | 5,797 | 69,045 | 407,792 |
Transaction cs00000001_0018 | 5,804 | 67,941 | 431,42 |
Transaction cs00000001_0019 | 5,817 | 69,48 | 438,995 |
Transaction cs00000001_0020 | 5,831 | 73,761 | 449,61 |
Transaction cs00000001_0021 | 5,816 | 74,199 | 460,276 |
Transaction cs00000001_0022 | 5,821 | 77,851 | 465,855 |
Transaction cs00000001_0023 | 5,813 | 83,318 | 479,238 |
Transaction cs00000001_0024 | 10,84 | 88,868 | 475,196 |
Transaction cs00000001_0025 | 11,293 | 89,018 | 490,799 |
Transaction cs00000001_0026 | 11,038 | 93,308 | 485,915 |
Transaction cs00000001_0027 | 11,219 | 96,048 | 498,511 |
Transaction cs00000001_0028 | 5,809 | 94,417 | 489,845 |
Transaction cs00000001_0029 | 15,859 | 99,562 | 502,401 |
Transaction cs00000001_0030 | 16,784 | 104,167 | 498,288 |
Transaction cs00000001_0031 | 12,269 | 105,609 | 499,723 |
Transaction cs00000001_0032 | 11,023 | 106,738 | 499,772 |
Transaction cs00000001_0033 | 6,045 | 107,321 | 503,951 |
Transaction cs00000001_0034 | 5,806 | 113,227 | 501,034 |
Transaction cs00000001_0035 | 5,819 | 108,428 | 502,329 |
Transaction cs00000001_0036 | 10,828 | 112,202 | 498,247 |
Transaction cs00000001_0037 | 6,033 | 112,399 | 500,752 |
Transaction cs00000001_0038 | 5,809 | 112,614 | 499,992 |
Transaction cs00000001_0039 | 5,807 | 113,384 | 496,618 |
Transaction cs00000001_0040 | 10,818 | 117,861 | 496,336 |
Transaction cs00000001_0041 | 5,803 | 117,082 | 492,608 |
Transaction cs00000001_0042 | 20,808 | 118,138 | 488,454 |
Transaction cs00000001_0043 | 16,492 | 101,24 | 259,409 |
Transaction cs00000001_0044 | 17,04 | 120,386 | 485,127 |
Transaction cs00000001_0045 | 12,07 | 126,264 | 479,953 |
Transaction cs00000001_0046 | 11,083 | 119,817 | 478,629 |
Transaction cs00000001_0047 | 6,015 | 120,362 | 475,184 |
Transaction cs00000001_0048 | 5,802 | 119,653 | 468,99 |
Transaction cs00000001_0049 | 5,793 | 119,383 | 466,177 |
Transaction cs00000001_0050 | 10,85 | 118,167 | 464,681 |
Transaction cs00000001_0051 | 11,061 | 114,231 | 460,583 |
Transaction cs00000001_0052 | 11,104 | 114,2 | 456,234 |
Transaction cs00000001_0053 | 6,182 | 108,869 | 449,397 |
Transaction cs00000001_0054 | 5,786 | 110,435 | 445,084 |
Transaction cs00000001_0055 | 10,821 | 105,359 | 442,16 |
Transaction cs00000001_0056 | 11,028 | 100,307 | 437,662 |
Transaction cs00000001_0057 | 5,826 | 95,456 | 428,7 |
Transaction cs00000001_0058 | 5,799 | 91,63 | 424,068 |
Transaction cs00000001_0059 | 5,794 | 86,413 | 420,401 |
Transaction cs00000001_0060 | 5,795 | 79,905 | 414,678 |
Transaction cs00000001_0061 | 10,935 | 74,89 | 407,285 |
...
Service CPU Utilization
DE_instances T1(500-1K-2k). Service CPU usage during the test was quite low, only the mod-data-export-b okapi-b mod-permissions-b services had a slight increase up to 13%.
...
| Expand | ||
|---|---|---|
| ||
2024-02-05 19:52 Local time Top 10 CPU-consuming services |
DE_instances T2(Max).
DE_instances T2(MAX). Service CPU usage during the test was less than 15%, and one spike was on mod-consortia with CPU usage 1600%
...
DE_holdings T3(500-1K-2k).Service CPU usage during the test 500-1000-2000 was quite low, only the mod-data-export-b okapi-b mod-permissions-b services had a slight increase up to 16%.
...
Memory Utilization
DE_instances T1(500-1K-2k). During testing, the memory usage does not increase
...
DE_instances T2(Max). During testing, the memory usage does not increase, only mod-data-export at the begging of the test change the memory usage from 55 to 85%.
...
DE_holdings T3(500-1K-2k). During testing, the memory usage does not increase
...
DB CPU Utilization
DE_instances T1(500-1K-2k). Except for the database spikes that started at 18:15 and repeated every 30 minutes. CPU usage before tets was about 2.5%, during all Data Export of 500, 1000, and 2000 instances, CPU usage increased up to 4%;
...
DE_instances T2(Max).
...
CPU usage was about 4%, during all Data Exports. Spike about 18% correlate with high CPU usage on mod-consortia
...
DE_instances T1holdings T3(500-1K-2k). Except for the database spikes that started at 18:15 and repeated every 30 minutes. CPU usage CPU usage before tets was about 2.5%, during all Data Export of 500, 1000, and 2000 instances, CPU usage increased up to 4%;
...
DB Connections
DE_instances T1Export of 500, 1000, and 2000 holdings, CPU usage increased up to 5%;
...
DB Connections
DE_instances T1(500-1K-2k). Maximal number of DB connections was 1190 for 500 DE; 1270 for 1000DE and 1340 for 2000 DE.
...
DE_instances T2(Max). The number of DB connections at the beginning of the test was about 1200 and evenly decreased to 700 at the end of the test
...
DE_holdings T3(500-1K-2k). Maximal The maximal number of DB connections was 1190 100 for 500 DE; 1270 1220 for 1000DE and 1340 1400 for 2000 DE holdings.
...
DB Load
DE_instances T1(500-1K-2k).
...
DE_instances T2(Max).
...
DE_holdings T3(500-1K-2k).
...
SQL queries
DE_instances T1(500-1K-2k).
...
DE_instances T2(Max).
...
DE_holdings T3(500-1K-2k).
...
Errors / Additional information
...