Data Export Test Report (Mobius)
Overview
This document contains the results of testing Data Export tests on 61 tenants (excluding the central tenant) on MCPT environment:
DE_instances T1(500-1K-2k). (MARC BIB) on Mobius environment with Data Export tests for 500, 1k, 2k. with Default instances export profile.
DE_instances T2(Max). (MARC BIB) on Mobius environment with Data Export tests for a maximal number of instances on each member tenant(The exact number of instances is in the section “Errors / Additional information”). with Default instances export profile.
DE_holdings T3(500-1K-2k).Holdings on Mobius environment with Data Export tests for 500, 1k, 2k. with Default holdings export profile.
DE_holdings T4(Max). Holdings on Mobius environment with Data Export tests for a maximal number of instances on each member tenant(The exact number of instances is in the section “Errors / Additional information”) with Default holdings export profile.
DE_authority T5(500-1K-2k). Authority on Mobius environment with Data Export tests for 500, 1k, 2k. with Default authority export profile.
Ticket: https://folio-org.atlassian.net/browse/PERF-777
Recommendations & Jiras
Add more CPU for
Summary
The total duration:
DE_instances T1 for: 500 records is 473 seconds; 1000 records is 922 seconds; and 2000 is 1724 seconds;
DE_instances T2(Max) about 23 hours;
DE_holdings T3 for: 500 records is 445 seconds; 1000 records is 508 seconds; and 2000 is 842 seconds;
DE_holdings T4(Max) about 9 hours and 45 minutes;
DE_authority T5 for: 500 records is 331 seconds; 1000 records is 335 seconds; and 2000 is 432 seconds.
Data-export duration statistics:
Data export | Instances | Holdings | Authority | ||||||
500, sec | 1000 , sec | 2000 , sec | 500 , sec | 1000 , sec | 2000, sec | 500 , sec | 1000 , sec | 2000, sec | |
Average duration | 83 | 426 | 1184 | 10 | 87 | 405 | 5,9 | 6,2 | 10,6 |
Minimal duration | 12 | 32 | 127 | 5 | 16 | 32 | 5,8 | 5,7 | 1,15 |
Maximal duration | 131 | 571 | 1372 | 29 | 127 | 504 | 6,6 | 11,7 | 15,8 |
75t percentile | 114 | 539 | 1350 | 12 | 113 | 490 | 5,8 | 6,1 | 14,4 |
90t percentile | 126 | 553 | 1362 | 19 | 119 | 500 | 5,9 | 6,5 | 15,5 |
DE_instances T1(500-1K-2k). The duration of instance date-export for 500 recordings increased from 12 seconds for the first tenant to about 100 for the 33rd tenant, then the processing time was approximately unity from 100 to 120 for tenants 33 to 62. The situation was similar for export dates of 1000 and 2000 records.
DE_holdings T3(500-1K-2k) For 2000 records Holdings data export duration increased from 32 seconds for the first tenant to about 420 sec for the 22nd tenant, then the processing time was approximately from 420 to 470 sec for tenants 23 - 61.
DE_instances T2(Max) and DE_holdings T4(Max) Both tests show a delay in the start time, but for DE_holdings T4(Max) maximal delay is 8 minutes for the files with the largest number of id (Tenant 42, export 640K records). The delay for the instances data-export for the same tenant is 9 hours and 50 minutes.
The duration of the longest data-export for holdings is 7 hours and 40 minutes, and 12 hours and 30 minutes for instances on 42nd tenants.
Recommendations & Jiras
Restart the tests DE_instances T2(Max) and DE_holdings T4(Max) with different POOL_SIZE, and BATCH_SIZE parameters to check Data-export duration improvement. [MDEXP-688] Make configurable params for Data-Export(POOL_SIZE, BATCH_SIZE) - FOLIO Jira (atlassian.net)
Restart Data-Import(Authority) test on mcpt to check how Kafka topics affect performance(found in the scope of data-preparation) [MODELINKS-213] Data-import process creating incorrect topics in Kafka - FOLIO Jira (atlassian.net)
Test Results
DE_instances T1(500-1K-2k). This table contains durations for Data-export for jobs with “Default instances export profile” on 61 tenants with 3 sets of data(500 records; 1000 records; 2000 records).
Transaction name | DE 500, sec | DE 1K, sec | DE 2K, sec |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0001 | 12 | 32 | 127 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0002 | 16 | 51 | 207 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0003 | 23 | 73 | 330 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0004 | 22 | 100 | 494 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0005 | 27 | 122 | 606 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0006 | 29 | 131 | 704 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0007 | 28 | 154 | 782 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0008 | 34 | 170 | 875 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0009 | 39 | 191 | 936 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0010 | 38 | 216 | 965 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0011 | 40 | 228 | 1022 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0012 | 45 | 261 | 1054 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0013 | 45 | 277 | 1082 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0014 | 45 | 293 | 1108 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0015 | 52 | 308 | 1163 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0016 | 51 | 331 | 1161 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0017 | 56 | 372 | 1183 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0018 | 56 | 374 | 1209 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0019 | 63 | 399 | 1232 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0020 | 63 | 419 | 1254 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0021 | 68 | 432 | 1275 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0022 | 69 | 457 | 1271 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0023 | 72 | 479 | 1290 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0024 | 74 | 475 | 1306 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0025 | 74 | 489 | 1300 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0026 | 75 | 506 | 1319 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0027 | 85 | 503 | 1336 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0028 | 80 | 502 | 1331 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0029 | 91 | 535 | 1347 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0030 | 87 | 532 | 1344 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0031 | 87 | 530 | 1357 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0032 | 93 | 539 | 1349 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0033 | 97 | 535 | 1363 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0034 | 97 | 547 | 1357 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0035 | 97 | 560 | 1373 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0036 | 107 | 554 | 1349 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0037 | 102 | 557 | 1359 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0038 | 103 | 563 | 1370 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0039 | 109 | 571 | 1363 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0040 | 104 | 548 | 1364 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0041 | 109 | 552 | 1365 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0042 | 115 | 553 | 1362 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0043 | 119 | 497 | 1363 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0044 | 126 | 555 | 1363 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0045 | 121 | 550 | 1356 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0046 | 126 | 553 | 1352 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0047 | 120 | 544 | 1352 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0048 | 131 | 551 | 1347 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0049 | 126 | 546 | 1340 |
DE_Exporting MARC Bib records workflow Transaction cs00000001_0050 | 130 | 538 | 1336 |