PTF- Performance testing of Individual Big Workflows
Overview
Summary
Recommendations & Jiras
Test Runs
Test 1. OAI - PMH. Tenant: cs00000001_0003(https://park-university.folio.ebsco.com). Number of virtual users- 1.
Test 2. Bulk Holdings edit. Number of loops: 4. Consists of 4 actions: 1) Upload file; 2) Edit; 3) Rollback upload; 4) Edit
Test 3. Bulk Items edit. Number of loops: 4. Consists of 4 actions: 1) Upload file; 2) Edit; 3) Rollback upload; 4) Edit
Test 4. Bulk Users edit. Number of loops: 4. Consists of 4 actions: 1) Upload file; 2) Edit; 3) Rollback upload; 4) Edit
Test 5. List App refresh list. 1 virtual user updates 20 lists in sequence.
Test 6. Data export. 1 virtual user doing data export 2 times with a custom profile and 6 times with a default profile in sequence.
Results
Test 1.
transaction | Number Of Samples | Average | Median | pct90 | pct95 | pct99 | Min | Max |
TC_RQ_OPIH_/oai/records?verb=ListRecords&apikey=[APIKey]&resumptionToken=[resumptionToken] cs00000001_0002 | 2745 | 372 ms | 309 ms | 434ms | 1.22 s | 1.70 s | 263 ms | 1.70 s |
TC_RQ_OPIH_/oai/records?verb=ListRecords&metadataPrefix=marc21_withholdings&apikey=[APIKey] | 29 | 808 ms | 662 ms | 3.17 s | 5.75 s | 6.61 s | 286ms | 6.61 s |
Test 2.
TC_BE: HOLDINGS_RECORD upload cs00000001_0003 | 4.00 | 1.06 min | 1.04 min | 1.17 min | 1.17 min | 1.17 min | 56.55 s | 1.17 min |
TC_BE: HOLDINGS_RECORD_rollback In-app edit cs00000001_0003 | 4.00 | 2.50 min | 2.50 min | 2.55 min | 2.55 min | 2.55 min | 2.38 min | 2.55 min |
TC_BE: HOLDINGS_RECORD_rollback upload cs00000001_0003 | 4.00 | 56.61 s | 56.60 s | 56.82 s | 56.82 s | 56.82 s | 56.28 s | 56.82 s |
TC_main_BE: HOLDINGS_RECORD In-app edit cs00000001_0003 | 4.00 | 2.36 min | 2.38 min | 2.46 min | 2.46 min | 2.46 min | 2.30 min | 2.46 min |
Test 3
TC_BE: ITEM upload cs00000001_0003 | 4.00 | 3.86 min | 3.85 min | 4.06 min | 4.06 min | 4.06 min | 3.36 min | 4.06 min |
TC_BE: ITEM_rollback upload cs00000001_0003 | 4.00 | 3.60 min | 3.60 min | 3.64 min | 3.64 min | 3.64 min | 3.45 min | 3.64 min |
TC_BE: ITEM_rollback_ in-app edit cs00000001_0003 | 4.00 | 53.21 s | 1.03 min | 1.54 min | 1.54 min | 1.54 min | 22.22 s | 1.54 min |
TC_main_BE: ITEM_ in-app edit cs00000001_0003 | 4.00 | 33.31 s | 31.36 s | 1.29 min | 1.29 min | 1.29 min | 21.90 s | 1.29 min |
Test 4
TC_BE: USER upload cs00000001_0003 | 4.00 | 32.35 s | 32.35 s | 32.35 s | 32.35 s | 32.35 s | 32.35 s | 32.35 s |
TC_BE: USER_rollback in-app edit cs00000001_0003 | 4.00 | 36.64 s | 36.64 s | 36.64 s | 36.64 s | 36.64 s | 36.64 s | 36.64 s |
TC_BE: USER_rollback upload cs00000001_0003 | 4.00 | 31.07 s | 31.07 s | 31.07 s | 31.07 s | 31.07 s | 31.07 s | 31.07 s |
TC_main_BE: USER in-app edit cs00000001_0003 | 4.00 | 36.75 s | 36.75 s | 36.75 s | 36.75 s | 36.75 s | 36.75 s | 36.75 s |
Test 5
List id | tenant | Query | Number of returned records | Without load |
9acbffb2-599b-4c04-8d64-d40350d6193e, | cs00000001_0002 | Query: (items.updated_date > 12/26/2025) | 754000 | 1,85 min |
ebf47a4e-924b-4f18-9f37-cd8a0a9e00c3, | cs00000001_0002 | Query: (loans.checkout_date > 01/07/2024) AND (users.active == True) | 0 | 4 sec |
02bbd876-f3bd-4602-8366-e9a052dd376b, | cs00000001_0003 | mtypes.name != 2 Dimensional Graphic) | 162061 | 14 sec |
63b6433e-d6f3-4807-962b-3dd153fd2fe4, | cs00000001_0003 | Query: (loans.status_name == Open) AND (users.active == True) | 0 | 3 sec |
1d115c40-dd74-46e9-a9a7-ca5e0e66fa7d, | cs00000001_0004 | (items.effective_call_number starts with G) | 8790 | 4 sec |
ed1fe639-d9d7-4622-b929-79cc086e9019, | cs00000001_0004 | (loclibrary.name != ROCK Greenlease Library) | 1210345 | 26 sec |
6fcea6a4-298d-4116-b8c5-9d3581f8a460, | cs00000001_0005 | Query: (users.created_date > 01/08/2021) AND (users.active == True) | 31000 | 5 sec |
ab7fab61-b68d-47b4-97ba-03ea2e68f61b, | cs00000001_0005 | Query: (items.status_name in [Aged to lost, Available, Awaiting pickup, Awaiting delivery, Checked out, Claimed returned, Declared lost, In process, In process (non-requestable), In transit, Intellectual item, Long missing, Lost and paid]) | 154000 | 10 sec |
16d8469f-92b9-4673-9c33-45931b92e00d, | cs00000001_0006 | (mtypes.name == 2 Dimensional Graphic) AND (instances.title starts with A) | 25300 | 2,4 min |
571df569-79c1-421c-afc0-032a558d23ee, | cs00000001_0006 | Query: (holdings.call_number starts with A) | 5890 | 3 sec |
09602d2e-6187-4917-8704-edf8ed81b895, | cs00000001_0007 | Query: (holdings.call_number is null/empty true) AND (effective_location.name == DCB) AND (holdings.updated_at > 01/08/2025) AND (permanent_location.name == DCB) AND (holdings.hrid starts with mbtsho000003) | 61500 | 11 sec |
d6f8c5be-1ed5-49a3-8246-87cfa11a3941, | cs00000001_0007 | (instance.shared == Local) AND (instance.title contains a) AND (instance.hrid != mbtsin00000) | 1200000 | 5,45 min |
82e54134-e2c3-4d51-bfdb-b3fd029c9799, | cs00000001_0007 | Query: (loans.action is null/empty false) AND (instance.title starts with B) AND (users.active == True) AND (instance.instance_type_name == text) | 63 | 7 sec |
ff422ca4-26b7-4f5b-b8ce-6f9c993843f0, | cs00000001_0008 | Query: (loclibrary.name in [DCB, MWSU Library]) AND (holdings.updated_at < 01/08/2026) AND (holdings.hrid starts with mwsuho000002) | 99863 | 13 sec |
bf3102c6-9fb7-4f6a-97c0-4ce2bfbfd9bd, | cs00000001_0008 | (users.created_date is null/empty false) AND (groups.group in [zEBSCO Support Group, staff, undergrad, faculty, graduate]) AND (users.barcode contains 1) | 994 | 3 sec |
e6fd6c2d-fd91-4e71-bedf-ec3d0ca4f7d3, | cs00000001_0008 | (items.status_name is null/empty false) AND (loans.due_date < 01/08/2026) AND (users.barcode contains 1) AND (users.barcode contains 2) AND (users.barcode contains 3) AND (instance.shared in [Shared, Local]) | 1002 | 3 sec |
7a11b736-12f8-4077-8756-20cfe02b729f, | cs00000001_0009 | Query: (instance.discovery_suppress == True) AND (date_type.name is null/empty true) | 10000 | 5,91 min |
303273ff-53aa-48e2-965c-adaa1275f089, | cs00000001_0009 | Query: (items.item_level_call_number is null/empty true) AND (mtypes.name in [3 Dimensional Object, Accessories, 2 Dimensional Graphic]) | 887472 | 2,2 min |
12237a75-227c-4168-9d1c-b702dbf0d2bd, | cs00000001_0010 | Query: (instance.instance_type_name in [cartographic dataset, cartographic image, cartographic tactile image]) | 31000 | 34 sec |
f473462f-002e-42d3-93b2-6e122257428b, | cs00000001_0010 | (instance.updated_at < 01/07/2026) AND (instance.title contains Charles) | 104113 | 28 sec |
Test 6
TC_DE_Exporting MARC Bib records custom workflow Transaction cs00000001_0002 | 9.81 min |
TC_DE_Exporting MARC Bib records custom workflow Transaction cs00000001_0004 | 7.48 min |
TC_DE_Exporting MARC Bib records workflow Transaction cs00000001_0003 | 5.39 min |
TC_DE_Exporting MARC Bib records workflow Transaction cs00000001_0005 | 3.87 min |
TC_DE_Exporting MARC Bib records workflow Transaction cs00000001_0006 | 5.14 min |
TC_DE_Exporting MARC Bib records workflow Transaction cs00000001_0007 | 4.23 min |
TC_DE_Exporting MARC Bib records workflow Transaction cs00000001_0008 | 3.88 min |
TC_DE_Exporting MARC Bib records workflow Transaction cs00000001_0009 | 3.71 min |
Resource utilization
Test 1. OAI - PMH.
Response time graphs
On this graph, you can see 4 main lines:
Yellow Line (Active Threads): 1 Virtual user
Blue Line (Throughput): It shows that 1.5 requests per second are actually processed.
Green Line (Response Time): ~300ms
Red Line (Error Rate): There are no failed requests
Every 1 minute, we see sharp spikes in the response time graph, from 300ms to 1.5 seconds.
Service CPU utilization
Service memory utilization
DB CPU utilization
DB Load
Test 2.
Service CPU utilization
Test 3.
Test 4.
Test 5
Service CPU utilization
Service memory usage
RDS CPU utilization
DB Connections
DB Load
Test 6.
Service CPU utilization
Service memory utilization
All services have stable memory utilization except
DB CPU utilization
DB Connections
DB Load