Steps for testing process
- Olga Kondratenko
- Mykhailo Petryshyn
- Hanna Tuhuzbayeva
IN PROGRESS
Check-In - Check-Out tests
Preparation for the test
Cleare database and create loans:
From the Carrier.io machine go to the circ-data-load folder and run the commands:
Make sure that the DB is clean by running
export PGPASSWORD='[DB password]';psql -f checkin-checkout-db-restore.sql -a --echo-all -h [DB host] -U [DB name]
To add seed data to mimic a database that already has loans and requests
./circ-data-load.sh psql_[environment name].conf [tenant]
Test run
For each new release check the test script, and change it to be up to date, upload a new version to the Carrier.io circulation bucket. (For all tests test name and test plan name should be equal)
Start test from Jenkins with proper Carrier.io bucket and test name parameters.
Typical tests parameters:
5, 8, 20, and 25 concurrent users for 30 minutes each. (repeat twice)
Also, run a longevity test of 24 hours to detect any trends in memory.
Analise results in Grafana and CloudWatch:
- Analyze the response time of CI and CO from Grafana and compare it to the previous test
- Analyze the slowest API - Grafana
- Analyze memory utilization of the services in AWS (CloudWatch)
- Analyze CPU and memory utilization of instances and modules involved
- Analyze RDS parameters CPU utilization, Connection count, queries
- Look through the AWS logs if there were any ERRORS during the test
Report example Check-in-check-out Test Report (Nolana)
For more details
Data Import:
Data Import is the FOLIO app where users can import one or more records in batch into various FOLIO apps. Data Import can import MARC Bibliographic records to create and/or update records in the Inventory App and Source Record Storage.
Recommended Maximum File Sizes and Configuration
With data import, we can create new 1- to 500k records (commonly 200k new items and instance or holdings records created), and as a result, we have more and more records in the database after each test.
To clear the database after the DI tests use SQL:
Delete from [tenant]_mod_source_record_storage.records_lb where created_date > '[test date format:YYYY-MM-DD hh:mm:ss.00+00]'; Delete from [tenant]_mod_inventory_storage.item where creation_date > '[test date format:YYYY-MM-DD hh:mm:ss.00+00]'; Delete from [tenant]_mod_inventory_storage.holdings_record where creation_date > '[test date format:YYYY-MM-DD hh:mm:ss.00+00]'; Delete from [tenant]_mod_inventory_storage.instance where creation_date > '[test date format:YYYY-MM-DD hh:mm:ss.00+00]';
To analyze results:
- Analyze the duration of DI jobs (the best way in DB table [tenant]_mod_source_record_manager.job_execution )and compare it to the previous test (or analyze from UI)
- Analyze if all records created or updated successfully (can be performed from UI)
- Analyze memory utilization of the DI services
- Analyze CPU and memory utilization of instances and modules involved
- Analyze RDS parameters CPU utilization, Connection count, queries
- Look through the AWS logs if there were any ERRORS during the test
Report example: Data Import test report (Nolana)
MARC BIB
MARC BIB Create
To run MARC BIB Create go to the DATA IMPORT app and upload the file with a proper number of marc records(1k, 2k, 5k, 10k, 25k, 50k, and 100k).
Choose "PTF - Create2" job profile. "Actions"→ "Run" → "Run".
The job starts when the file starts to upload.
MARC BIB Update
To run MARC BIB Update Select from the database the proper number of IDs(not updated records IDs). You can use records from the MARC BIB Create process.
- To pick the exact execution time of DI Create (it is from started_date to completed_date) you can use:
select completed_date-started_date as job_time,hrid,file_name,started_date,completed_date, status, job_profile_name FROM [tenant]_mod_source_record_manager.job_execution order by started_date desc
The same SELECT can be used to analyze job duration.
2. To select IDs from the database for a future update:
select id from [tenant]_mod_inventory_storage.instance where creation_date >= '[started_date]' and creation_date<= '[completed_date]'
Save IDs to .csv file (IDs should start from the first line of the file)
Go to the Data EXPORT, choose created .csv file, choose profile "Export for Data Import updates" -> "instances" in drop-down -> "Run".
Click "View all", sort by ID and click on the generated .mrc file to download.
Go to the DATA IMPORT app and upload saved .mrc file with a proper number of exported marc records(1k, 2k, 5k, 10k, 25k, 50k, and 100k).
Choose "PTF - Updates Success - 1" job profile. "Actions"→ "Run" → "Run".
The job starts when the file starts to upload.
Files for MARC BIB Create:
TAMU_500K.zip (Due to file corruption DI job can be finished with errors)
500k_bib.zip (Edited file, job could be completed without errors)
Jobs should be performed one at a time and 2-5 min pauses after.
MARC Holdings
1. Conduct data import for 1 record file with job profile Default - Create Holdings and SRS MARC Holdings.
2. After it completed - copy field 001 from newly created record (in UI). For this you should choose file name of the last DI job, than any title and copy 001 field (it should looks like “in00007579903”).
3. Open file that should be imported as marc holding using Marc edit. Replace all 004 fields with 001 that you have from previous step.
4. In UI go to ”APPS” -> Settings-> Tenant-> locations, choose any institution, campus, library and location. Copy code of this location and replace all 852 fields in file with this code. Note: not the whole field should be replaced, only part after "$b" and till the next "$".
5. Conduct data import for the files with job profile Default - Create Holdings and SRS MARC Holdings.
Also, more detailed instructions can be found at the link: How to upload MARC Holdings via UI?
Files for MARC holdings Create
MARC Authorities
To run MARC Authorities go to the DATA IMPORT app and upload the file with a proper number of marc records(1k, 5k, 10k, 25k, 50k).
Choose "Default-Create SRS MARC Authority" job profile. "Actions"→ "Run" → "Run".
Files for MARC Authorities
Main KPI here is duration of data MARC Authorities. To define exact duration of DI job use:
select completed_date-started_date as job_time,hrid,file_name,started_date,completed_date, status, job_profile_name FROM [tenant]_mod_source_record_manager.job_execution order by started_date desc
Additional info:
To debug failed jobs (or jobs that stuck) check the logs of next modules
- mod-data-import
- mod-data-import-cs
- mod-source-record-storage
- mod-source-record-manager
- mod-inventory
- mod-inventory-storage
Additionally : kafka broker logs,DB logs
Data export
MARC BIB
To run Data Export: create or take existing .csv files with instance IDs of 1k, 100k, 200k, and 500k records. (IDs should start from the first line of the file)
Go to the Data Export app and download the file with the proper number of marc records. Choose "srs - holdings and items" job profile → "Instance" → "Run".
Wait for the job to be finished. If you can not see your job on the preview page, click on "View all" and then click on column name "ID" twice to order jobs IDs desc.
Download exported file .mrc
Files should be exported one by one with 2-5 min pauses.
To create a Job Profile:
Go to "Settings" → "Data Export" → "Field Mapping Profiles" if the Mapping profile does not exist and click "New"
Fill in all parameters according to the screenshot. For "srs - holdings and items" job profile
Name:
srs - holdings and items locations
Output format:
MARC
FOLIO record type*(check):
- Source record storage (entire record)
- Holdings
- Item
Description:
Mapping profile for perf testing - it will get the records from SRS, inventory instance (if no underlying SRS record present) holdings and items.
Add Transformations:
Field name | Transformation |
|---|---|
| Holdings - Permanent location | 900 $a |
| Holdings - Temporary location | 901 $a |
| Item - Effective call number | 902 $a |
| Item - Effective location | 903 $a |
Save & close
Go to Job Profile and click "New"
Add parameters
Name:
srs - holdings and items
Mapping profile:
srs - holdings and items locations
Description:
Make data export work more hard
Save & close
EDIFACT
The purpose of edifact export is to export orders (with or without PO lines) from organizations.
Unlike the others exports -edifact is using FTP server to store exported files.
We have a list of 10 predefined organizations to work with (below path to organizations integrations):
- /organizations/2e6d8468-0620-475b-a092-045e659a0aaa/integration/c8cc7080-0b89-4b20-b55e-0a3de73aae4c/view?limit=50&offset=0&query=ZHONEWAX%24%25
- /organizations/e02e4507-3c3a-40e5-b2f6-dbb9a15ac950/integration/7f70799a-ae1b-44a8-b17e-d75b4967f1bc/view?limit=50&offset=0&qindex=code&query=Z50EGGS%24%25
- /organizations/ede1513a-ea9b-46e5-8f2c-7d93836f9742/integration/2c65379c-fc45-4b58-bb24-cadd68f2177d/view?limit=50&offset=0&qindex=code&query=EBSCO
- /organizations/1a36d83e-526f-48ad-9956-4e341a40fbbb/integration/befaaf4f-87f7-49e0-95b8-e051c19a4c8a/view?limit=50&offset=0&qindex=code&query=SRPRIMEDIA
- /organizations/6d363fea-c0e3-4c32-8074-4124b0a2307e/integration/cda456b8-b34e-408d-98e3-c1410e141ead/view?limit=50&offset=0&qindex=code&query=SRHARR
- /organizations/382831f9-c680-4b7e-a3ab-daa3022fa4cb/integration/1cdc21d8-8e8f-4ee9-879b-227c0a034807/view?limit=50&offset=0&qindex=code&query=SRD
- /organizations/da29ee41-727a-4372-9472-7818c948f8c7/integration/f7029c2a-7176-4ef6-ba28-07390a8dcf06/view?limit=50&offset=0&qindex=code&query=ZAWWA%24%25
- /organizations/02c0820c-108c-41c4-ab9c-d289877e8dfa/integration/44be204e-93c2-4a45-983e-88f45381a6a6/view?limit=50&offset=0&qindex=code&query=HRSW
- /organizations/2d6f2d47-9664-4794-8cd5-4e168bd57384/integration/22409324-355d-4d0a-9010-057e88c7d4ec/view?limit=50&offset=0&qindex=code&query=SRWEST
- /organizations/a58a5dcc-7e60-492f-b795-7a791c0970fe/integration/b2570852-0fc0-438c-a30e-a248a66bcbea/view?limit=50&offset=0&qindex=code&query=SRNHM
each path above will lead to page like this:
Here is basic integration information + FTP server configuration + Scheduler.
Preparation for test
clean old records (orders)
TRUNCATE TABLE fs09000000_mod_orders_storage.purchase_order CASCADE
populate the database using script:
Script above consist of 10 parts (each part corresponding to each organization).
by changing next values we can manipulate with numbers of orders and PO lines will be created to each organization
-- 1 - amount of organizations to be created
-- 2 - amount of orders per organization
-- 3 - amount of polines per order
select public.generate_data_for_edifact_export(1, 1000, 1); (in this particular case script will create 1000 orders with 1 PO line each)
to check if data were created successfully use query:
SELECT jsonb->>'vendor', count(jsonb->>'vendor') FROM fs09000000_mod_orders_storage.purchase_order where creation_date>'2022-08-30' group by jsonb->>'vendor' limit 10
Set scheduler
Using UI on each organization integration set up proper scheduler Actions→Edit
Set up scheduler on the same time to have job concurrency.
Testing scenario
Test # | Concurrent jobs | Orders per job |
|---|---|---|
1 | 10 | 500 |
| 2 | 10 | 1000 |
| 3 | 10 | 2000 |
| 4 | 10 | 3000 |
After scheduler trigger the export job (or jobs) they will appear on export manager app on UI.
Bursar
Bursar export is the export of particular user fees/fines.
Data preparation
Check out several available items for particular user. According to policy wait until loan will have fees/fines.
Or create fee/fine for user using user app
test run
- go on apps→settings→users
- in fee/fine section go on "transfer criteria" tab
- choose appropriate fee/fine owner (in PTF case it's test2)
You can either set a scheduler or run bursar export manually
After test is tarted it'll appear on data export manager page
Expected numbers for testing is here Feature - Team Responsibility Matrix
Circulation Log
Circulation log export is part of data-export manager workflow to export all circulation activities for specified time
data preparation
There is no special data preparation is needed. However in order to manipulate with the numbers should be exported we're using "date" filter in combination with other filters to get needed number to be exported .
On the screenshot you can see UI. By clicking "Export results (CSV)" export job going to appear on "data export manager" UI
Approximate number of logs to be exported is 60K.
EHoldings
EHoldings is part of data-export manager workflow to export titles of particular provider.
Each title can be exported numerous of times concurrently.
To start EHoldings - go on eholdings app, search for provider → go on provider. Find appropriate package and click on it.
Each package contains some number of titles.
To start export click "actions"→"export package CSV"
after export start - export job will appear on export-manager page.
Example packages to use
Note: each package should have at least 15 long notes.
here is package examples applicable to PTF
/eholdings/packages/58-473?searchfield=title - 2 877 titles
/eholdings/packages/76-1904?searchfield=title - 4 424 titles
/eholdings/packages/53-1094073 - 9 631 titles
Bulk Edit
All necessary information about:
User records testing scenarios
Testing expectations
Concurrent and consecutive tests
Bulk edit testing setup
- Failover tests
Scenarios are here Orchid - Bulk Edit Performance testing
Items (Orchid)
Preparation for the test
Populate database
TRUNCATE TABLE [tenant]_mod_patron_blocks.user_summary;
TRUNCATE TABLE [tenant]_mod_circulation_storage.loan;
TRUNCATE TABLE [tenant]_mod_circulation_storage.audit_loan;
TRUNCATE TABLE [tenant]_mod_circulation_storage.request;
TRUNCATE TABLE [tenant]_mod_circulation_storage.patron_action_session;
TRUNCATE TABLE [tenant]_mod_circulation_storage.scheduled_notice;
TRUNCATE TABLE [tenant]_mod_notify.notify_data;
UPDATE [tenant]_mod_inventory_storage.item SET jsonb = jsonb_set(jsonb, '{status, name}', '"Available"') WHERE jsonb->'status'->>'name' != 'Available';
UPDATE [tenant]_mod_inventory_storage.item SET jsonb = jsonb_set(jsonb, '{permanentLocationId}', '"08863ef2-508d-491e-9603-b6e1272f6855"') where jsonb->'permanentLocationId' != '"08863ef2-508d-491e-9603-b6e1272f6855"' and jsonb->'barcode' is not null and jsonb->'barcode' >= '"000"' and jsonb->'barcode'<= '"090155243"';
UPDATE [tenant]_mod_inventory_storage.item SET jsonb = jsonb_set(jsonb, '{temporaryLocationId}', '"6216269b-9c9e-4129-adc5-ca9397137edc"') where jsonb->'temporaryLocationId' is null and jsonb->'barcode' is not null and jsonb->'barcode' >= '"000"' and jsonb->'barcode'<= '"090155243"';
UPDATE [tenant]_mod_inventory_storage.item SET jsonb = jsonb_set(jsonb, '{permanentLoanTypeId}', '"ac19815e-1d8e-473f-bd5a-3193cb301b8b"') where jsonb->'permanentLoanTypeId' != '"ac19815e-1d8e-473f-bd5a-3193cb301b8b"' and jsonb->'barcode' is not null and jsonb->'barcode' >= '"000"' and jsonb->'barcode'<= '"090155243"';
UPDATE [tenant]_mod_inventory_storage.item SET jsonb = jsonb_set(jsonb, '{temporaryLoanTypeId}', '"23e4f1ec-cf31-4098-959e-de64ce4781ce"') where jsonb->'temporaryLoanTypeId' is null and jsonb->'barcode' is not null and jsonb->'barcode' >= '"000"' and jsonb->'barcode'<= '"090155243"';
Test run
For each new release check the test script, and change it to be up to date. To check if all is up to date you can perform Bulk edit of 1 record from UI and record it with the BlazeMeter Chrome plugin or Google Chrome Developer Tools, etc. and compare API calls.
Upload a new version to the Carrier.io export bucket. (For all tests test name and test plan name should be equal)
Enable thread groups with the proper number of records(100, 1k, 5k, 10k, 25k, 50k, and 100k) in the script, and ensure that all threads will be run one at a time.
Start testing locally.
Typical tests parameters:
Orchid - Bulk Edit Performance testing
1, 2, 3, 4, and 5 concurrent users.
Analise results in Database and CloudWatch
select (end_time - start_time)as job_duration,matched_num_of_records,entity_type,* from [tenant]_mod_bulk_operations.bulk_operation order by start_time desc limit 1000
It is only 1 job ID for Items Bulk Editing for both parts: finding matched records and updating (job type BULK_EDIT_IDENTIFIERS).
Users (Orchid)
Preparation for the test
Populate database
UPDATE [tenant]_mod_users.users SET jsonb = jsonb_set(jsonb, '{personal,email}', '"[email].com"') where jsonb->'barcode' is not null and jsonb->'personal'->>'email' = '[email].org';
UPDATE [tenant]_mod_users.users SET jsonb = jsonb - 'expirationDate' where jsonb->'barcode' is not null and jsonb->'expirationDate' is not null;
UPDATE [tenant]_mod_users.users SET jsonb = jsonb_set(jsonb, '{patronGroup}', '"5fc96cbd-a860-42a7-8d2b-72af30206712"') where jsonb->'barcode' is not null and jsonb->'patronGroup' = '"294db32c-0675-4dd5-8c5f-e3974c4ab6f2"';
Test run
For each new release check the test script, and change it to be up to date, upload a new version to the Carrier.io export bucket. (For all tests test name and test plan name should be equal)
Enable thread groups with the proper number of records(100, 1k, 2.5k, 5k, 10k) in the script, and ensure that all threads will be run one at a time.
Start testing locally.
Typical tests parameters:
Orchid - Bulk Edit Performance testing
1, 2, 3, 4, and 5 concurrent users.
Analise results in Database and CloudWatch
select (end_time - start_time)as job_duration,matched_num_of_records,entity_type,* from [tenant]_mod_bulk_operations.bulk_operation order by start_time desc limit 1000
It is only 1 job ID for Users Bulk Editing for both parts: finding matched records and updating (job type BULK_EDIT_IDENTIFIERS).
Holdings (Orchid)
Preparation for the test
Populate database
UPDATE [tenant]_mod_inventory_storage.holdings_record SET jsonb = jsonb_set(jsonb, '{permanentLocationId}', '"fac5de34-26ee-456d-86b1-f04fdf680d65"') WHERE jsonb->'hrid'>='"ho87055"' and jsonb->'hrid'<='"ho9999999"' and jsonb->'permanentLocationId'!='"fac5de34-26ee-456d-86b1-f04fdf680d65"';
UPDATE [tenant]_mod_inventory_storage.holdings_record SET jsonb = jsonb_set(jsonb, '{temporaryLocationId}', '"2b8f7d63-706a-4b56-8a5e-50ad24e33e4c"') WHERE jsonb->'hrid'>='"ho87055"' and jsonb->'hrid'<='"ho9999999"' and jsonb->'temporaryLocationId' is null;
Test run
For each new release check the test script, and change it to be up to date, upload a new version to the Carrier.io export bucket. (For all tests test name and test plan name should be equal)
Enable thread groups with the proper number of records(100, 1k, 5k, 10k, 100k) in the script, and ensure that all threads will be run one at a time.
Start testing locally.
Typical tests parameters:
Orchid - Bulk Edit Performance testing
1, 2, 3, 4, and 5 concurrent users.
Analise results in Database and CloudWatch
select (end_time - start_time)as job_duration,matched_num_of_records,entity_type,* from [tenant]_mod_bulk_operations.bulk_operation order by start_time desc limit 1000
It is only 1 job ID for Holdings Bulk Editing for both parts: finding matched records and updating (job type BULK_EDIT_IDENTIFIERS).
OAI-PMH
To run oai-pmh test use script oai-pmh-test git repo.
Preparation for testing
In most of a times oai-pmh test doesn’t require additional preparations. However, usually after (or before) test database cleaning required.
to delete previous oai-pmh request run truncate table
[tenantID]_mod_oai_pmh.request_metadata_lb cascade
this query will clear all data in tables mod_oai_pmh.request_metadata_lb and mod_oai_pmh.instances .
Test flow
Test consist of few calls:
Initial call that was performed only once
|
Subsequent harvesting calls:
|
These calls were performed repeatedly, harvesting 100 records each time until there is no more data in [tenant]_mod_oai_pmh.instances table to harvest.
[resumptionToken] was set to 100, returning in initial call response and in each harvesting call until there is no more records to harvest. When all data has being harvested - resumptionToken will not return with the response.
Additional information
Test will run until there is instances in DB to harvest (test designed in a way to run infinitely until first error. first error, which is expected, will happen when there will be no resumption token in response. Whisch will mean end of a test)
This test (and oai-pmh itself) aimed on one process at the time so we'll use next test parameters.
| param | value |
|---|---|
| VUsers | 1 |
| RampUp | 0 |
| Duration | Until completion |
Reindex
To get interim or final results of index size during reindexing go to Open Search service and copy Domain Endpoint (VPC).
Then paste it into the request
curl -v VPC/_cat/indices?v&s=store.size:desc
Make tunnel via AWS Session manager
https://127.0.0.1:9999/_cat/indices
Go to carrio-io and paste it there as a command. So as a result we get such data like this table
|
Copy/paste table by SHIFT+INSERT into excel sheet and edit it to use it in future. Go to Data, then Text to Column and press next to finish.
Fiscal year rollover
Fiscal year brief data structure
Data preparation
Before each fiscal year rollover data should be prepared.
To restore the data (100K orders: 50% open, 50% closed) backups of DB schemas were created.
- Truncate next schemas:
truncate table fs09000000_mod_finance_storage.fiscal_year cascade;
truncate table fs09000000_mod_finance_storage.group_fund_fiscal_year cascade;
truncate table fs09000000_mod_finance_storage.fund_type cascade;
truncate table fs09000000_mod_finance_storage.ledger cascade;
truncate table fs09000000_mod_finance_storage.fund cascade;
truncate table fs09000000_mod_finance_storage.budget cascade;
truncate table fs09000000_mod_finance_storage.expense_class cascade;
truncate table fs09000000_mod_finance_storage.budget_expense_class cascade;
truncate table fs09000000_mod_finance_storage.transaction cascade;
truncate table fs09000000_mod_orders_storage.purchase_order cascade;
truncate table fs09000000_mod_orders_storage.po_line cascade;
truncate table fs09000000_mod_orders_storage.titles cascade;
2. Restore the data from the backups:
- Go to the /home/ec2-user/Finance directory on the host and download backup files for the database ("backOrders.sql" and "backFinance.sql").
- Restore data in PgAdmin. Choose "[tenant]_mod_orders_storage" → "Restore" → choose file "backOrders.sql" → "Restore". Then do the same for "[tenant]_mod_finance_storage" (use "backFinance.sql" file here).
- Restore process can fail. In this case you can use the same approach but restore each table sequentially. Select tables it in the same seqence as they are listed in point 1 above.
For other orders quantity and data structure JMeter script should be used (perf-testing/workflows-scripts/fiscal_year/FY_rollover_preparation on the GitHub). But in this case data generation will take more time.
FY rollover start
- Go to "Finance" → "Ledger" → Check status "Active" → "ROLLOVERTEST" ledger → "Actions" → "Rollover"
- Fill in the form like this:
3. Click "Test Rollover". Test rollover is a feature that should be also tested and duration is measured.
4. When test rollover is finished click "Rollover".
FY rollover monitoring
For monitoring FY Rollover progress go to "Finance" → "Ledger" → Check status "Active" → "ROLLOVERTEST" ledger. There you will see progress bar and information about the errors if there are any.
To see rollover logs choose ledger → "Actions" → "Rollover logs".
Also you can check rollover progress in the database. Go to the "[tenant]_mod_finance_storage" schema -> "[tenant]_mod_finance_storage.ledger_fiscal_year_rollover_progress" table → choose the rollover.
There you will find status for each part of the rollover:
- orders ("ordersRolloverStatus")
- finance ("financeRolloverStatus")
- budgets ("budgetsClosingRolloverStatus")
and also overall status.
FY rollover termination
There is no way to terminate rollover process in UI (at the moment). But you can truncate all the tables listed in "Data preparation" part and restart modules if needed.
ListApp
For ListApp testing 200K items with "Unknown" status should be created.
Lists creation:
- Go to the Lists app.
- Check if there are lists created on this environment (name should be like "Test-PTF-*").
- If the are no test lists - create it with the Jmeter script. You can do it by enabling "Create List" Thread group and setting up list number (loop count). It should be done only one time for each environment.
Data generation:
- Run checkin-checkout-db-restore.sql script (as for CICO tests) to restore the database.
- Go to the /home/ec2-user/ListApp directory and run listapp_data_prepare.sql script. This script creates 200K items with "Unknown" status on each of three tenants for multi-tenant testing. If you're testing single tenant, you can just run specific queries from the file directly in the database.
- If you test multiple workflows, make sure that data (e.g. for CICO) doesn't interfere between each other. Items used in listapp_data_prepare.sql script shouldn't be used in CICO data preparation.
Title-level requests (holds)
- Run necessary commands to return the database to the initial state. Do this before each test run. Wait several minutes before the test start.
- Conduct check-out for the items with JMeter script Create_TLR.jmx (disable "Create_TLR" step).
- Conduct baseline - run check-in load tests with different number of users.
- Conduct verification - repeat tests with the same approach but before each test also generate 10 TLR for each item by running JMeter script (Create_TLR.jmx) - enable both Check-in and Create_TLR steps.
- Compare test results.
Note - make sure to use the same list of items for Create_TLR.jmx script and Check-in script. Also, items should be selected for those instances which have 1 item per instance.