Test Coverage

Owned by Martin Tran
Last updated: Feb 06, 2023 by Olga Kondratenko
2 min read

Overview

The Performance Task Force test for performance of workflows, not of APIs or modules. At times there are APIs that need to be investigated further as a result of a poor workflow test result, but this is not something that the Task Force does regularly.  This page lists all the workflows that this group has worked on to date.  The workflows in red font are the ones that PTF test in each release.

Workflows

Circulation

  1. Check In, Check Out (with 1, 5, 8, 20, 25 concurrent users)
  2. Check In (by itself)
  3. Check out for users with 2000 loans (new)
  4. Title-level requests
  5. Item-level requests
  6. Check Ins for users with 10 TLRs attached
  7. Check Ins for users with 10 ILRs attached
  8. Renew loans

Data Import

  1. Creates and Updates of MARC BIB (1k, 2k, 5k, 10k, 25k, 50k, 100k records)
  2. Creates of MARC Authority (1k, 5k, 10k, 25k, 50k, records)
  3. Creates of MARC Holdings (1k, 5k, 10k, 80k records)
  4. Create and Update data import with Check In, Check Out for all 3 different kinds of MARC records
  5. Multi-tenants
  6. Data Import (Single record) Create & Update

Data Export Workflows

  1. Edifact

3 concurrent jobs - 1000 orders per user

5 concurrent jobs - 1000 orders per user

10 concurrent jobs - 1000, 2000, and 3000 orders per user

  1. eHoldings

Package "Wiley UBCM - Engineering (with notes)" - 1, 2, 4, 6, 10, 14 concurrent jobs

Package "Wiley UBCM - Engineering (without notes/agreements)" - 1 concurrent job

  1. Bursar

Jobs with 100, 200, 300, 400, 500, 1000, 1200, 1500, 1700, and 2000 records

  1. Circulation Logs 

Jobs with 20k, 40k, and 60k records

  1. Bulk Edits

  Baseline

Jobs with user barcodes (100, 1000, 2500, 5000 records)

Jobs with item barcodes (100, 1000, 10 000, 100 000 records)

Jobs with holdings HRIDs (100, 1000, 10 000, 100 000 records)

Scenario 1. Run simultaneously bulk edits:

  • one job for 2500  user records
  • one job for 10k item records

Scenario 2.  Run simultaneously bulk edits:

  • one job for 2500  user records
  • one job for 10k holdings records

Scenario 3. Run consecutively four jobs editing 2500 user records

Scenario 4. Run consecutively four jobs editing 10k  item records

Scenario 5. Run simultaneously four jobs editing 2500 user records

Scenario 6. Run simultaneously four jobs editing 10k item records

Scenario 7. Run simultaneously four jobs editing 10k holdings records

Data Export

  1. Export MARC BIB records (1 virtual user for 1000, 100K, 200k, and 500K records)

Multi-workflows

  1. Check In, Check Out with DB Read/Write split
  2. Check In, Check Out with Data Import (MARC BIB) and DB R/W split
  3. Check In, Check Out with Data Import (MARC BIB) and Traffics Diversion
  4. Check In/Out with Data Import (MARC BIB) and Bulk Edits
  5. Data Export Worker Worfklows:  All of the 5 flows together 

OAI-PMH

  1. OAI-PMH with metadataPrefix=MARC21
  2. OAI-PMH with metadataPrefix=marc21_withholdings

RTAC

Inventory

  1. Exporting inventory search
  2. Instance search filter
  3. Item load
  4. Item search Filter
  5. Browse by contributors and subjects

Acquisition:

  1. Orders Searching
    1. Search order lines by status
    2. Search orders by IDs
    3. Search orders by Keyword
    4. Search orders by status
  2. EBSCONet (New)
  3. Fiscal Year Rollover (New)
  4. Search Users

API Testing

PTF doesn't individually test APIs, but the following APIs were tested as part of in depth analysis

  1. mod-feesfines: getAccount
  2. mod-pubusb (via CICO)
  3. Search requests by OPEN status
  4. GET /item-storage/items
  5. POST /inventory-hierarchy/items-and-holdings
  6. GET circulation/loan
  7. GET /circulation/loans?(userId=={userId} and status.name <> Closed)
  8. GET /loan-storage/loans