FameFlower Test FameFlower Test Results

• Overview
• Test Runs
• Results
  • 1. High level FameFlower results data
  • 2.  CPU Utilization comparisons
  • 3.  Memory trends
  • 4.  Database CPU trends  
  • 5.  Slow queries
  • 6. Missing indexes
• Summary
  • Issues

Overview

Using the Carrier-io framework for capturing and analyzing performance test results, the following tests for the export instance UUIDs workflows were executed.

The testing was provided with the modules:

Backend:
- mod-inventory-storage-19.1.2
- mod-inventory-14.1.3
- mod-authtoken-2.4.0
- mod-permissions-5.9.0
- okapi-2.38.0
Frontend:
- folio_inventory-2.0.2

Test Runs

• 30-min Runs for export instance UUIDs workflow:

  Test	Virtual Users	Duration	OKAPI log level	Profiled	Ramp up (total time in seconds)	Size of records
  1. FameFlower	1	30 min	INFO	No	5	10K~50K instances
  2. FameFlower	1	30 min	INFO	No	1	50K~100K instances
  3. FameFlower	1	30 min	INFO	Yes	10	10K~50K instances
  4. FameFlower	1	30 min	INFO	Yes	10	50K~100K instances
  5. FameFlower	5	30 min	INFO	No	50	10K~50K instances
  6. FameFlower	5	30 min	INFO	No	10	50K~100K instances
  7. FameFlower	5	30 min	INFO	Yes	50	10K~50K instances
  8. FameFlower	5	30 min	INFO	Yes	50	50K~100K instances

  
  

  Results

  *All numbers are in milliseconds except for those in the Delta % column, which indicates the difference in percentage going from 1 to 5 users, 10K~50K instances

  1. High level FameFlower results data

  1 and 5 users tests runs, 10K~50K instances

  
  

• 

...

Folio build was deployed with 50+ ECS services installed  installed randomly across 4 m5.large instances in the fcp1-pvt cluster and the database was created on the db.r5.xlarge AWS RDS instance. Logging level was set to default INFO.

...

Based on the CPU usage per service we can make a conclusion that the most consuming service was service was mod-inventory-storage.

The test run with 5 users and 10K~50K instances

Image Added

The service is 99% of allocated RAM memory.

Image Added

Image Added

Image Added

During testing the workflow with 5 users and 50K~100K instances, mod-inventory-storage

...

Image Removed

The service is 99% of allocated RAM memory.

Image Removed

Image Removed

...

was crashing a few times due to OOM. There are 4 instances of mod-inventory-storage active in this test run. This means that it crashed 3 times and spun up new mod-inventory-storage instances

Image Added

4. Database CPU trends  

...

Summary

        See Attached FameFlower Performance Test Runs.xlsx for details 

• FOLIO performs better without being profiled when the tests are running 

...