Overview

In Quesnelia the profile page allows users to upload a profile picture and to view the page with the picture. The purpose of the ticket is to compare performance of Patron Profile Page with loading picture and without loading picture in scope of PERF-790 - Getting issue details... STATUS ticket on PCP1 environment.
Also in scope is checking how the volume of pictures as well as the images' storage choice, DB or S3 bucket affect loading time,

Summary

Four tests were carried out to compare results with different ways to store pictures in User's profile. It was possible to enable/disable functionality, change source storage and maximum possible value of file size on the fly with API config requests.
- Profile Picture functionality does not affect Patron Page loading response times and it works even faster (60-140 ms, depends on the flow).
After populating DB and S3 bucket with pictures (3 times more data) two tests were carried out to see how it affect Patron Page loading time.
- Volume of pictures in DB or S3 bucket does not affect response times during Patron Page loading.

Recommendations & Jiras

It was difficult to update mod-user correctly during deploying. Please take a look into the process. It may skip profile_picture table creation or create with not correct number of columns for some reason. The functionality has dependency from mod-permission so the module version should correspond to latest with all needed UI permissions for admin user.

Test Runs

These baseline test results on mod-users 19.2.2 version without Profile Picture functionality before deploying the version which support profile picture functionality

Requests	Executions	Response Times (ms), Average
Label	#Samples	Disabled Profile Picture
TC: Search User*	10	44.5
TC: View User**	10	1138.1

* - TC: Search User - GET request which search user by UUID

** - TC: View User - patron page loading for UUID from a previous GET request

This table shows tests of patron page loading with different configuration of source storage

Tests	Profile Picture Functionality	Source storage	Threads	Loops	File size
#1	Disabled		5	100
#2	Enabled	DB	5	100	No pictures
#3	Enabled	DB	5	100	3,7 Mb
#4	Enabled	S3 bucket	5	100	3,7 Mb

Tests after populating of DB and S3 bucket with pictures. The volume increased 3 times.

Tests	Profile Picture Functionality	Source storage	Threads	Loops	File size
#5	Enabled	DB	5	100	3,7 Mb
#6	Enabled	S3 bucket	5	100	3,7 Mb

Results

Compare results

Requests	Executions	Response Times (ms), Average
Label	#Samples	Baseline, mod-users 19.2.2 No Profile Picture functionality	Test #1 Disabled Profile Picture	Test #2 Enabled Profile Picture, DB	Test #3 Enabled Profile Picture, DB	Test #4 Enabled Profile Picture, S3 bucket	Test #5 Enabled Profile Picture, DB	Test #6 Enabled Profile Picture, S3 bucket
TC: Search User	500	44.5	35.87	33.4	40.51	43.94	55.71	49.61
TC: View User	500	1138.1	677.6	619.49	609.09	573.09	586.37	575.99
TC: Edit User	500		566.93	538.63	530.56	492.58	514.42	502.18
TC: Save User	500		27.39	26.06	26.59	20.24	21.22	22.57
TC: View User After Save	500		824.54	758.31	734.89	686.45	709.75	686.77
TC: Total time in flow	500		2132.32	1975.88	1941.63	1816.29	1887.47	1837.12

Service CPU Utilization

Tests #1, #2, #3

mod-users-b - 89%, mod-configuration-b - 38%

Test #4, #5, #6

During volume testing in tests #5 and #6 mod-users with S3 bucket utilized CPU 10% more than DB (S3 - 93%, DB - 83%).

Service Memory Consumption

mod-users - 68%, mod-inventory - 40%. No some weird behaviour from memory side

RDS CPU Utilization

CPU during volume tests grew from 17% to 30%. The results for RDS CPU utilization are not clear because of every 20 minutes spikes.

RDS Database Connections

Connections were close to 400 during all tests.

Appendix

Errors

For all tests common errors (404/Not Found) were in GET /perms/users/{id} and GET /perms/users/{id}/permissions requests. These errors appear if [tenant]_mod_permissions.permissions_users table has no record with this user UUID in jsonb→>'userId'.

Methodology/Approach

To get config Id and change storage source use API
- GET /users/configurations/entry
- PUT /users/configurations/entry/{configId}
To upload picture to DB use API
- POST /users/profile-picture
To get or to check uploaded profile picture use API where profileId the record in DB [tenant]_mod_users.profile_picture
- GET /users/profile-picture/{profileId}

To connect AWS S3 bucket storage add to task definition of mod-users module and restart it with changes in revision
- { "name": "AWS_URL", "value": "https://s3.amazonaws.com" }
- ```
{ "name": "AWS_BUCKET", "value": "cluster-id-or-any-useful-naming-here" }
```

Infrastructure

Environment: PCP1
Release: Poppy (2023 R2)

9 m6i.2xlarge EC2 instances located in US East (N. Virginia)
2 instances of db.r6.xlarge database instances, one reader, and one writer
MSK tenant
- 4 brokers
- Apache Kafka version 2.8.0
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- og.retention.minutes=480
- default.replication.factor=3

Schemas and tables involved in testing:

[tenant]_mod_users.users - 90068 records
[tenant]_mod_users.profile_picture - 1800 records
[tenant]_mod_permissions.permissions_users - 375 records

Modules

All modules

Module	Task Def. Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft limit	CPU units	Xmx	MetaspaceSize	MaxMetaspaceSize	R/W split enabled
pcp1-pvt
Mon Mar 11 10:33:45 UTC 2024
mod-remote-storage	11	mod-remote-storage:3.0.0	2	4920	4472	1024	3960	512	512	FALSE
mod-ncip	10	mod-ncip:1.14.4	2	1024	896	128	768	88	128	FALSE
mod-finance-storage	10	mod-finance-storage:8.5.0	2	1024	896	1024	700	88	128	FALSE
mod-agreements	10	mod-agreements:6.0.2	2	1592	1488	128	0	0	0	FALSE
mod-ebsconet	10	mod-ebsconet:2.1.1	2	1248	1024	128	700	128	256	FALSE
edge-sip2	8	edge-sip2:3.1.1	2	1024	896	128	768	88	128	FALSE
mod-organizations	10	mod-organizations:1.8.0	2	1024	896	128	700	88	128	FALSE
mod-settings	11	mod-settings:1.0.2	2	1024	896	200	768	88	128	FALSE
edge-dematic	10	edge-dematic:2.1.0	1	1024	896	128	768	88	128	FALSE
mod-data-import	20	mod-data-import:3.0.7	1	2048	1844	256	1292	384	512	FALSE
mod-search	20	mod-search:3.0.5	2	2592	2480	2048	1440	512	1024	FALSE
mod-tags	10	mod-tags:2.1.0	2	1024	896	128	768	88	128	FALSE
mod-authtoken	16	mod-authtoken:2.14.1	2	1440	1152	512	922	88	128	FALSE
edge-courses	2	edge-courses:1.3.0	2	1024	896	128	768	88	128	FALSE
mod-notify	10	mod-notify:3.1.0	2	1024	896	128	768	88	128	FALSE
mod-inventory-update	10	mod-inventory-update:3.2.1	2	1024	896	128	768	88	128	FALSE
mod-configuration	10	mod-configuration:5.9.2	2	1024	896	128	768	88	128	FALSE
mod-orders-storage	10	mod-orders-storage:13.6.0	2	1024	896	512	700	88	128	FALSE
edge-caiasoft	10	edge-caiasoft:2.1.0	2	1024	896	128	768	88	128	FALSE
mod-login-saml	18	mod-login-saml:2.7.1	2	1024	896	128	768	88	128	FALSE
mod-erm-usage-harvester	11	mod-erm-usage-harvester:4.4.1	2	1024	896	128	768	88	128	FALSE
mod-password-validator	10	mod-password-validator:3.1.0	2	1440	1298	128	768	384	512	FALSE
mod-licenses	10	mod-licenses:5.0.2	2	2480	2312	128	1792	384	512	FALSE
mod-gobi	10	mod-gobi:2.7.1	2	1024	896	128	700	88	128	FALSE
mod-fqm-manager	7	mod-fqm-manager:1.0.3	2	1024	896	128	768	88	128	FALSE
mod-bulk-operations	9	mod-bulk-operations:1.1.7	2	3072	2600	1024	1536	384	512	FALSE
mod-graphql	16	mod-graphql:1.12.0	2	1024	896	128	768	88	128	FALSE
mod-finance	10	mod-finance:4.8.0	2	1024	896	128	700	88	128	FALSE
mod-erm-usage	13	mod-erm-usage:4.6.0	2	1024	896	128	768	88	128	FALSE
mod-copycat	10	mod-copycat:1.5.0	2	1024	896	128	768	88	128	FALSE
mod-lists	6	mod-lists:1.0.5	2	3000	2600	128	2048	384	512	FALSE
mod-entities-links	15	mod-entities-links:2.0.4	2	2592	2480	400	1440	0	1024	FALSE
mod-permissions	47	mod-permissions:6.5.0-SNAPSHOT.369	2	1684	1544	512	1024	384	512	FALSE
pub-edge	9	pub-edge:2023.06.14	2	1024	896	128	768	0	0	FALSE
mod-orders	10	mod-orders:12.7.1	2	2048	1440	1024	1024	384	512	FALSE
edge-patron	10	edge-patron:5.0.0	2	1024	896	256	768	88	128	FALSE
edge-ncip	11	edge-ncip:1.9.2	2	1024	896	128	768	88	128	FALSE
mod-users-bl	10	mod-users-bl:7.6.0	2	1440	1152	512	922	88	128	FALSE
mod-inventory-storage	15	mod-inventory-storage:27.0.4	2	4096	3690	2048	3076	384	512	FALSE
mod-invoice	10	mod-invoice:5.7.2	2	1440	1152	512	922	88	128	FALSE
mod-user-import	10	mod-user-import:3.8.0	2	1024	896	128	768	88	128	FALSE
mod-sender	10	mod-sender:1.11.0	2	1024	896	128	768	88	128	FALSE
edge-oai-pmh	8	edge-oai-pmh:2.7.1	2	1512	1360	1024	1440	384	512	FALSE
mod-data-export-worker	10	mod-data-export-worker:3.1.2	2	3072	2800	1024	2048	384	512	FALSE
mod-rtac	10	mod-rtac:3.5.0	2	1024	896	128	768	88	128	FALSE
mod-circulation-storage	14	mod-circulation-storage:17.1.7	2	2880	2592	1536	1814	384	512	FALSE
mod-calendar	10	mod-calendar:2.5.0	2	1024	896	128	768	88	128	FALSE
mod-source-record-storage	18	mod-source-record-storage:5.7.5	2	5600	5000	2048	3500	384	512	FALSE
mod-event-config	10	mod-event-config:2.6.0	2	1024	896	128	768	88	128	FALSE
mod-courses	10	mod-courses:1.4.8	2	1024	896	128	768	88	128	FALSE
mod-inventory	14	mod-inventory:20.1.7	2	2880	2592	1024	1814	384	512	FALSE
mod-email	10	mod-email:1.16.0	2	1024	896	128	768	88	128	FALSE
mod-di-converter-storage	18	mod-di-converter-storage:2.1.5	2	1024	896	128	768	88	128	FALSE
mod-circulation	14	mod-circulation:24.0.11	2	2880	2592	1536	1814	384	512	FALSE
mod-pubsub	13	mod-pubsub:2.11.3	2	1536	1440	1024	922	384	512	FALSE
edge-orders	10	edge-orders:2.9.1	2	1024	896	128	768	88	128	FALSE
edge-rtac	7	edge-rtac:2.6.2	2	1024	896	128	768	88	128	FALSE
mod-template-engine	10	mod-template-engine:1.19.1	2	1024	896	128	768	88	128	FALSE
mod-users	30	mod-users:19.3.0-SNAPSHOT.676	2	1024	896	128	768	88	128	FALSE
mod-patron-blocks	10	mod-patron-blocks:1.9.0	2	1024	896	1024	768	88	128	FALSE
edge-fqm	21	edge-fqm:1.0.1	2	1024	896	128	768	88	128	FALSE
mod-audit	10	mod-audit:2.8.0	2	1024	896	128	768	88	128	FALSE
mod-source-record-manager	17	mod-source-record-manager:3.7.8	2	5600	5000	2048	3500	384	512	FALSE
nginx-edge	9	nginx-edge:2023.06.14	2	1024	896	128	0	0	0	FALSE
mod-quick-marc	11	mod-quick-marc:5.0.1	1	2288	2176	128	1664	384	512	FALSE
nginx-okapi	9	nginx-okapi:2023.06.14	2	1024	896	128	0	0	0	FALSE
okapi-b	11	okapi:5.1.2	3	1684	1440	1024	922	384	512	FALSE
mod-feesfines	11	mod-feesfines:19.0.0	2	1024	896	128	768	88	128	FALSE
mod-invoice-storage	10	mod-invoice-storage:5.7.0	2	1872	1536	1024	1024	384	512	FALSE
mod-service-interaction	10	mod-service-interaction:3.0.2	2	2048	1844	256	1290	384	512	FALSE
mod-data-export	12	mod-data-export:4.8.7	1	1024	896	1024	768	88	128	FALSE
mod-patron	10	mod-patron:6.0.0	2	1024	896	128	768	88	128	FALSE
mod-oai-pmh	5	mod-oai-pmh:3.12.8	2	4096	3690	2048	3076	384	512	FALSE
edge-connexion	10	edge-connexion:1.1.0	2	1024	896	128	768	88	128	FALSE
mod-kb-ebsco-java	10	mod-kb-ebsco-java:4.0.0	2	1024	896	128	768	88	128	FALSE
mod-notes	10	mod-notes:5.1.0	2	1024	896	128	952	384	512	FALSE
mod-organizations-storage	10	mod-organizations-storage:4.6.0	2	1024	896	128	700	88	128	FALSE
mod-data-export-spring	12	mod-data-export-spring:3.0.2	1	2048	1844	256	1536	384	512	FALSE
mod-login	10	mod-login:7.10.1	2	1440	1298	1024	768	384	512	FALSE
pub-okapi	9	pub-okapi:2023.06.14	2	1024	896	128	768	0	0	FALSE
mod-eusage-reports	13	mod-eusage-reports:2.0.0	2	1024	896	128	768	88	128	FALSE

Downloading Patron Profile Picture