Test status: COMPLETED WITH ERRORS

Overview IN PROGRESS

Regression testing of Fiscal Year Rollover (FYR) on Eureka based environment in quesnelia release.
- The testing triggered from UI for the ledger with generated amount of defined data set (Data quantity**: 50000 orders with Open status and 50000 orders with Pending status).
Testing include two different phases of the fiscal year transition process:
- #1 phase: Test Fiscal Year Rollover - is a risk free simulation pre-step to #2 phase which includes only Finance part of the data (to preview how the rollover settings will affect funds, budgets, and encumbrances).
- #2 phase: Fiscal Year Rollover - perform a permanent changes. It is the actual process which move financial data, budgets, and encumbrances into the new fiscal year. It includes not only Finance but Orders parts of the data too.
The purpose of testing is to define duration time of those 2 phases, to do comparison between current and previous results of each phase, to find any trends for resource utilization. To recommend improvements how to make it work better if any confirmed.
- Previous successful testing for #2 phase took 29 hours
Jiras/ links:
- The previous results reports:
  - [Poppy] Fiscal year rollover testing
  - [Orchid] Fiscal year rollover testing
- The current ticket: PERF-1016 - Getting issue details... STATUS

Summary

Running FYR on eureka completed with errors. Tests failed multiple times on overall order rollover with 504 Gateway Time-out issue.
The problem confirmed on okapi based environment. In scope of investigation of the problem the Time-out was solved changing parameter max_locks_per_transaction in DB configuration from 64 to 1024.
Eureka based environment (after changes were applied):
- #1 Phase Test FYR took 3 hours 35 minutes, completed successfully.
- #2 Phase actual FYR took 8 hours and completed with errors* (Order rollover Error).
Okapi based environment (after changes were applied, testing is carried out in scope of investigation to check functionality of FYR):
- #1 Phase Test FYR took 3 hours 20 minutes. Completed successfully.
- #2 Phase actual FYR took 9 hours 7 minutes. Completed successfully.
Service CPU utilization for both phases was under 5% on eureka environment except a spike at the beginning of test rollover (mod-finance-storage - 16%, mod-invoice - 10%). Module mod-inventory - 11% during whole test.
DB CPU usage was on level of 9% during #1 Phase and there was growing trend from 9% to 15% during the rollover itself on Eureka environment with 4xlarge database. On xlarge database - 39% without growth.
No memory leaks were found.

Recommendations & Jiras

Set max_locks_per_transaction parameter in DB cluster and instance configurations from default 64 to 1024 to avoid Time-out issue during actual rollover (#2 Phase).
Investigation of issues on Eureka based environment MODFISTO-495 - Getting issue details... STATUS - Time out issue.

Errors

127.0.0.1:43264 POST /finance/ledger-rollovers null HTTP_1_1 500 265 400027 tid=[tenant] Internal Server Error. This error happens when we try FYR with more than 10k open orders. The last attempt to run FYR with 50k open orders after changed recommended parameter max_locks_per_transaction failed. A new observation here is that budgets became unavailable with open orders >= 42000 after max_locks_per_transaction parameter was changed from 64 to 1024. Probably it may cause fail of FYR.
* Error message: io.vertx.core.impl.NoStackTraceThrowable: Response status code 401 is not between 200 and 299,qelc2/mod-finance-storage/9044d47f773b48a99cc6c8420864b724 which indicate possible RTR issue.
WARN [org.fol.sid.ser.rou.RequestMatchingService] (vert.x-eventloop-thread-4) Egress routing entry was not found for the request's path. Forwarding request to the Gateway:moduleId = sc-mod-finance-storage, path = /orders/rollover, destination = https://kong-qelc2.int.aws.folio.org, x-okapi-module-id = null",qelc2/sidecar-mod-finance-storage/9044d47f773b48a99cc6c8420864b724,054267740449:qelc2-folio-eis
ERROR edgerRolloverService handleOrderRolloverError:: Orders rollover failed for ledger f38a29f5-feaa-4363-98a1-1eba79557c9c

Test Runs and Results

Data size: 100K orders (50K orders in open status, 50K - pending), 200K order lines, 400K transactions.

Test #

Scenario

Load level

Fiscal year rollover duration Orchid*

Fiscal year rollover duration

Poppy*

FYR duration

Quesnelia (Eureka)

FYR duration

Quesnelia (non-Eureka)

Comments

1

Test Fiscal year rollover

1 rollover at a time

-

3.5 hours

3 hours 20 minutes

Test rollover finished successfully.

2

Fiscal year rollover

1 rollover at a time

6 days (failed with 504 error)

29 hours

8 hours, failed due to 500(server error)

9 hours 7 minutes

On eureka Rollover competed with error.

On non-eureka Rollover completed successfully.

*Results are taken from the previous test report. Details can be found at the link: [Orchid] Fiscal year rollover testing

*Results are taken from the previous test report. Details can be found at the link: [Poppy] Fiscal year rollover testing

**Data structure can be found at the link: Fiscal year rollover testing

Service CPU Utilization

Note: Instance level CPU screenshots is not included in this report. Taking into account that Fiscal Year Rollover process is mostly happening on DB side - it's barely visible on service CPU, so it's invisible on instance CPU.

Test FYR (Eureka)

Low CPU usage during FYR reflects that it can handle large fiscal year transitions efficiently. As the process runs mostly on database level.

Maximum CPU utilization by modules:

mod-finance storage - 16% (spike at the beginning)

mod-inventory - 10%

mod-orders, mod-orders-storage - 1,5%, 3%

mod-finance - under 1%

FYR (Eureka)

Maximum CPU utilization by modules on eureka:

mod-inventory - 11%

mod-orders - 1.5%

mod-orders-storage - 3%

mod-finance - 0.15%

mod-finance storage - 1.2%

Memory Utilization

Test FYR (Eureka)

This graph shows memory usage during #1 phase of FYR. No signs of memory leaks trends.

Memory usage by modules:

mod-finance-storage - 85%

mod-finance - 41%

mod-orders - 57%

mod-orders-storage - 46%

FYR (Eureka)

This graph shows memory usage during #2 phase of FYR. No signs of memory leaks trends too. Consumption is on the same level as #1 phase.

Memory usage by modules:

mod-finance-storage - 85%

mod-finance - 42%

mod-orders - 58%

mod-orders-storage - 46%

DB CPU Utilization

Test FYR (Eureka)

DB CPU usage range: 9% - 20%. Utilization was stable during #1 phase except of spikes to 20%. It competed successfully so it didn't affect the test.

Test FYR (non-Eureka)

The #1 phase of FYR was carried out on xlarge DB instance. That's the reason why we see 34% of DB CPU utilization. The utilization was stable - 34%. This phase completed successfully.

FYR (Eureka)

Maximum DB CPU usage - 99%

FYR (non-Eureka)

Spikes are connected to fqm manager queries (as example - REFRESH MATERIALIZED VIEW CONCURRENTLY [tenant]_0001_mod_fqm_manager.drv_langu...). Do not affect duration of FYR.

The #2 phase completed successfully in non-eureka. It utilized 35% which is almost the same as in #1 phase.

DB Connections

DB connections stay on the same level during all phases of FYR. Connections in Eureka - 690 and non-Eureka 1380.. The difference can be explained by enabled mod-serials-management module on qcon environment.

Test FYR (Eureka)

Test FYR (non-Eureka)

FYR (Eureka)

FYR (non-Eureka)

On qcon module mod-serials spiking affect DB connections growth from 700 to 1400.

DB Load

Test FY rollover (non-Eureka)

On this graphs sql statement responsible for budget encumbrances rollover consume most of CPU.

FY rollover

Top SQL

Test FY rollover (non-Eureka)

FY rollover

Appendix

Infrastructure

PTF -environment qelc2

10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 database instance, writer.
Name Memory GIB vCPUs max_connections
db.r6g.4xlarge
128 GiB 16 vCPUs 4000
db.r6g.xlarge 32 GB 4vCPUs 2000
database cluster and instance parameters max_locks_per_transaction - 64, changed to 1024
MSK fse-tenant
- 4 kafka.m7g.xlarge brokers in 2 zones (2 brokers per zone)
- Apache Kafka version 3.7.x, metadata mode - KRaft
- EBS storage volume per broker 300 GiB
- auto.create.topics.enable=true
- log.retention.minutes=480
- default.replication.factor=2

PTF -environment qcon

10 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1
1 database instance, writer
Name Memory GIB vCPUs max_connections
db.r6g.xlarge
32 GiB 4 vCPUs 2000
database cluster and instance parameters max_locks_per_transaction - 64, changed to 1024

Module QELC2

Cluster Resources - qelc2-pvt (Wed Nov 06 11:34:51 UTC 2024)

Module	Task Definition Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft Limit	CPU Units	Xmx	Metaspace Size	Max Metaspace Size
mod-remote-storage	22	mod-remote-storage:3.2.0	0	4920	4472	1024	3960	512	512
mod-remote-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-finance-storage	24	mod-finance-storage:8.6.1	0	1024	896	1024	700	88	128
mod-finance-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-ncip	23	mod-ncip:1.14.5	0	1024	896	0	768	88	128
mod-ncip - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-agreements	22	mod-agreements:7.0.6	0	1592	1488	0	0	0	0
mod-agreements - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-ebsconet	21	mod-ebsconet:2.2.0	0	1248	1024	128	700	128	256
mod-ebsconet - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-sip2	6	edge-sip2:3.2.5	0	1024	896	0	768	88	128
mod-organizations	23	mod-organizations:1.9.2	0	1024	896	0	768	88	128
mod-organizations - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-settings	21	mod-settings:1.0.3	0	1024	896	200	768	88	128
mod-settings - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-serials-management	22	mod-serials-management:1.0.3	0	2480	2312	0	1792	384	512
mod-serials-management - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-search	21	mod-search:3.2.6	0	2592	2480	2048	1440	512	1024
mod-search - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-import	21	mod-data-import:3.1.1	0	2048	1844	256	1292	384	512
mod-data-import - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-dematic	9	edge-dematic:2.2.3	0	1024	896	0	768	88	128
mod-consortia-keycloak	20	mod-consortia-keycloak:1.4.2	0	5136	4776	1024	4416	384	512
mod-consortia-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-tags	21	mod-tags:2.2.0	0	1024	896	0	768	88	128
mod-tags - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-courses	9	edge-courses:1.4.2	0	1024	896	0	768	88	128
mod-inventory-update	22	mod-inventory-update:3.3.1	0	1024	896	0	768	88	128
mod-inventory-update - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-notify	21	mod-notify:3.2.0	0	1024	896	0	768	88	128
mod-notify - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-configuration	23	mod-configuration:5.10.0	0	1024	896	0	768	88	128
mod-configuration - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-orders-storage	36	mod-orders-storage:13.7.4	0	1024	896	512	700	88	128
mod-orders-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
folio-keycloak	16	folio-keycloak:25.0.1.150	0	1684	1536	0	2048	0	0
edge-caiasoft	9	edge-caiasoft:2.2.4	0	1024	896	0	768	88	128
mod-password-validator	21	mod-password-validator:3.2.1	0	1440	1298	0	768	384	512
mod-password-validator - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-gobi	23	mod-gobi:2.8.1	0	1024	896	0	768	88	128
mod-gobi - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-licenses	21	mod-licenses:6.0.3	0	2480	2312	512	1792	384	512
mod-licenses - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-bulk-operations	17	mod-bulk-operations:2.0.2	0	3072	2600	0	1536	384	512
mod-bulk-operations - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-fqm-manager	24	mod-fqm-manager:2.0.5	0	1024	896	0	768	88	128
mod-fqm-manager - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-graphql	21	mod-graphql:1.12.1	0	1024	896	0	768	88	128
mod-graphql - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-finance	26	mod-finance:4.9.0	0	1024	896	0	768	88	128
mod-finance - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-roles-keycloak	29	mod-roles-keycloak:1.4.4	0	1024	896	0	512	88	256
mod-roles-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-batch-print	18	mod-batch-print:1.1.0	0	1024	896	0	768	88	128
mod-batch-print - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-copycat	21	mod-copycat:1.6.0	0	1024	896	0	768	88	128
mod-copycat - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-lists	23	mod-lists:2.0.6	0	1024	896	0	768	88	128
mod-lists - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-permissions	38	mod-permissions:6.5.0	0	1684	1544	512	1024	384	512
mod-permissions - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-entities-links	21	mod-entities-links:3.0.2	0	2592	2480	400	1440	0	1024
mod-entities-links - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
pub-edge	2	pub-edge:2023.06.14	0	1024	896	0	768	0	0
mod-orders	26	mod-orders:12.8.8	0	2048	1740	1024	1024	384	512
mod-orders - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
kong	14	kong:3.7.1.83	0	6144	6144	2048	768	88	128
edge-patron	9	edge-patron:5.1.2	0	1024	896	256	768	88	128
mod-users-keycloak	32	mod-users-keycloak:1.5.3	0	1024	896	0	512	88	256
mod-users-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-ncip	9	edge-ncip:1.10.1	0	1024	896	0	768	88	128
mgr-applications	10	mgr-applications:1.3.3	0	1024	896	512	512	88	256
mod-users-bl	18	mod-users-bl:7.8.0	0	1440	1152	512	922	88	128
mod-users-bl - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mgr-tenants	10	mgr-tenants:1.3.3	0	1024	896	512	512	88	256
mod-invoice	29	mod-invoice:5.8.2	0	1440	1152	512	922	88	128
mod-invoice - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory-storage	24	mod-inventory-storage:27.1.4	0	4096	3690	2048	3076	384	512
mod-inventory-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-user-import	21	mod-user-import:3.8.0	0	1024	896	0	768	88	128
mod-user-import - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-sender	22	mod-sender:1.12.0	0	1024	896	0	768	88	128
mod-sender - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-oai-pmh	9	edge-oai-pmh:2.9.2	0	1512	1360	1024	1440	384	512
mgr-tenant-entitlements	10	mgr-tenant-entitlements:1.2.4	0	1024	896	512	512	88	256
mod-login-keycloak	31	mod-login-keycloak:1.4.3	0	1024	896	0	512	88	256
mod-login-keycloak - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-export-worker	21	mod-data-export-worker:3.2.4	0	3072	2800	1024	2048	384	512
mod-data-export-worker - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-rtac	21	mod-rtac:3.6.0	0	1024	896	0	768	88	128
mod-rtac - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-circulation-storage	31	mod-circulation-storage:17.2.3	0	2880	2592	1536	1814	384	512
mod-circulation-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-scheduler	22	mod-scheduler:1.2.3	0	1024	896	0	512	88	256
mod-scheduler - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-calendar	21	mod-calendar:3.1.0	0	1024	896	0	768	88	128
mod-calendar - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-source-record-storage	26	mod-source-record-storage:5.8.6	0	5600	5000	2048	3500	384	512
mod-source-record-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-event-config	21	mod-event-config:2.7.1	0	1024	896	0	768	88	128
mod-event-config - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-courses	20	mod-courses:1.4.10	0	1024	896	0	768	88	128
mod-courses - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-inventory	24	mod-inventory:20.2.7	0	2880	2592	1024	1814	384	512
mod-inventory - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-email	21	mod-email:1.17.0	0	2800	2550	512	1800	384	512
mod-email - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-di-converter-storage	23	mod-di-converter-storage:2.2.2	0	1024	896	0	768	88	128
mod-di-converter-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-circulation	28	mod-circulation:24.2.5	0	2880	2592	1536	1814	384	512
mod-circulation - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-pubsub	23	mod-pubsub:2.14.0	0	1536	1440	1024	922	384	512
mod-pubsub - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-orders	11	edge-orders:3.0.3	0	1024	896	0	768	88	128
edge-rtac	9	edge-rtac:2.7.3	0	1024	896	0	768	88	128
mod-users	23	mod-users:19.3.1	0	1024	896	0	768	88	128
mod-users - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-template-engine	21	mod-template-engine:1.20.0	0	1024	896	0	768	88	128
mod-template-engine - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-patron-blocks	18	mod-patron-blocks:1.10.0	0	1024	896	1024	768	88	128
mod-patron-blocks - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-audit	22	mod-audit:2.9.0	0	1024	896	0	768	88	128
mod-audit - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-fqm	9	edge-fqm:2.0.2	0	1024	896	0	768	88	128
mod-source-record-manager	22	mod-source-record-manager:3.8.6	0	5600	5000	2048	3500	384	512
mod-source-record-manager - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
nginx-edge	2	nginx-edge:2023.06.14	0	1024	896	0	0	0	0
mod-quick-marc	21	mod-quick-marc:5.1.1	0	2288	2176	0	1664	384	512
mod-quick-marc - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-feesfines	21	mod-feesfines:19.1.0	0	1024	896	0	768	88	128
mod-feesfines - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-invoice-storage	25	mod-invoice-storage:5.8.1	0	1872	1536	1024	1024	384	512
mod-invoice-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-service-interaction	22	mod-service-interaction:4.0.2	0	2048	1844	256	1290	384	512
mod-service-interaction - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-export	20	mod-data-export:5.0.4	0	2592	2480	1024	1440	88	1024
mod-data-export - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-patron	25	mod-patron:6.1.0	0	1024	896	0	768	88	128
mod-patron - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-oai-pmh	22	mod-oai-pmh:3.13.2	0	4096	3690	2048	3076	384	512
mod-oai-pmh - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-connexion	6	edge-connexion:1.3.1	0	1024	896	0	768	88	128
mod-kb-ebsco-java	21	mod-kb-ebsco-java:4.0.0	0	1024	896	0	768	88	128
mod-kb-ebsco-java - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-notes	22	mod-notes:5.2.0	0	1024	896	0	952	384	512
mod-notes - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-data-export-spring	20	mod-data-export-spring:3.3.0	0	2048	1844	256	1536	384	512
mod-data-export-spring - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
mod-organizations-storage	23	mod-organizations-storage:4.7.0	0	1024	896	0	768	88	128
mod-organizations-storage - Sidecar 1	N/A	folio-module-sidecar:1.0.0.312	N/A	665	512	0	128	0	0
edge-erm	6	edge-erm:1.2.1	0	1024	896	0	768	88	128

Module QCON

Cluster Resources - qcon-pvt (Wed Nov 06 11:28:29 UTC 2024)

Module	Task Definition Revision	Module Version	Task Count	Mem Hard Limit	Mem Soft Limit	CPU Units	Xmx	Metaspace Size	Max Metaspace Size
mod-remote-storage	1	mod-remote-storage:3.2.0	2	4920	4472	1024	3960	512	512
mod-finance-storage	1	mod-finance-storage:8.6.0	2	1024	896	1024	700	88	128
mod-ncip	1	mod-ncip:1.14.4	2	1024	896	128	768	88	128
mod-agreements	1	mod-agreements:7.0.0	2	1592	1488	128	0	0	0
mod-ebsconet	1	mod-ebsconet:2.2.0	2	1248	1024	128	700	128	256
mod-consortia	1	mod-consortia:1.1.0	2	3072	2048	128	2048	512	1024
mod-organizations	1	mod-organizations:1.9.0	2	1024	896	128	700	88	128
mod-serials-management	1	mod-serials-management:1.0.0	2	2480	2312	128	1792	384	512
mod-settings	2	mod-settings:1.0.3	2	1024	896	200	768	88	128
mod-search	9	mod-search:3.3.0-SNAPSHOT.224	2	2592	2480	2048	1440	512	1024
edge-dematic	1	edge-dematic:2.2.0	1	1024	896	128	768	88	128
mod-data-import	1	mod-data-import:3.1.0	1	2048	1844	256	1292	384	512
mod-tags	1	mod-tags:2.2.0	2	1024	896	128	768	88	128
mod-authtoken	6	mod-authtoken:2.15.1	2	1440	1152	512	922	88	128
edge-courses	1	edge-courses:1.4.0	2	1024	896	128	768	88	128
mod-inventory-update	1	mod-inventory-update:3.3.0	2	1024	896	128	768	88	128
mod-notify	1	mod-notify:3.2.0	2	1024	896	128	768	88	128
mod-configuration	1	mod-configuration:5.10.0	2	1024	896	128	768	88	128
mod-orders-storage	3	mod-orders-storage:13.7.4	2	1024	896	512	700	88	128
edge-caiasoft	1	edge-caiasoft:2.2.0	2	1024	896	128	768	88	128
mod-login-saml	1	mod-login-saml:2.8.0	2	1024	896	128	768	88	128
mod-erm-usage-harvester	1	mod-erm-usage-harvester:4.5.0	2	1024	896	128	768	88	128
mod-password-validator	1	mod-password-validator:3.2.0	2	1440	1298	128	768	384	512
mod-licenses	1	mod-licenses:6.0.0	2	2480	2312	128	1792	384	512
mod-gobi	1	mod-gobi:2.8.0	2	1024	896	128	700	88	128
mod-bulk-operations	1	mod-bulk-operations:2.0.0	2	3072	2600	1024	1536	384	512
mod-fqm-manager	1	mod-fqm-manager:2.0.1	2	3000	2600	128	2048	384	512
edge-dcb	1	edge-dcb:1.1.0	2	1024	896	128	768	88	128
mod-graphql	1	mod-graphql:1.12.1	2	1024	896	128	768	88	128
mod-finance	1	mod-finance:4.9.0	2	1024	896	128	700	88	128
mod-erm-usage	1	mod-erm-usage:4.7.0	2	1024	896	128	768	88	128
mod-batch-print	1	mod-batch-print:1.1.0	2	1024	896	128	768	88	128
mod-copycat	1	mod-copycat:1.6.0	2	1024	512	128	768	88	128
mod-lists	1	mod-lists:2.0.0	2	3000	2600	128	2048	384	512
mod-entities-links	1	mod-entities-links:3.0.0	2	2592	2480	400	1440	0	1024
mod-permissions	4	mod-permissions:6.6.0-SNAPSHOT.379	2	1684	1544	512	1024	384	512
pub-edge	1	pub-edge:2023.06.14	2	1024	896	128	768	0	0
mod-orders	3	mod-orders:12.8.8	2	2048	1740	1024	1024	384	512
edge-patron	1	edge-patron:5.1.0	2	1024	896	256	768	88	128
edge-ncip	1	edge-ncip:1.9.2	2	1024	896	128	768	88	128
mod-users-bl	1	mod-users-bl:7.7.0	2	1440	1152	512	922	88	128
mod-invoice	5	mod-invoice:5.8.2	2	2880	2304	2	2048	88	128
mod-inventory-storage	2	mod-inventory-storage:27.2.0-SNAPSHOT.738	2	4096	3690	2048	3076	384	512
mod-user-import	1	mod-user-import:3.8.0	2	1024	896	128	768	88	128
mod-sender	1	mod-sender:1.12.0	2	1024	896	128	768	88	128
edge-oai-pmh	1	edge-oai-pmh:2.9.0	2	1512	1360	1024	1440	384	512
mod-data-export-worker	1	mod-data-export-worker:3.2.1	2	3072	2048	1024	2048	384	512
mod-rtac	1	mod-rtac:3.6.0	2	1024	896	128	768	88	128
mod-circulation-storage	1	mod-circulation-storage:17.2.0	2	2880	2592	1536	1814	384	512
mod-source-record-storage	1	mod-source-record-storage:5.8.0	2	5600	5000	2048	3500	384	512
mod-calendar	1	mod-calendar:3.1.0	2	1024	896	128	768	88	128
mod-event-config	1	mod-event-config:2.7.0	2	1024	896	128	768	88	128
mod-courses	1	mod-courses:1.4.10	2	1024	896	128	768	88	128
mod-circulation-item	1	mod-circulation-item:1.0.0	2	1024	896	128	0	0	0
mod-inventory	3	mod-inventory:20.2.0	2	2880	2592	1024	1814	384	512
mod-email	1	mod-email:1.17.0	2	1024	896	128	768	88	128
mod-circulation	2	mod-circulation:24.2.1	2	2880	2592	1536	1814	384	512
mod-pubsub	1	mod-pubsub:2.13.0	2	1536	1440	1024	922	384	512
mod-di-converter-storage	2	mod-di-converter-storage:2.2.2	2	1024	896	128	768	88	128
edge-orders	1	edge-orders:3.0.0	2	1024	896	128	768	88	128
edge-rtac	1	edge-rtac:2.7.1	2	1024	896	128	768	88	128
mod-users	3	mod-users:19.3.1	2	2048	1792	128	1024	88	256
mod-template-engine	1	mod-template-engine:1.20.0	2	1024	896	128	768	88	128
mod-patron-blocks	1	mod-patron-blocks:1.10.0	2	1024	896	1024	768	88	128
mod-audit	1	mod-audit:2.9.0	2	1024	896	128	768	88	128
edge-fqm	1	edge-fqm:2.0.0	2	1024	896	128	768	88	128
mod-source-record-manager	4	mod-source-record-manager:3.8.0	2	5600	5000	2048	3500	384	512
nginx-edge	1	nginx-edge:2023.06.14	2	1024	896	128	0	0	0
mod-quick-marc	2	mod-quick-marc:5.1.0	1	2288	2176	128	1664	384	512
nginx-okapi	1	nginx-okapi:2023.06.14	2	1024	896	128	0	0	0
okapi-b	1	okapi:5.3.0	3	1684	1440	1024	922	384	512
mod-feesfines	1	mod-feesfines:19.1.0	2	1024	896	128	768	88	128
mod-invoice-storage	3	mod-invoice-storage:5.8.1	2	1872	1536	2	1024	384	512
mod-reading-room	7	mod-reading-room:1.0.0-SNAPSHOT.11	2	1024	896	128	768	88	128
mod-service-interaction	1	mod-service-interaction:4.0.1	2	2048	1844	256	1290	384	512
mod-dcb	1	mod-dcb:1.1.0	2	1024	896	128	768	88	128
mod-patron	1	mod-patron:6.1.0	2	1024	896	128	768	88	128
mod-data-export	1	mod-data-export:5.0.0	1	2048	1524	1024	0	0	0
mod-oai-pmh	1	mod-oai-pmh:3.13.0	2	4096	3690	2048	3076	384	512
edge-connexion	1	edge-connexion:1.2.0	2	1024	896	128	768	88	128
mod-notes	1	mod-notes:5.2.0	2	1024	896	128	952	384	512
mod-kb-ebsco-java	1	mod-kb-ebsco-java:4.0.0	2	1024	896	128	768	88	128
mod-login	2	mod-login:7.11.0	2	2048	1792	1024	1024	88	256
mod-organizations-storage	1	mod-organizations-storage:4.7.0	2	1024	896	128	700	88	128
mod-data-export-spring	1	mod-data-export-spring:3.2.0	1	2048	1844	256	1536	384	512
pub-okapi	1	pub-okapi:2023.06.14	2	1024	896	128	768	0	0
mod-eusage-reports	1	mod-eusage-reports:2.1.1	2	1024	896	128	768	88	128

Methodology/Approach

In order to run FYR:

truncate tables with query

Truncate

truncate table [tenant]_mod_organizations_storage.organizations cascade;
truncate table [tenant]_mod_orders_storage.purchase_order cascade;
truncate table [tenant]_mod_invoice_storage.invoices cascade;

Create organization (Vendor) to reuse its id as access provider in the next query which generates needed data set.

Replace FYR id, access provider, fund id, fund name in accordance with FYR ledger info. Also check all instance related fields which should be replaced with actual data. The script prepared to generate needed amount of organizations, orders, po lines, invoices.

Queries to generate data

Generate

CREATE OR REPLACE FUNCTION public.generate_0062_data_for_edifact_export(
scenario_prefix TEXT,
organizations_amount INTEGER,
orders_per_vendor INTEGER,
polines_per_order INTEGER,
pieces_per_order INTEGER
) RETURNS VOID AS
$$
DECLARE
orgName TEXT DEFAULT 'perf_test_vendor';
orgCodePrefix TEXT DEFAULT 'PERF_TEST_ORG';
vendor_id TEXT;
BEGIN
FOR org_counter IN 1..organizations_amount
LOOP
INSERT INTO [tenant]_mod_organizations_storage.organizations (id, jsonb)
VALUES (
public.uuid_generate_v4(),
jsonb_build_object(
'code', concat(orgCodePrefix, '_', scenario_prefix, '_', org_counter),
'erpCode', '12345',
'isVendor', true,
'name', concat(orgCodePrefix, '_', scenario_prefix, '_', org_counter),
'status', 'Active',
'metadata', jsonb_build_object(
'createdDate', '2023-02-08T00:00:00.000+0000',
'createdByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42',
'updatedDate', '2023-02-08T00:00:00.000+0000',
'updatedByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42'
)
)
)
RETURNING id INTO vendor_id;

PERFORM public.generate_0062_orders(orders_per_vendor, polines_per_order, pieces_per_order, vendor_id,1,2);
END LOOP;
END
$$ LANGUAGE plpgsql;

CREATE OR REPLACE FUNCTION public.generate_0062_orders(
orders_per_vendor INTEGER,
polines_per_order INTEGER,
pieces_per_order INTEGER,
vendor_id TEXT,
invoices_per_organization INTEGER,
invoicelines_per_invoice INTEGER
) RETURNS VOID AS
$$
DECLARE
order_id TEXT;
poline_id TEXT;
newPoNumber INTEGER;
BEGIN
FOR order_counter IN 1..orders_per_vendor
LOOP
SELECT nextval('[tenant]_mod_orders_storage.po_number') INTO newPoNumber;

INSERT INTO [tenant]_mod_orders_storage.purchase_order (id, jsonb)
VALUES (
public.uuid_generate_v4(),
jsonb_build_object(
'id', public.uuid_generate_v4(),
'notes', jsonb_build_array(),
'acqUnitIds', jsonb_build_array(),
'approved', true,
'reEncumber', true,
'nextPolNumber', 2,
'workflowStatus', 'Pending',
'poNumber', newPoNumber,
'vendor', vendor_id,
'orderType', 'One-Time',
'metadata', jsonb_build_object(
'createdDate', '2024-10-06T00:00:00.000+0000',
'createdByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42',
'updatedDate', '2024-10-06T00:00:00.000+0000',
'updatedByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42'
)
)
)
RETURNING id INTO order_id;

PERFORM public.generate_0062_polines(order_id, polines_per_order, pieces_per_order, newPoNumber, vendor_id);
PERFORM public.generate_0062_invoices(invoices_per_organization, invoicelines_per_invoice, vendor_id, poline_id);
END LOOP;
END
$$ LANGUAGE plpgsql;

CREATE OR REPLACE FUNCTION public.generate_0062_polines(
order_id TEXT,
polines_per_order INTEGER,
pieces_per_order INTEGER,
ponumber INTEGER,
vendor_id TEXT
) RETURNS VOID AS
$$
DECLARE
polineNumber TEXT;
holding_id UUID;
currPoNumber INTEGER;
iteration_counter INT := 1;

BEGIN
SELECT id INTO holding_id
FROM [tenant]_mod_inventory_storage.holdings_record 
WHERE permanentlocationid = '9ffb23a9-0e83-4d8e-a70d-ddf44ab67c84' 
AND instanceid = 'b94d2138-bdfc-5dea-bab9-ac99e21b7970'
LIMIT 1;

FOR line_counter IN 1..polines_per_order
LOOP
SELECT currval('[tenant]_mod_orders_storage.po_number') INTO currPoNumber;

INSERT INTO [tenant]_mod_orders_storage.po_line (id, jsonb)
VALUES (
public.uuid_generate_v4(),
jsonb_build_object(
'id', public.uuid_generate_v4(),
'cost', jsonb_build_object(
'currency', 'USD',
'discountType', 'percentage',
'quantityElectronic', 2,
'poLineEstimatedPrice', 4,
'listUnitPriceElectronic', 2
),
'rush', false,
'alerts', jsonb_build_array(),
'claims', jsonb_build_array(),
'source', 'User',
'details', jsonb_build_object(
'productIds', jsonb_build_array(
jsonb_build_object(
'productId', '73121721',
'productIdType', 'c858e4f2-2b6b-4385-842b-60732ee14abb'
)
),
'isAcknowledged', false
),
'edition', '',
'metadata', jsonb_build_object(
'createdDate', '2024-10-06T11:09:59.181Z',
'updatedDate', '2024-10-06T11:10:48.652Z',
'createdByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42',
'updatedByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42'
),
'eresource', jsonb_build_object(
'trial', false,
'activated', false,
'accessProvider', 'c88742c3-dc2f-4589-a7cf-a90694c2a296',
'createInventory', 'Instance, Holding'
),
'isPackage', false,
'locations', jsonb_build_array(
jsonb_build_object(
'quantity', 2,
'locationId', '9ffb23a9-0e83-4d8e-a70d-ddf44ab67c84',
'quantityElectronic', 2
)
),
'publisher', 'Praeger Publishers',
'collection', false,
'instanceId', 'b94d2138-bdfc-5dea-bab9-ac99e21b7970',
'orderFormat', 'Electronic Resource',
'checkinItems', false,
'contributors', jsonb_build_array(
jsonb_build_object(
'contributor', 'Yurchenco, Henrietta',
'contributorNameTypeId', '2b94c631-fca9-4892-a730-03ee529ffe2a'
)
),
'poLineNumber', currPoNumber || '-' || iteration_counter,
'vendorDetail', jsonb_build_object(
'instructions', '',
'vendorAccount', '',
'referenceNumbers', jsonb_build_array()
),
'paymentStatus', 'Pending',
'receiptStatus', 'Pending',
'claimingActive', false,
'reportingCodes', jsonb_build_array(),
'titleOrPackage', '!Hablamos! Puerto Ricans speak / Photos. by Julia Singer.',
'automaticExport', false,
'publicationDate', '[1971]',
'purchaseOrderId', order_id,
'fundDistribution', jsonb_build_array(
jsonb_build_object(
'code', 'FYND',
'value', 100,
'fundId', '8003d427-34a3-4ad4-97cd-c1aae19f2bfc',
'distributionType', 'percentage'
)
),
'acquisitionMethod', '796596c4-62b5-4b64-a2ce-524c747afaa2',
'searchLocationIds', jsonb_build_array(
'9ffb23a9-0e83-4d8e-a70d-ddf44ab67c84'
),
'donorOrganizationIds', jsonb_build_array(),
'checkinItems', true
)
)
RETURNING id INTO polineNumber;
iteration_counter := iteration_counter + 1;

-- Call the function to generate data for titles table
PERFORM public.generate_0062_titles_data(polineNumber, concat(ponumber, '-', line_counter), pieces_per_order);
END LOOP;
END;
$$ LANGUAGE plpgsql;



CREATE OR REPLACE FUNCTION public.generate_0062_titles_data(
po_line_id TEXT,
po_line_number TEXT,
pieces_per_order INTEGER
) RETURNS VOID AS
$$
DECLARE
title_id UUID;
BEGIN
-- Insert data into titles table
INSERT INTO [tenant]_mod_orders_storage.titles (id, jsonb, creation_date, created_by, polineid)
VALUES (
public.uuid_generate_v4(),
jsonb_build_object(
'id', '4945c26f-6cf7-4050-93c1-0a8a25a2f4d7',
'title', '!Hablamos! Puerto Ricans speak / Photos. by Julia Singer.',
'edition', '',
'metadata', jsonb_build_object(
'createdDate', '2024-10-06T11:09:59.247Z',
'updatedDate', '2024-10-06T11:09:59.247Z',
'createdByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42',
'updatedByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42'
),
'poLineId', po_line_id,
'publisher', 'Praeger Publishers',
'acqUnitIds', jsonb_build_array(),
'instanceId', 'b94d2138-bdfc-5dea-bab9-ac99e21b7970',
'productIds', jsonb_build_array(
jsonb_build_object(
'productId', '73121721',
'productIdType', 'c858e4f2-2b6b-4385-842b-60732ee14abb'
)
),
'contributors', jsonb_build_array(
jsonb_build_object(
'contributor', 'Yurchenco, Henrietta',
'contributorNameTypeId', '2b94c631-fca9-4892-a730-03ee529ffe2a'
)
),
'poLineNumber', po_line_number,
'publishedDate', '[1971]',
'claimingActive', false,
'isAcknowledged', false
),
current_timestamp, -- Assuming creation date is the current timestamp
'created_by_user_id', -- Replace with the actual user ID
po_line_id::uuid
)
RETURNING id INTO title_id;

-- Call the function to generate data for pieces table
PERFORM public.generate_0062_pieces_data(title_id, po_line_id, pieces_per_order);
END
$$ LANGUAGE plpgsql;


CREATE OR REPLACE FUNCTION public.generate_0062_pieces_data(
title_id UUID,
polineNumber TEXT,
pieces_per_order INTEGER
) RETURNS VOID AS
$$
DECLARE
piece_counter INTEGER;
holding_id UUID;
BEGIN
SELECT id INTO holding_id
FROM [tenant]_mod_inventory_storage.holdings_record 
WHERE permanentlocationid = '9ffb23a9-0e83-4d8e-a70d-ddf44ab67c84' 
AND instanceid = 'b94d2138-bdfc-5dea-bab9-ac99e21b7970'
LIMIT 1;

FOR piece_counter IN 1..pieces_per_order
LOOP
-- Replace the following line with your actual poLineId
INSERT INTO [tenant]_mod_orders_storage.pieces VALUES (
public.uuid_generate_v4(),
jsonb_build_object(
'id', public.uuid_generate_v4(),
'format', 'Electronic',
'titleId', title_id,
'metadata', jsonb_build_object(
'createdDate', '2024-10-06T11:43:04.384Z',
'updatedDate', '2024-10-06T11:43:04.384Z',
'createdByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42',
'updatedByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42'
),
'poLineId', polineNumber,
'holdingId', 'aefd322b-9a32-4cd9-80e0-a5a3f882f2b1',
'copyNumber', piece_counter,
'supplement', true,
'displaySummary', piece_counter,
'receivingStatus', 'Expected',
'displayOnHolding', false,
'discoverySuppress', false,
'statusUpdatedDate', '2024-06-05T11:43:04.385+00:00'
),
NULL,
NULL,
'eb79cb72-0fb5-4773-a580-b1428fa724e9'::UUID, -- Replace with the actual poLineId
title_id
);
END LOOP;
END
$$ LANGUAGE plpgsql;






CREATE OR REPLACE FUNCTION public.generate_0062_invoices(
invoices_per_organization INTEGER,
invoicelines_per_invoice INTEGER,
vendor_id TEXT,
order_id TEXT
) RETURNS VOID AS
$$
DECLARE
invoice_id TEXT;
newInvoiceNumber INTEGER;
BEGIN
FOR invoice_counter IN 1..invoices_per_organization
LOOP
SELECT nextval('[tenant]_mod_invoice_storage.invoice_number') INTO newInvoiceNumber;

INSERT INTO [tenant]_mod_invoice_storage.invoices (id, jsonb)
VALUES (
public.uuid_generate_v4(),
jsonb_build_object(
'id', public.uuid_generate_v4(),
'total', 0.0,
'source', 'User',
'status', 'Approved',
'currency', 'USD',
'metadata', jsonb_build_object(
'createdDate', '2024-10-06T09:07:45.366Z',
'updatedDate', '2024-10-06T09:08:47.954Z',
'createdByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42',
'updatedByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42'
),
'subTotal', 0.0,
'vendorId', vendor_id,
'poNumbers', ARRAY[newInvoiceNumber]::TEXT[],
'acqUnitIds', ARRAY[]::UUID[],
'adjustments', ARRAY[]::JSONB[],
'invoiceDate', '2024-02-27T00:00:00.000+00:00',
'batchGroupId', '2a2cb998-1437-41d1-88ad-01930aaeadd5',
'fiscalYearId', '562bf586-11e9-4c36-98d7-3341042c856c',
'paymentMethod', 'Cash',
'accountingCode', '12345',
'folioInvoiceNo', newInvoiceNumber::TEXT,
'enclosureNeeded', false,
'vendorInvoiceNo', invoice_counter::TEXT,
'adjustmentsTotal', 0.0,
'exportToAccounting', false,
'nextInvoiceLineNumber', 2,
'chkSubscriptionOverlap', true
)
) RETURNING id INTO invoice_id;

PERFORM public.generate_0062_invoicelines(
invoicelines_per_invoice,
invoice_id,
newInvoiceNumber,
vendor_id,
order_id
);
END LOOP;
END
$$ LANGUAGE plpgsql;

CREATE OR REPLACE FUNCTION public.generate_0062_invoicelines(
invoicelines_per_invoice INTEGER,
invoice_id TEXT,
newInvoiceNumber INTEGER,
vendor_id TEXT,
order_id TEXT
) RETURNS VOID AS
$$
DECLARE
invoiceline_id TEXT;
BEGIN
FOR invoiceline_counter IN 1..invoicelines_per_invoice
LOOP
INSERT INTO [tenant]_mod_invoice_storage.invoice_lines (id, jsonb)
VALUES (
public.uuid_generate_v4(),
jsonb_build_object(
'id', public.uuid_generate_v4(),
'total', 0.0,
'metadata', jsonb_build_object(
'createdDate', '2024-10-06T09:08:47.393Z',
'updatedDate', '2024-10-06T09:08:47.393Z',
'createdByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42',
'updatedByUserId', '9f9d1c46-52e1-4bb7-9c6c-56e6bb945c42'
),
'poLineId', order_id,
'quantity', 2,
'subTotal', 0.0,
'invoiceId', invoice_id,
'adjustments', ARRAY[]::JSONB[],
'description', 'Its awesome if its working',
'accountNumber', 'libraryorders@library.tam',
'accountingCode', '12345',
'adjustmentsTotal', 0.0,
'referenceNumbers', ARRAY[]::JSONB[],
'fundDistributions', jsonb_build_array(
jsonb_build_object(
'code', 'FYND',
'value', 100.0,
'fundId', '8003d427-34a3-4ad4-97cd-c1aae19f2bfc',
'distributionType', 'percentage'
)
),
'invoiceLineNumber', invoiceline_counter,
'invoiceLineStatus', 'Approved',
'releaseEncumbrance', false
)
) RETURNING id INTO invoiceline_id;

-- You can perform additional actions if needed
END LOOP;
END
$$ LANGUAGE plpgsql;


-- CREATE sample data
-- 1 - amount of organizations to be created
-- 2 - amount of orders per organization
-- 3 - amount of polines per order
-- 4 - amount of pieces per order

SELECT public.generate_0062_data_for_edifact_export('FYNG',1,1,1,1);



-- CLEANUP

To create encumbrances linked to the current budget orders should be with open status. To change the status from pending to open select needed data for the jmeter script. Save to use in the PUT request orders/composite-orders/${po_id}. Run needed number of requests to prepare open orders.

Data preparation to Open Orders

SELECT id as po_id, jsonb->>'vendor' as vendor_id, jsonb->>'poNumber' as po_number
select count(id)
FROM cs00000int_mod_orders_storage.purchase_order
where jsonb->>'workflowStatus'='Pending'

BODY DATA

{"id":"${po_id}","approved":true,"notes":[],"poNumber":"${po_number}","orderType":"One-Time","reEncumber":true,"vendor":"${vendor_id}","workflowStatus":"Open","acqUnitIds":[],"needReEncumber":false}

Legacy approach about data preparation instructions can be found at the link: Steps for testing process#Fiscalyearrollover Use this link to get exact number of organizations, orders, POLined, invoices

Set max_locks_per_transaction parameter in DB cluster and instance configurations from default 64 to 1024 to avoid problems with ordersRollover.
Additional info for testing (scripts, queries) saved in S3 bucket - Buckets/fse-ptf/FYR/
- envs_data_gen_scripts - txt files with sql which populate DB with data
- qelc2 and qcon jmeter scripts to change status from pending to open

Name	Memory GIB	vCPUs	max_connections
db.r6g.4xlarge	128 GiB	16 vCPUs	4000
db.r6g.xlarge	32 GB	4vCPUs	2000

[Quesnelia][Eureka] Fiscal year rollover testing

Overview IN PROGRESS

Summary

Recommendations & Jiras

Errors

Test Runs and Results

Service CPU Utilization

Test FYR (Eureka)

FYR (Eureka)

Memory Utilization

Test FYR (Eureka)

FYR (Eureka)

DB CPU Utilization

Test FYR (Eureka)

Test FYR (non-Eureka)

FYR (Eureka)

FYR (non-Eureka)

DB Connections

Test FYR (Eureka)

Test FYR (non-Eureka)

FYR (Eureka)

FYR (non-Eureka)

DB Load

Test FY rollover (non-Eureka)

FY rollover

Top SQL

Test FY rollover (non-Eureka)

FY rollover

Appendix

Infrastructure

Methodology/Approach