Versions Compared

Old Version 10

changes.mady.by.user Mykhailo Petryshyn

Saved on

compared with

New Version 11

changes.mady.by.user Mykhailo Petryshyn

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Overview

...

  • How long does it take to export 100, 1000, 2500, 5000 records?
  • Use it for up to 5 concurrent users.  
  • Look for a memory trend and CPU usage

Summary 

Test report for Bulk Edits users-app functionality 2022-10-26. 

  • 5k records per user, 5 users simultaneously (25k records total) can be uploaded in about 6 min 13 seconds, 
  • The files with identifiers should be strictly determined.
  • The memory of all modules during the tests for 5000 records with 5 parallel was stable, the memory gap in figure 1 was cause by the import data process.
  • Instance CPU usage 
    • maximal value for text 4VU (0.1-1-2.5k-5k) was 26%
    • maximal value for text 5VU (0.1-1-2.5k-5k) was 27%
  • Service CPU

...

  • usage for test 5VU (0.1-1-2.5k-5k) 
    • CPU of mod-bulk-operations 126%, for all other modules did not exceed

...

    • 22%. 
  • RDS CPU utilization did not exceed

...

  • 43% for 5jobs

...

  • 5000 records and

...

  • 34% for

...

  • 4jobs  5k

...

  • .


Recommendations & Jiras

For further testing Users' bulk editing can be performed with 10k records

...

Infrastructure

PTF -environment

  • 9 m6i.2xlarge EC2 instances located in US East (N. Virginia)us-east-1  
  • 2 instances of db.r6.xlarge database instances, one reader, and one writer
  • MSK ptf-kakfka-1
    • 4 m5.2xlarge brokers in 2 zones

    • Apache Kafka version 2.8.0

    • EBS storage volume per broker 300 GiB

    • auto.create.topics.enable=truec
    • log.retention.minutes=480
    • default.replication.factor=3

...

Comparison with previous results

5VU,
Records		Nolana  

Orchid
2500 2 min 9 sec4 minutes 4 seconds
5000 records3 min 47 sec6minutes 13
seconds

Memory usage

Figure 1 shows memory usage during the testing with 1-5 concurrent and  100-1000-2500-5000 records

...

Errors in logs during testing

Code Block
2023-03-22T19:47:19.986Z
19:47:19 [] [] [] [] ERROR ? HTTP response code=404 msg=No suitable module found for path /holdings-sources/ for tenant fs09000000
ncp5/okapi-b/8dcac0276f1c46cba21d6e5814ec6cd0
Field				Value
@ingestionTime		1679514444708
@log				054267740449:ncp5-folio-eis
@logStream			ncp5/okapi-b/8dcac0276f1c46cba21d6e5814ec6cd0
@message			19:47:19 [] [] [] [] ERROR ?                    HTTP response code=404 msg=No suitable module found for path /holdings-sources/ for tenant fs09000000
@timestamp			1679514439986

...

...

2023-03-22T19:47:19.985Z
19:47:19 [${FolioLoggingContext:requestid}] [${FolioLoggingContext:tenantid}] [${FolioLoggingContext:userid}] [${FolioLoggingContext:moduleid}] ERROR oldingsDataProcessor Holdings source was not found by id=null
ncp5/mod-bulk-operations/bfcbe6d984e1443bb3e2e49dbd14601e
Field				Value
@ingestionTime		1679514442775
@log				054267740449:ncp5-folio-eis
@logStream			ncp5/mod-bulk-operations/bfcbe6d984e1443bb3e2e49dbd14601e
@message			19:47:19 [${FolioLoggingContext:requestid}] [${FolioLoggingContext:tenantid}] [${FolioLoggingContext:userid}] [${FolioLoggingContext:moduleid}] ERROR oldingsDataProcessor Holdings source was not found by id=null
@timestamp			1679514439985

Appendix

Infrastructure

PTF -environment ncp5 [ environment name] 

...

Modules memory and CPU parameters:

Module

SoftLimit

XMX

Task Def. Revision

Module Version

desiredCount

CPUUnits

RWSplitEnabled

HardLimit

Metaspace

Task Count

Mem Hard Limit

Mem Soft limit

CPU units

Xmx

MetaspaceSize

MaxMetaspaceSize

mod-inventory-storage-b195214403mod-inventory-storage:26.1.0-SNAPSHOT.64421024False2208
ncp5-pvt

Wed Sep

13 09:54:48 UTC 2023

mod-agreements6579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-agreements:5.5.2215921488128968384512
mod-
inventory
bulk-
bokapi-b14409221okapi:5.1.0-SNAPSHOT.135231024False1684
operations
259218147mod-inventory:20.0.0-SNAPSHOT.39221024False2880384512
17579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-bulk-operations:1.0.623072260010241536384512
mod-users-
b
bl
8967684
8579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-users-bl:
19
7.
2
5.0
-SNAPSHOT.584
21440
128
1152
False
512
1024
92288128
mod-
data
inventory-
export-workermod-data-export-worker:3
storage
2600
2048
3
12579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-inventory-storage:26.0.0
-SNAPSHOT.104
24096
1024
3690
False
2048
3072
3076384512
mod-data-export-
spring
worker
1844
1292
3
10579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-data-export-
spring
worker:
2
3.0.
0-SNAPSHOT.67
1313072
256
2800
False
10242048
200
384
256
512
mod-
bulk-operations0
inventory
3864010mod-bulk-operations:1.0.22400False4096384512mod-notes
896
322
3mod-notes:5.1.0-SNAPSHOT.2452
128
False
1024
128
128
mod-agreements
2580
2048
3mod-agreements:5.6.0-SNAPSHOT.1172
128
False
3096
384
512
nginx-okapi
896
03
nginx-okapi:2022.03.02
2
128
False
1024
0
12579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-inventory:20.0.622880259210241814384512
nginx-okapi7579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/nginx-okapi:2023.06.1421024896128000
okapi-b8579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/okapi:5.0.13168414401024922384512
mod-notes6579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-notes:5.0.121024896128952384512
mod-data-export-spring8579891902283.dkr.ecr.us-east-1.amazonaws.com/folio/mod-data-export-spring:2.0.21204818442561536384512