[FOLIO-1103] Loan information and Request App 504 Timeout Created: 05/Mar/18  Updated: 30/Jun/20

Status: Blocked
Project: FOLIO
Components: None
Affects versions: None
Fix versions: None

Type: Bug Priority: P3
Reporter: Varun Javalkar Assignee: shale99
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified
Environment:

AWS Aurora
Engine: Aurora PostgreSQL 9.6.3
DB instance class: db.r4.large
vCPU: 2 vCPU
Memory: 15.25 GiB
EBS Optimized: 400 Mbps
Network Performance: 10Gbps

AWS RDS
Engine: RDS PostgreSQL 9.6.6
DB instance class: db.r4.large
vCPU: 2 vCPU
Memory: 15.25 GiB
EBS Optimized: 400 Mbps
Network Performance: 10Gbps


Attachments: PNG File LoansTimeout.PNG     PNG File Request.PNG     PNG File RequestTimeout.PNG    
Issue links:
Blocks
is blocked by CIRCSTORE-43 Upgrade to RAML Module Builder versio... Closed
Sprint:
Development Team: Core: Platform

 Description   

Loan information 504 Timeout Request URL query:
http://tmp-lb-pub-185231094.us-east-1.elb.amazonaws.com.:9130/circulation/loans?query=(userId=8dff705f-6884-40a7-8324-6c5ad5d44ece)&limit=100
Attached evidence below.

Request App 504 Timeout Request URL query:
http://tmp-lb-pub-185231094.us-east-1.elb.amazonaws.com.:9130/circulation/requests?query=(requester.barcode="" or item.title="" or item.barcode="*") sortby requestDate
instances.tsv(400381), items.tsv(413992), recordholdings.tsv(400381), circulate.tsv(10097) records
Attached evidence below.

Source data:
HARVARD UNIVERSITY LIBRARIES' Catalog:
https://s3.amazonaws.com/folio-hosting-db-data/cat00352a/cat00352a.tar.gz
400,000 records



 Comments   
Comment by Cate Boerema (Inactive) [ 06/Mar/18 ]

Jakub Skoczen will you verify this and move it to the appropriate project? Thanks!

Comment by shale99 [ 06/Mar/18 ]

hi, please note that there are missing indexes in the circ-storage module, which will create slowness for a number of queries as we are still optimizing for larger data sets.

Comment by Varun Javalkar [ 14/Mar/18 ]

Okay. Is there any time frame as to when this jira ticket will be resolved?

Comment by shale99 [ 19/Mar/18 ]

Not yet

Comment by Varun Javalkar [ 12/Apr/18 ]

Any updates on this?

Comment by Wayne Schneider [ 13/Apr/18 ]

Hi, Varun Javalkar – we hope to be able to get to this next week (week of 16 April).

Comment by shale99 [ 15/Apr/18 ]

i believe the two problematic urls are caused by queries coming from mod-inv-storage, a loans + userid and request + cql , Marc Johnson please correct me if i am wrong. i've looked mod-circ-storage and there are no indexes defined for these types of queries so if there is a significant amount of loan / request data (is this the case?) then these queries will indeed be slow. how long are these queries taking? this should be a seq scan whose perf would depend on the data size.

Marc, is there a plan to move to the latest rmb so we can define the needed indexes in the schema.json?

Comment by Marc Johnson [ 16/Apr/18 ]

shale99 There is an intention to move a newer version of the RAML Module Builder (see CIRCSTORE-43 Closed and CIRCSTORE-48 Closed ) however they are both blocked by this being a compatibility breaking change (renaming metaData to metadata in multiple interfaces), and so needs to be scheduled in accordingly

Comment by Marc Johnson [ 17/Apr/18 ]

shale99 I'm planning to try to coordinate the upgrade to RAML Module Builder 19 this week (with Zak Burke help).

Are there specific indexes that have been identified and we would like to add at the same time?

Comment by shale99 [ 17/Apr/18 ]

hey Marc Johnson - we havent tackled this module yet from a perf standpoint - but of course any filter exposed by the UI should be added along with these two

Comment by Marc Johnson [ 19/Apr/18 ]

shale99 I think I may have missed something above. Can you help me by outlining the indexes we want to add to resolve this issue (that I can possibly add during the upgrade to RMB 19)?

Generated at Thu Feb 08 23:10:51 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.