Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Create ProfileUpdate Profile




5k rec

10k rec50k rec100k rec

Profile:

Create

"startedDate" : "2023-05-01T14:18:08.828

+00:00

",

"completedDate" : "2023-05-01T14:32:59.472

+00:00

"

14 min

"startedDate" : "2023-05-01T15:33:55.004

+00:00

",

"completedDate" : "2023-05-01T16:04:15.136

+00:00

",

31 min

"startedDate" : "2023-05-01T17:26:36.552

+00:00

",

"completedDate" : "2023-05-01T18:59:33.557

+00:00

",

1h 33min

SRM: db_maxpoolsize = 15 ..100  - Timeout

SRM: db_maxpoolsize = 400

"startedDate" : "2023-05-03T13:47:11.526

+00:00

",

"completedDate" : "2023-05-03T17:05:31.741

+00:00

",

3h 18min

Profile:

Update

"startedDate" : "2023-05-01T14:58:59.770

+00:00

",

"completedDate" : "2023-05-01T15:31:51.023

+00:00

"

33 min

"startedDate" : "2023-05-01T16:25:12.856

+00:00

",

"completedDate" : "2023-05-01T17:26:05.342

+00:00

",

1h 1min

SRM: db_maxpoolsize = 15 ..100  - Timeout

SRM: db_maxpoolsize = 400

"startedDate" : "2023-05-03T10:18:08.980

+00:00

",

"completedDate" : "2023-05-03T12:43:24.420

+00:00

",

2h 25min

SRM: db_maxpoolsize = 400

Completed with errors:

"startedDate" : "2023-05-03T18:08:41.016",

"completedDate" : "2023-05-04T07:46:53.954",

13h 38min


Create Index:

Size: marc_records_lb = 9`874`818

...

May 2, 2023 @ 19:32:13.649 2023-05-02 14:32:13.645 [vert.x-eventloop-thread-1] [741919/mapping-metadata] [fs09000000] [9eb67301-6f6e-468f-9b1a-6134dc39a684] [mod_source_record_manager] ERROR PostgresClient Opening SQLConnection failed: Timeout 

=====================

100k update:

Image Added


Image Added




WARN:

java.lang.IllegalArgumentException: 'DI_INVENTORY_INSTANCE_UPDATED_READY_FOR_POST_PROCESSING' has no corresponding value. Accepted values: [DI_SRS_MARC_BIB_RECORD_UPDATED, DI_SRS_MARC_AUTHORITY_RECORD_UPDATED, DI_SRS_MARC_HOLDINGS_RECORD_UPDATED, DI_SRS_MARC_BIB_RECORD_MODIFIED, DI_SRS_MARC_BIB_RECORD_MATCHED, DI_SRS_MARC_AUTHORITY_RECORD_MATCHED, DI_SRS_MARC_HOLDINGS_RECORD_MATCHED, DI_SRS_MARC_BIB_RECORD_NOT_MATCHED, DI_SRS_MARC_AUTHORITY_RECORD_NOT_MATCHED, DI_SRS_MARC_HOLDINGS_RECORD_NOT_MATCHED, DI_INVENTORY_INSTANCE_CREATED, DI_SRS_MARC_BIB_RECORD_MODIFIED_READY_FOR_POST_PROCESSING, DI_INVENTORY_INSTANCE_CREATED_READY_FOR_POST_PROCESSING, DI_INVENTORY_INSTANCE_UPDATED, DI_INVENTORY_INSTANCE_NOT_MATCHED, DI_INVENTORY_HOLDING_CREATED, DI_INVENTORY_HOLDING_UPDATED, DI_INVENTORY_HOLDING_NOT_MATCHED, DI_INVENTORY_AUTHORITY_CREATED, DI_INVENTORY_AUTHORITY_UPDATED, DI_INVENTORY_AUTHORITY_NOT_MATCHED, DI_INVENTORY_ITEM_CREATED, DI_INVENTORY_ITEM_UPDATED, DI_INVENTORY_ITEM_NOT_MATCHED, DI_SRS_MARC_AUTHORITY_RECORD_CREATED, DI_LOG_SRS_MARC_BIB_RECORD_CREATED, DI_LOG_SRS_MARC_BIB_RECORD_UPDATED, DI_SRS_MARC_HOLDING_RECORD_CREATED, DI_LOG_SRS_MARC_AUTHORITY_RECORD_CREATED, DI_ORDER_CREATED, DI_ORDER_CREATED_READY_FOR_POST_PROCESSING, DI_COMPLETED, DI_ERROR]

...