[MDEXP-509] build-platform-complete-snapshot build failures 3/21 Created: 21/Mar/22  Updated: 12/Apr/22  Resolved: 21/Mar/22

Status: Closed
Project: mod-data-export
Components: None
Affects versions: None
Fix versions: 4.4.2

Type: Bug Priority: P2
Reporter: Jakub Skoczen Assignee: Viachaslau Khandramai (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Attachments: PNG File Screenshot 2022-03-21 at 22.37.07.png     PNG File Screenshot 2022-03-21 at 22.37.19.png    
Issue links:
Blocks
blocks MDEXP-522 MDEXP (mod-data-export) Lotus BF rele... Closed
Defines
defines UXPROD-3340 Firebird - Lotus R1 2022 Enhancements... Closed
Relates
relates to MDEXP-507 Invalid migration scripts for job pro... Closed
Sprint: Firebird Sprint 135
Story Points: 1
Development Team: Firebird
Release: Lotus (R1 2022) Bug Fix
RCA Group: Implementation coding issue

 Description   

Three in a row from Monday morning.



 Comments   
Comment by John Malconian [ 21/Mar/22 ]

Looks like a tenant initialization failure for mod-data-export. The problematic snapshot version is: mod-data-export-4.4.0-SNAPSHOT.308 and the related commit in git is here: https://github.com/folio-org/mod-data-export/commit/742b984d3f3936a7541b8ff69591225f1ad9b134

CC: Viachaslau Khandramai

Log snippet:

14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,792 WARN  [vert.x-eventloop-thread-1] JavaBeanExecutable HV000254: Missing parameter metadata for RecordType(String, int, String), which declares implicit or synthetic parameters. Automatic resolution of generic type information for method parameters may yield incorrect results if multiple parameters have the same erasure. To solve this, compile your code with the '-parameters' flag.
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,808 INFO  [vert.x-eventloop-thread-1] RestRouting invoking postDataExportMappingProfiles
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,813 INFO  [vert.x-eventloop-thread-1] PostgresClient DB config read from environment variables
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,813 INFO  [vert.x-eventloop-thread-1] PostgresClient Using schema: diku
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,813 INFO  [vert.x-eventloop-thread-1] PostgresClient postgreSQLClientConfig = {"maxPoolSize":5,"port":5432,"username":"diku_mod_data_export","host":"10.36.1.43","database":"okapi_modules","password":"...","postgres_tester":false}
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,817 INFO  [vert.x-eventloop-thread-1] RestRouting invoking getTenantByOperationId
14:45:52 [] [] [] [] INFO  ?                    142968/proxy;900194/tenant RES 200 63612us okapiClient http://10.36.1.43:9164/_/tenant/7a6bac57-3bdf-48ee-a116-06c8101ce8bf
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,833 INFO  [vert.x-eventloop-thread-1] LogUtil 10.36.1.43:44756 GET /_/tenant/7a6bac57-3bdf-48ee-a116-06c8101ce8bf null HTTP_1_1 200 426 15 tid=diku OK 
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,838 INFO  [vert.x-eventloop-thread-1] LogUtil 172.17.0.1:39226 POST /data-export/mapping-profiles null HTTP_1_1 201 524 81 tid=diku Created 
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,870 INFO  [vert.x-eventloop-thread-1] RestRouting invoking postDataExportJobProfiles
14:45:52 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:52,888 INFO  [vert.x-eventloop-thread-1] LogUtil 172.17.0.1:39226 POST /data-export/job-profiles null HTTP_1_1 201 514 29 tid=diku Created 
14:45:53 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:53,217 INFO  [vert.x-eventloop-thread-1] RestRouting invoking deleteTenantByOperationId
14:45:53 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:53,217 INFO  [vert.x-eventloop-thread-1] TenantReferenceAPI deleteTenant
14:45:53 [] [] [] [] WARN  ?                    Activation of module 'mod-data-export-4.4.0-SNAPSHOT.308' for tenant 'diku' failed: Tenant operation failed for module mod-data-export-4.4.0-SNAPSHOT.308: POST http://10.36.1.43:9164/data-export/holding-mapping-profiles returned status 404: <html><body><h1>Resource not found</h1></body></html>
14:45:53 [] [] [] [] INFO  ?                    job complete
14:45:53 [] [] [] [] WARN  ?                    job failed
io.vertx.core.impl.NoStackTraceThrowable: Tenant operation failed for module mod-data-export-4.4.0-SNAPSHOT.308: POST http://10.36.1.43:9164/data-export/holding-mapping-profiles returned status 404: <html><body><h1>Resource not found</h1></body></html>
14:45:53 [] [] [] [] WARN  ?                    Tenant operation failed for module mod-data-export-4.4.0-SNAPSHOT.308: POST http://10.36.1.43:9164/data-export/holding-mapping-profiles returned status 404: <html><body><h1>Resource not found</h1></body></html>
io.vertx.core.impl.NoStackTraceThrowable: Tenant operation failed for module mod-data-export-4.4.0-SNAPSHOT.308: POST http://10.36.1.43:9164/data-export/holding-mapping-profiles returned status 404: <html><body><h1>Resource not found</h1></body></html>
14:45:53 [] [] [] [] INFO  ?                    142968/proxy RES 500 117695651us okapi Tenant operation failed for module mod-data-export-4.4.0-SNAPSHOT.308: POST http://10.36.1.43:9164/data-export/holding-mapping-profiles returned status 404: <html><body><h1>Resource not found</h1></body></html>
14:45:53 [] [] [] [] ERROR ?                    HTTP response code=500 msg=Tenant operation failed for module mod-data-export-4.4.0-SNAPSHOT.308: POST http://10.36.1.43:9164/data-export/holding-mapping-profiles returned status 404: <html><body><h1>Resource not found</h1></body></html>
14:45:53 [] [] [] [] INFO  ?                    mod-data-export-4.4.0-SNAPSHOT.308 2022-03-21T14:45:53,227 INFO  [vert.x-eventloop-thread-1] LogUtil 10.36.1.43:44756 DELETE /_/tenant/7a6bac57-3bdf-48ee-a116-06c8101ce8bf null HTTP_1_1 204 0 9 tid=diku No Content 
Comment by Adam Dickmeiss [ 21/Mar/22 ]

The commit changes the path for loading reference to data to a path is not offered by the module and therefore results in a failure "not found".

MDEXP-507 Closed work did not test case with loadReference=true or loadSample=true. Unit tests for the module should include a test with loadReference=true

Comment by Viachaslau Khandramai (Inactive) [ 21/Mar/22 ]

Verified locally on vagrant box according steps from: https://folio-org.atlassian.net/wiki/display/FOLIJET/How+to+test+data+migration+scripts+locally.

TenantAPI call:

curl "http://localhost:8082/_/tenant" -H "X-Okapi-Tenant: testtenant" -H "X-Okapi-URL: http://localhost:8082" -H "Content-type: application/json" -XPOST -d'
{
  "module_to": "mod-data-export-fat",      
  "parameters": [{
    "key": "loadSample",
    "value": "true"
  },{
    "key": "loadReference",
    "value": "true"
  }]
}'
{
  "id" : "ba405cf8-9205-42b0-af50-4aad7572b29b",
  "tenant" : "testtenant",
  "tenantAttributes" : {
    "module_to" : "mod-data-export-fat",
    "parameters" : [ {
      "key" : "loadSample",
      "value" : "true"
    }, {
      "key" : "loadReference",
      "value" : "true"
    } ]
  },
  "complete" : false,
  "messages" : [ ]
}%

leads to correct sample data for profiles:

 

Comment by John Malconian [ 21/Mar/22 ]

Verified fix with this build. https://jenkins-aws.indexdata.com/job/Automation/job/build-platform-complete-snapshot/8070/. Feel free to close issue at your convenience.

Comment by Oleksii Petrenko [ 08/Apr/22 ]

Deployed to Lotus BF. Please proceed with verification

Comment by Magda Zacharska [ 08/Apr/22 ]

Viachaslau Khandramai - how can this be verified on the bugfest environment?

Comment by Viachaslau Khandramai (Inactive) [ 12/Apr/22 ]

Hi Magda Zacharska, this cannot be verified on bugfest because this is a technical stuff relating Community Jenkins (not a bugfest env). This can be closed without additional verification.

 

CC Denis Yauheniya Kryshtafovich

Thanks,

Slava

Generated at Thu Feb 08 23:28:15 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.