[FOLIO-3264] Platform Complete Snapshot Build Fails Created: 18/Aug/21  Updated: 18/Aug/21  Resolved: 18/Aug/21

Status: Closed
Project: FOLIO
Components: None
Affects versions: None
Fix versions: None

Type: Task Priority: TBD
Reporter: Marc Johnson Assignee: Wayne Schneider
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Issue links:
Relates
relates to MSEARCH-172 Remove default values for Kafka confi... Closed
Sprint: DevOps Sprint 121
Development Team: FOLIO DevOps

 Description   

The platform complete builds are failing, meaning that the definition for the snapshot environment cannot be updated.

The most recent of these includes this error:

failed: [10.36.1.9] (item={'redirected': False, 'url': 'http://10.36.1.9:9130/_/discovery/modules/mod-search-1.5.0-SNAPSHOT.113', 'status': 404, 'vary': 'origin', 'content_type': 'text/plain', 'connection': 'close', 'content_length': '29', 'msg': 'HTTP Error 404: Not Found', 'elapsed': 0, 'changed': False, 'invocation': {'module_args': {'url': 'http://10.36.1.9:9130/_/discovery/modules/mod-search-1.5.0-SNAPSHOT.113', 'headers': {'X-Okapi-Tenant': 'supertenant', 'X-Okapi-Token': '', 'Accept': 'application/json'}, 'status_code': ['200', ' 404'], 'force': False, 'http_agent': 'ansible-httpget', 'use_proxy': True, 'validate_certs': True, 'force_basic_auth': False, 'body_format': 'raw', 'method': 'GET', 'return_content': False, 'follow_redirects': 'safe', 'timeout': 30, 'follow': False, 'url_username': None, 'url_password': None, 'client_cert': None, 'client_key': None, 'dest': None, 'body': None, 'src': None, 'creates': None, 'removes': None, 'unix_socket': None, 'mode': None, 'owner': None, 'group': None, 'seuser': None, 'serole': None, 'selevel': None, 'setype': None, 'attributes': None, 'content': None, 'backup': None, 'remote_src': None, 'regexp': None, 'delimiter': None, 'directory_mode': None, 'unsafe_writes': None}}, 'failed': False, 'item': {'key': 'mod-search', 'value': {'srvcId': 'mod-search-1.5.0-SNAPSHOT.113', 'nodeId': '10.36.1.9', 'descriptor': {'dockerImage': 'folioci/mod-search:1.5.0-SNAPSHOT.113', 'dockerPull': True, 'env': [{'name': 'ELASTICSEARCH_URL', 'value': 'http://10.36.1.9:9301'}, {'name': 'OKAPI_URL', 'value': 'http://10.36.1.9:9130'}, {'name': 'JAVA_OPTIONS', 'value': '-XX:MaxRAMPercentage=66.0'}], 'dockerArgs': {'HostConfig': {'Memory': 536870912, 'PortBindings': {'8081/tcp': [{'HostPort': '%p'}]}}}}}}, 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "content": "", "elapsed": 300, "item": {"ansible_loop_var": "item", "changed": false, "connection": "close", "content_length": "29", "content_type": "text/plain", "elapsed": 0, "failed": false, "invocation": {"module_args": {"attributes": null, "backup": null, "body": null, "body_format": "raw", "client_cert": null, "client_key": null, "content": null, "creates": null, "delimiter": null, "dest": null, "directory_mode": null, "follow": false, "follow_redirects": "safe", "force": false, "force_basic_auth": false, "group": null, "headers": {"Accept": "application/json", "X-Okapi-Tenant": "supertenant", "X-Okapi-Token": ""}, "http_agent": "ansible-httpget", "method": "GET", "mode": null, "owner": null, "regexp": null, "remote_src": null, "removes": null, "return_content": false, "selevel": null, "serole": null, "setype": null, "seuser": null, "src": null, "status_code": ["200", " 404"], "timeout": 30, "unix_socket": null, "unsafe_writes": null, "url": "http://10.36.1.9:9130/_/discovery/modules/mod-search-1.5.0-SNAPSHOT.113", "url_password": null, "url_username": null, "use_proxy": true, "validate_certs": true}}, "item": {"key": "mod-search", "value": {"descriptor": {"dockerArgs": {"HostConfig": {"Memory": 536870912, "PortBindings": {"8081/tcp": [{"HostPort": "%p"}]}}}, "dockerImage": "folioci/mod-search:1.5.0-SNAPSHOT.113", "dockerPull": true, "env": [{"name": "ELASTICSEARCH_URL", "value": "http://10.36.1.9:9301"}, {"name": "OKAPI_URL", "value": "http://10.36.1.9:9130"}, {"name": "JAVA_OPTIONS", "value": "-XX:MaxRAMPercentage=66.0"}]}, "nodeId": "10.36.1.9", "srvcId": "mod-search-1.5.0-SNAPSHOT.113"}}, "msg": "HTTP Error 404: Not Found", "redirected": false, "status": 404, "url": "http://10.36.1.9:9130/_/discovery/modules/mod-search-1.5.0-SNAPSHOT.113", "vary": "origin"}, "msg": "Status code was -1 and not [201]: Connection failure: timed out", "redirected": false, "status": -1, "url": "http://10.36.1.9:9130/_/discovery/modules"}

I think this means that mod-search cannot be deployed.

I think this may be related to making the ENV environment variable mandatory during this [recent change|] because the hosted reference environments do not set that environment variable (as it was intended that the default, folio be used).

Interested parties: John Malconian Ian Hardy Wayne Schneider Oleksii Kuzminov Drif Abdenour



 Comments   
Comment by Wayne Schneider [ 18/Aug/21 ]

I made two changes:

  1. Added the ENV variable to the global environment variables defined in the okapi-deployment and okapi-tenant-deploy roles. Defaulted to FOLIO, can be set with the Ansible variable kafka_topic_env.
  2. Added the KAFKA_EVENTS_CONSUMER_PATTERN to the mod-search environment for the testing, snapshot, and release builds. Set value to FOLIO\.(.*\.)inventory\.(instance|holdings-record|item) as documented in the Juniper release notes

The platform-complete build finished successfully, and I would expect the change to be reflected in folio-testing and folio-snapshot and in the Vagrant boxes after tonight's builds.

Generated at Thu Feb 08 23:26:50 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.