Fuel Contrail plugin

MOS 8 with contrail 4.0 deploy failed (public network on computes

Bug #1596498 reported by Xiwen Deng
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel Contrail plugin
Fix Released
Medium
Fuel Plugin Contrail
Fuel Contrail plugin 4.0.1

Bug Description

When trying to deploy contrail plugins in MOS 8 is failed.

Steps to reproduce:
1. create some vm in vmware EXi and configure network
2. Create cluster with contrail network
3. Add 1 node with “contrail-db” "contrail-config" "contrail-control" role,
 1 node with controller and 2 node with compute roles
4. Enable Contrail plugin v4.0.0
5. verify network is ok
6. Deploy cluster with plugin

I get the following error:

[676] Error running RPC method granular_deploy: Failed to execute hook 'contrail-compute-provision' Puppet run failed. Check puppet logs for details
---
uids:
- '1'
- '4'
parameters:
  puppet_modules: puppet/modules:/etc/puppet/modules
  puppet_manifest: puppet/manifests/contrail-compute-provision.pp
  timeout: 720
  cwd: /etc/fuel/plugins/contrail-4.0/
priority: 400
fail_on_error: true
type: puppet
id: contrail-compute-provision
, trace:
["/usr/share/gems/gems/astute-8.0.0/lib/astute/nailgun_hooks.rb:64:in `block in process'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/nailgun_hooks.rb:26:in `each'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/nailgun_hooks.rb:26:in `process'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/deployment_engine/granular_deployment.rb:233:in `post_deployment_actions'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/deployment_engine.rb:75:in `deploy'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/orchestrator.rb:216:in `deploy_cluster'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/orchestrator.rb:52:in `granular_deploy'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/dispatcher.rb:92:in `granular_deploy'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/server.rb:189:in `dispatch_message'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/server.rb:146:in `block in dispatch'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/task_queue.rb:64:in `call'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/task_queue.rb:64:in `block in each'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/task_queue.rb:56:in `each'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/task_queue.rb:56:in `each'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/server.rb:144:in `each_with_index'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/server.rb:144:in `dispatch'",
 "/usr/share/gems/gems/astute-8.0.0/lib/astute/server/server.rb:123:in `block in perform_main_job'"]

From puppet log of compute node (node 1 and node 4) I find some cli failed like this:
2016-06-27 09:34:43 +0000 /Stage[main]/Contrail::Provision::Compute/Exec[provision-vrouter]/returns (err): change from notrun to 0 failed: contrail-provision-vrouter --api_server_ip 10.200.0.1 --api_server_port 8082 --openstack_ip 192.168.101.2 --oper add --host_name node-4.domain.tld --host_ip 10.200.0.4 --admin_user 'neutron' --admin_tenant_name 'services' --admin_password 'evRhePtfmmS0C4wrRuabz3gg' && touch /opt/contrail/provision-vrouter-DONE returned 1 instead of one of [0]

api-server_ip openstack_ip and host_ip cannot ping from compute node and default gw is also cannot ping.

By the way, before deploy all interface is up, but when deploy failed I find only pxe interface is UP.

I think this is reason why deploy failed, but I do not understand why.

Is someone face the same issue?

Tags: area-plugins
Revision history for this message
Oleksandr Martsyniuk (omartsyniuk) wrote :

Could you please attach the Fuel diagnostic snapshot?
This will help us to identify the issue.

Revision history for this message
Xiwen Deng (deng-xiwen) wrote :
Download full text (6.0 KiB)

there are some puppet log from failed node

2016-06-27 09:31:27 +0000 Scope(Class[main]) (notice): MODULAR: netconfig.pp
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Hiera YAML backend starting
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking up network_scheme in YAML backend
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source plugins/contrail
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source override/node/node-4.domain.tld
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Cannot find datafile /etc/hiera/override/node/node-4.domain.tld.yaml, skipping
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source override/plugins
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Cannot find datafile /etc/hiera/override/plugins.yaml, skipping
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source override/common
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Cannot find datafile /etc/hiera/override/common.yaml, skipping
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source override/configuration/node-4.domain.tld
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Cannot find datafile /etc/hiera/override/configuration/node-4.domain.tld.yaml, skipping
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source override/configuration/role
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Cannot find datafile /etc/hiera/override/configuration/role.yaml, skipping
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source override/configuration/cluster
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Cannot find datafile /etc/hiera/override/configuration/cluster.yaml, skipping
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source nodes
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Cannot find datafile /etc/hiera/nodes.yaml, skipping
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source globals
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Found network_scheme in globals
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source astute
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Found network_scheme in astute
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking up use_ovs in YAML backend
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking for data source plugins/contrail
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Found use_ovs in plugins/contrail
2016-06-27 09:31:27 +0000 Puppet (debug): importing '/etc/puppet/modules/l23network/manifests/init.pp' in environment production
2016-06-27 09:31:27 +0000 Puppet (debug): Automatically imported l23network from l23network into production
2016-06-27 09:31:27 +0000 Puppet (debug): Evicting cache entry for environment 'production'
2016-06-27 09:31:27 +0000 Puppet (debug): Caching environment 'production' (ttl = 0 sec)
2016-06-27 09:31:27 +0000 Puppet (debug): Evicting cache entry for environment 'production'
2016-06-27 09:31:27 +0000 Puppet (debug): Caching environment 'production' (ttl = 0 sec)
2016-06-27 09:31:27 +0000 Puppet (debug): hiera(): Looking up l23netwo...

Read more...

Xiwen Deng (deng-xiwen)
summary: - MOS 8 and contrail 4.0
+ MOS 8 with contrail 4.0 deploy failed
Revision history for this message
Xiwen Deng (deng-xiwen) wrote : Re: MOS 8 with contrail 4.0 deploy failed

@Oleksandr Martsyniuk I had attach the Fuel diagnostic snapshot, how can I share?

Ivan Ponomarev (ivanzipfer)
Changed in fuel:
milestone: none → 8.0-updates
Ivan Ponomarev (ivanzipfer)
Changed in fuel:
assignee: nobody → Fuel Plugin Contrail (fuel-plugin-contrail)
tags: added: area-plugins
Revision history for this message
Ivan Ponomarev (ivanzipfer) wrote :

"Add attachment or patch" button located below "Add comment field"
Please provide snapshot and reopen issue.

Changed in fuel:
status: New → Incomplete
Revision history for this message
Xiwen Deng (deng-xiwen) wrote :

attachment about issue

Revision history for this message
Oleksandr Martsyniuk (omartsyniuk) wrote :

Hi Xiwen!
Thanks for uploading the snapshot.

Could you please re-deploy the environment with network setting "Assign public network to all nodes" disabled?

Revision history for this message
Xiwen Deng (deng-xiwen) wrote :

Hi Oleksandr,
  I follow you suggestion that re-deploy but disable "Assign public network to all nodes", re-deploy success. Thanks for your help.
  This issue is a bug for contrail 4.0?

Revision history for this message
Nastya Urlapova (aurlapova) wrote :

@Oleksandr, should we document your point about settings?

Revision history for this message
Oleksandr Martsyniuk (omartsyniuk) wrote :

Thanks!
Will document this as a limitation.

Revision history for this message
Xiwen Deng (deng-xiwen) wrote :

Hi Oleksandr,
  Thank you for your help. Maybe I need your more help.

  When I re-deploy and enable ToR agent for new environment, everything is same but deploy failed. In my environment not have ToR switch. I don't know whether the problem is have no ToR switch or not. Can you help me?

Revision history for this message
Xiwen Deng (deng-xiwen) wrote :

this is the snapshot about the ToR agent problem.

Revision history for this message
Oleksandr Martsyniuk (omartsyniuk) wrote :

Hi Xiwen,
could you please create a new bug report on ToR issue?

Changed in fuel:
status: Incomplete → In Progress
importance: Undecided → Medium
affects: fuel → fuel-plugin-contrail
Changed in fuel-plugin-contrail:
milestone: 8.0-updates → none
milestone: none → 4.0.1
status: In Progress → Fix Committed
okosse (okosse)
Changed in fuel-plugin-contrail:
status: Fix Committed → Fix Released
Illia Polliul (ipolliul)
summary: - MOS 8 with contrail 4.0 deploy failed
+ MOS 8 with contrail 4.0 deploy failed (public network on computes
Revision history for this message
Janni Han (hanhan) wrote :

Hi Xiwen,
I configured the "Assign public network to all nodes",But there is a "Failed to execute hook 'contrail-compute-provision' Puppet run failed. Check puppet logs for details" error.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.