Execution expired on non-primary controller
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Confirmed
|
High
|
Vladimir Sharshov |
Bug Description
release: "5.1"
api: "1.0"
build_number: "369"
build_id: "2014-07-
astute_sha: "aa5aed61035a8d
fuellib_sha: "851b29ac6434c1
ostf_sha: "9c0454b2197756
nailgun_sha: "98ea1ce54f4d08
fuelmain_sha: "2379783517e483
With enabled patch https:/
less 10.108.
2014-07-29T00:47:40 debug: [372] f738b612-
summary', results: {:sender=>"2", :statuscode=>0, :statusmsg=>"OK", :data=>
l, :runtime=
n"=>0}, :resources=
:running=>1, :output=>"Currently running; last completed run 1406591259 seconds ago"}}
2014-07-29T00:47:40 debug: [372] f738b612-
summary', results: {:sender=>"3", :statuscode=>0, :statusmsg=>"OK", :data=>{:idling=>0, :status=>"running",
:runtime=
of_sync"=>0}, :lastrun=>0, :version=>nil, :time=>
events=>nil, :output=>"Currently running; last completed run 1406591260 seconds ago"}}
2014-07-29T00:47:40 debug: [372] Nodes statuses: {"succeed"=>[], "error"=>[], "running"=>["2", "3"]}
2014-07-29T00:47:41 debug: [372] Got progress for nodes: [{"uid"=>"2", "progress"=>4}, {"uid"=>"3", "progres
s"=>4}]
2014-07-29T00:47:41 debug: [372] Data received by DeploymentProxy
=>"2", "progress"=>4, "status"
eploying", "role"=
2014-07-29T00:48:25 debug: [372] f738b612-
summary', results: {:sender=>"3", :statuscode=>0, :statusmsg=>"OK", :data=>{:idling=>0, :status=>"running",
:runtime=
of_sync"=>0}, :lastrun=>0, :version=>nil, :time=>
events=>nil, :output=>"Currently running; last completed run 1406591263 seconds ago"}}
2014-07-29T00:48:25 debug: [372] f738b612-
2014-07-29T00:48:25 err: [372] MCollective call failed in agent 'puppetd', method 'last_run_summary', failed nodes:
ID: 2 - Reason: execution expired
2014-07-29T00:48:25 err: [372] Timeout of deployment is exceeded.
It is unclear:
1) why execution expired
2) why astute gave up with timeout error?
Changed in fuel: | |
importance: | Undecided → High |
According to logs, puppet continued to run: test.domain. local/var/ log/puppet. log p_rabbitmq- server] (provider= pacemaker) (debug): LSO: {"node-3"=>"stop", "node-2"=>"stop", "node-1"=>"start"} p_rabbitmq- server] (provider= pacemaker) (debug): STATUS IS: stopped
less node-2.
"stop"
Mon Jul 28 23:49:15 +0000 2014 Service[
Mon Jul 28 23:49:15 +0000 2014 Service[
grep puppet node-2. test.domain. local/commands/ ps.txt manifests/ site.pp --logdest syslog --trace --no-report --debug --evaltrace --logdest /var/log/puppet.log
root 3789 8.7 11.5 443104 236652 ? Rs 23:40 0:46 /usr/bin/ruby /usr/bin/puppet apply /etc/puppet/
I could not find syslog for node-2, wondering where it is in snapshot...