maas commisioning fails

Steps to reproduce...
1 - setup a maas server and a empty node to pxeboot.
2 - start the commission process
3 - the empty node pxeboots and os installs
4 - once os installs ssh from maas controller to node works fine
5 - the node has internet access through maas as gateway and using maas dns services
6 - the node shows "commission failed" status

how can we troubleshoot this?

we tried with both maas version 1.8 and 1.9.

the environment is live on the internet if you can help us login and troubleshoot

I am working with Narinder Gupta from Canonical on this issue - he asked me to submit this issue.

ubuntu@maas:~$ dpkg -l '*maas*'|cat
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-===================================-================================-============-===============================================================================
ii maas 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS server all-in-one metapackage
ii maas-cli 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS command line API tool
ii maas-cluster-controller 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS server cluster controller
ii maas-common 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS server common files
ii maas-dhcp 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS DHCP server
ii maas-dns 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS DNS server
ii maas-proxy 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS Caching Proxy
ii maas-region-controller 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS server complete region controller
ii maas-region-controller-min 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS Server minimum region controller
ii python-django-maas 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS server Django web framework
ii python-maas-client 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS python API client
ii python-maas-provisioningserver 1.9.0+bzr4533-0ubuntu1~trusty1 all MAAS server provisioning libraries
ubuntu@maas:~$ zip -r ~/maas.zip /var/log/maas/*
  adding: var/log/maas/apache2/ (stored 0%)
  adding: var/log/maas/clusterd.log (deflated 86%)
  adding: var/log/maas/maas.log (stored 0%)
  adding: var/log/maas/maas.log.1 (deflated 94%)
  adding: var/log/maas/maas.log.2.gz (deflated 5%)
  adding: var/log/maas/maas.log.3.gz (deflated 7%)
  adding: var/log/maas/maas.log.4.gz (deflated 1%)
  adding: var/log/maas/maas.log.5.gz (deflated 4%)
  adding: var/log/maas/maas.log.6.gz (deflated 1%)
  adding: var/log/maas/proxy/ (stored 0%)
  adding: var/log/maas/regiond.log (deflated 96%)
  adding: var/log/maas/rsyslog/ (stored 0%)
ubuntu@maas:~$ ls -al /var/log/maas
total 9708
drwxr-xr-x 4 root root 4096 Jan 14 06:47 .
drwxrwxr-x 15 root syslog 4096 Jan 14 06:47 ..
lrwxrwxrwx 1 root root 16 Jan 6 17:38 apache2 -> /var/log/apache2
-rw-r--r-- 1 maas maas 8515 Jan 14 06:14 clusterd.log
-rw-r--r-- 1 syslog syslog 0 Jan 14 06:47 maas.log
-rw-r--r-- 1 syslog syslog 31775 Jan 14 06:44 maas.log.1
-rw-r--r-- 1 syslog syslog 1708 Jan 13 06:40 maas.log.2.gz
-rw-r--r-- 1 syslog syslog 1345 Jan 10 06:45 maas.log.3.gz
-rw-r--r-- 1 syslog syslog 1729 Jan 9 06:45 maas.log.4.gz
-rw-r--r-- 1 syslog syslog 1792 Jan 8 06:45 maas.log.5.gz
-rw-r--r-- 1 syslog syslog 6388 Jan 7 06:19 maas.log.6.gz
drwxr-x--- 2 proxy proxy 4096 Jan 14 06:47 proxy
-rw-r--r-- 1 maas maas 9848693 Jan 14 06:47 regiond.log
drwxr-xr-x 2 syslog syslog 4096 Jan 5 17:45 rsyslog
ubuntu@maas:~$ ubuntu@maas:~$