Bundletester fails due to state changing too quickly; try again soon in juju deployer

I can run a test and have it complete then try to re run it and bundletest will fail with :

{
      "executable": [
        "/tmp/bundletester-ky19bf/gitlab-server/tests/01-deploy.py"
      ],
      "returncode": 1,
      "test": "01-deploy.py",
      "exit": "/tmp/bundletester-ky19bf/gitlab-server/tests/01-deploy.py",
      "output": "2017-05-05 10:37:24 Starting deployment of aws1:admin/default\n2017-05-05 10:37:25 Deploying applications...\n2017-05-05 10:37:25 Deploying application gitlab using cs:~spiculecharms/gitlab-server-6\n2017-05-05 10:37:25 Error deploying application 'gitlab'\n2017-05-05 10:37:25 Command (juju deploy -m aws1:admin/default --series xenial cs:~spiculecharms/gitlab-server-6 gitlab) Output:\n\n Located charm \"cs:~spiculecharms/gitlab-server-6\".\nDeploying charm \"cs:~spiculecharms/gitlab-server-6\".\nERROR cannot add application \"gitlab\": state changing too quickly; try again soon\n\n2017-05-05 10:37:25 Deployment stopped. run time: 1.22\nTraceback (most recent call last):\n File \"/tmp/bundletester-ky19bf/gitlab-server/tests/01-deploy.py\", line 15, in <module>\n d.setup(timeout=1200)\n File \"/usr/local/lib/python3.5/dist-packages/amulet/deployer.py\", line 714, in setup\n subprocess.check_call(shlex.split(cmd))\n File \"/usr/lib/python3.5/subprocess.py\", line 581, in check_call\n raise CalledProcessError(retcode, cmd)\nsubprocess.CalledProcessError: Command '['juju-deployer', '-W', '-c', '/tmp/amulet-juju-deployer-vswu9y47/deployer-schema.json', '-e', 'aws1:admin/default', '-t', '1300', 'aws1:admin/default']' returned non-zero exit status 1\n",
      "duration": 1.95258,
      "suite": "gitlab-server",
      "dirname": "/tmp/bundletester-ky19bf/gitlab-server"
    }

If I copy the bundletester command

ubuntu@856686f40eb9:~/charms/builds/gitlab-server$ juju-deployer -W -c /tmp/amulet-juju-deployer-vswu9y47/deployer-schema.json -e aws1:admin/default -t 1300 aws1:admin/default
2017-05-05 10:42:01 Starting deployment of aws1:admin/default
2017-05-05 10:42:01 Deploying applications...
2017-05-05 10:42:01 Deploying application gitlab using cs:~spiculecharms/gitlab-server-6
2017-05-05 10:42:02 Error deploying application 'gitlab'
2017-05-05 10:42:02 Command (juju deploy -m aws1:admin/default --series xenial cs:~spiculecharms/gitlab-server-6 gitlab) Output:

 Located charm "cs:~spiculecharms/gitlab-server-6".
Deploying charm "cs:~spiculecharms/gitlab-server-6".
ERROR cannot add application "gitlab": state changing too quickly; try again soon

2017-05-05 10:42:02 Deployment stopped. run time: 1.34

If I rebootstrap it goes back to running fine