juju-core

certificate signed by unknown authority

Bug #1303778 reported by Tim Van Steenburgh on 2014-04-07

This bug report is a duplicate of: Bug #1307215: destroy-environment fails to clear lxc containers. Edit Remove

This bug affects 2 people

Affects		Status	Importance	Assigned to	Milestone
	juju-core	Triaged	High	Unassigned	juju-core 1.19.1

Bug Description

tvansteenburgh@trusty-vm:~⟫ juju status
ERROR Unable to connect to environment "local".
Please check your credentials or use 'juju bootstrap' to create a new environment.

Error details:
environment is not bootstrapped

tvansteenburgh@trusty-vm:~⟫ ll /var/lib/juju/locks/
total 8
drwxr-xr-x 2 root root 4096 Apr 7 00:26 ./
drwxr-xr-x 5 root root 4096 Mar 26 15:58 ../

tvansteenburgh@trusty-vm:~⟫ sudo lxc-ls --fancy
NAME STATE IPV4 IPV6 AUTOSTART
-----------------------------------------------------
juju-precise-template STOPPED - - NO
juju-trusty-template STOPPED - - NO

tvansteenburgh@trusty-vm:~⟫ juju bootstrap
uploading tools for series [trusty precise]
Logging to /home/tvansteenburgh/.juju/local/cloud-init-output.log on remote host
Starting MongoDB server (juju-db-tvansteenburgh-local)
Bootstrapping Juju machine agent
Starting Juju machine agent (juju-agent-tvansteenburgh-local)

tvansteenburgh@trusty-vm:~⟫ juju status
ERROR state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
ERROR state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
ERROR state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")

^C2 tvansteenburgh@trusty-vm:~⟫ juju --version
1.17.7-trusty-amd64

Tags:

Curtis Hovey (sinzui) on 2014-04-07

tags:	added: local-provider ppc64el
Changed in juju-core:
status:	New → Triaged
importance:	Undecided → High
milestone:	none → 1.19.0

Revision history for this message

Tim Van Steenburgh (tvansteenburgh) wrote on 2014-04-07:

New info on this. I was able to reproduce this repeatedly, destroying the environment, rebootstrapping, and getting this error when I'd run `juju status`. While asking for help in #IRC, it was suggested that I run bootstrap with the `--debug` flag and paste the resulting output. After doing so, the error no longer occurred (`juju status` returned normally and I was able to subsequently deploy a workload using the local provider). In case it helps, here's the output of that `juju bootstrap --debug` run: http://pastebin.ubuntu.com/7217166/

Revision history for this message

Antonio Rosales (arosales) wrote on 2014-04-09:

I am also hitting this issue:
http://paste.ubuntu.com/7225537/

I am able to bootstrap, but deploying a service or issuing a stat results in certificate errors. I have tried removing the Juju files in my specified Juju root-dir. I have removed ~/.juju/environments/local.jenv. I have kill mongo process. I don't have any lxc containers running. However, I still get this certificate error on local provider.

-thanks,
Antonio

Revision history for this message

Evan (ev) wrote on 2014-04-13:

Download full text (6.4 KiB)

/var/log/juju-evan-local/unit-rabbitmq-server-0.log:

2014-04-13 19:45:28 INFO juju runner.go:254 worker: restarting "api" in 3s
2014-04-13 19:45:31 INFO juju runner.go:262 worker: start "api"
2014-04-13 19:45:31 INFO juju apiclient.go:114 state/api: dialing "wss://10.0.3.1:17070/" 2014-04-13 19:45:31 ERROR juju apiclient.go:119 state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"") 2014-04-13 19:45:31 ERROR juju runner.go:220 worker: exited "api": websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
2014-04-13 19:45:31 INFO juju runner.go:254 worker: restarting "api" in 3s
2014-04-13 19:45:34 INFO juju runner.go:262 worker: start "api"
2014-04-13 19:45:34 INFO juju apiclient.go:114 state/api: dialing "wss://10.0.3.1:17070/" 2014-04-13 19:45:34 ERROR juju apiclient.go:119 state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"") 2014-04-13 19:45:34 ERROR juju runner.go:220 worker: exited "api": websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
2014-04-13 19:45:34 INFO juju runner.go:254 worker: restarting "api" in 3s
2014-04-13 19:45:37 INFO juju runner.go:262 worker: start "api"
2014-04-13 19:45:37 INFO juju apiclient.go:114 state/api: dialing "wss://10.0.3.1:17070/" 2014-04-13 19:45:37 ERROR juju apiclient.go:119 state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"") 2014-04-13 19:45:37 ERROR juju runner.go:220 worker: exited "api": websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
2014-04-13 19:45:37 INFO juju runner.go:254 worker: restarting "api" in 3s

juju bootstrap --debug (unfortunately lost most of this out of my scrollback buffer):

2014-04-13 19:23:13 INFO juju.environs.tools tools.go:100 filtering tools by architecture: amd64
2014-04-13 19:23:13 DEBUG juju.environs.simplest...

/var/log/juju-evan-local/unit-rabbitmq-server-0.log:

2014-04-13 19:45:28 INFO juju runner.go:254 worker: restarting "api" in 3s
2014-04-13 19:45:31 INFO juju runner.go:262 worker: start "api"
2014-04-13 19:45:31 INFO juju apiclient.go:114 state/api: dialing "wss://10.0.3.1:17070/"                                    2014-04-13 19:45:31 ERROR juju apiclient.go:119 state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")                                                                             2014-04-13 19:45:31 ERROR juju runner.go:220 worker: exited "api": websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
2014-04-13 19:45:31 INFO juju runner.go:254 worker: restarting "api" in 3s
2014-04-13 19:45:34 INFO juju runner.go:262 worker: start "api"
2014-04-13 19:45:34 INFO juju apiclient.go:114 state/api: dialing "wss://10.0.3.1:17070/"                                    2014-04-13 19:45:34 ERROR juju apiclient.go:119 state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")                                                                             2014-04-13 19:45:34 ERROR juju runner.go:220 worker: exited "api": websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
2014-04-13 19:45:34 INFO juju runner.go:254 worker: restarting "api" in 3s
2014-04-13 19:45:37 INFO juju runner.go:262 worker: start "api"
2014-04-13 19:45:37 INFO juju apiclient.go:114 state/api: dialing "wss://10.0.3.1:17070/"                                    2014-04-13 19:45:37 ERROR juju apiclient.go:119 state/api: websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")                                                                             2014-04-13 19:45:37 ERROR juju runner.go:220 worker: exited "api": websocket.Dial wss://10.0.3.1:17070/: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "juju-generated CA for environment \"local\"")
2014-04-13 19:45:37 INFO juju runner.go:254 worker: restarting "api" in 3s

juju bootstrap --debug (unfortunately lost most of this out of my scrollback buffer):

2014-04-13 19:23:13 INFO juju.environs.tools tools.go:100 filtering tools by architecture: amd64
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:490 fetchData failed for "file:///home/evan/.juju/local/storage/tools/streams/v1/index.sjson": stat /home/evan/.juju/local/storage/tools/streams/v1/index.sjson: no such file or directory
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:464 cannot load index "file:///home/evan/.juju/local/storage/tools/streams/v1/index.sjson": invalid URL "file:///home/evan/.juju/local/storage/tools/streams/v1/index.sjson" not found
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:490 fetchData failed for "file:///home/evan/.juju/local/storage/tools/streams/v1/mirrors.json": stat /home/evan/.juju/local/storage/tools/streams/v1/mirrors.json: no such file or directory
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:567 no mirror index file found
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:548 no mirror information available for { }: mirror data for "com.ubuntu.juju:released:tools" not found
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:468 read metadata index at "file:///home/evan/.juju/local/storage/tools/streams/v1/index.json"
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:635 candidate matches for products ["com.ubuntu.juju:14.04:amd64"] are [{Sun, 13 Apr 2014 20:23:08 +0100 products:1.0 content-download  [] streams/v1/com.ubuntu.juju:released:tools.json [com.ubuntu.juju:12.04:amd64 com.ubuntu.juju:14.04:amd64]}]
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:947 finding products at path "streams/v1/com.ubuntu.juju:released:tools.json"
2014-04-13 19:23:13 DEBUG juju.environs.simplestreams simplestreams.go:985 metadata: &{map[com.ubuntu.juju:12.04:amd64:{ 1.18.1.1 amd64   map[20140413:0xc210054780]} com.ubuntu.juju:14.04:amd64:{ 1.18.1.1 amd64   map[20140413:0xc2100548a0]}] map[] Sun, 13 Apr 2014 20:23:08 +0100 products:1.0 com.ubuntu.juju:released:tools}
2014-04-13 19:23:13 INFO juju.environs.bootstrap bootstrap.go:58 picked newest version: 1.18.1.1
Logging to /home/evan/.juju/local/cloud-init-output.log on remote host
Starting MongoDB server (juju-db-evan-local)
Bootstrapping Juju machine agent
Starting Juju machine agent (juju-agent-evan-local)
2014-04-13 19:23:16 INFO juju.cmd supercommand.go:306 command finished

% sudo lxc-ls -f
NAME                   STATE    IPV4        IPV6  AUTOSTART
-----------------------------------------------------------
evan-local-machine-1   RUNNING  10.0.3.150  -     YES
juju-precise-template  STOPPED  -           -     NO

% sudo btrfs subvolume list /var/lib/lxc
ID 262 gen 556 top level 5 path juju-precise-template/rootfs
ID 265 gen 582 top level 5 path evan-local-machine-1/rootfs

% juju status
environment: local
machines:
  "0":
    agent-state: started
    agent-version: 1.18.1.1
    dns-name: localhost
    instance-id: localhost
    series: trusty
  "1":
    agent-state: pending
    instance-id: evan-local-machine-1
    series: precise
    hardware: arch=amd64
services:
  rabbit:
    charm: local:precise/rabbitmq-server-98
    exposed: false
    relations:
      cluster:
      - rabbit
    units:
      rabbit/0:
        agent-state: pending
        machine: "1"

It looked like destroy-environment after the previous bootstrap and deploy didn't clear out evan-local-machine-1.

Revision history for this message

Evan (ev) wrote on 2014-04-13:

Sure enough, further units deploy without issue. It's just evan-local-machine-1 that's a problem.

Revision history for this message

Evan (ev) wrote on 2014-04-13:

I've filed bug 1307215 for what I think led to this bug for me.

Curtis Hovey (sinzui) on 2014-04-14

Changed in juju-core:
milestone:	1.19.0 → 1.19.1

Report a bug

This report contains Public information

Everyone can see this information.

Duplicate of bug #1307215 Remove

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.