If you want to ssh into your EC2 instance you can always use docker-machine:

$ docker-machine ssh <machine-name>

If docker-machine is not working you can go straight:

ssh -i ~/.docker/machine/machines/<machine-name>/id_rsa ubuntu@xx.xx.xx.xx