swarms_default_host: add check for removed host

Previously when the default host device was
removed, trying to host a conference would still
attempt to connect to a device with empty Uri.

Change-Id: I8f33eba5a5b93e9d1bff2275667a885a3ebe22c5