swarm: remove memberless conversations from the to-sync list

If somehow we have obtained a convInfo file with invalid conversations
(reproducible during a post link account sync), remove them when
loading the conversations.

Gitlab: #528
Change-Id: I45f759f470e58f567e70abafaca21dcce728183f