conversation_module: don't update removed conversations

When removing a contact, we need to set the "removed" timestamp for our
active conversations with that contact, but we shouldn't update the
timestamp for conversations that had already been removed in the past.

GitLab: #1048
Change-Id: Ic090775625fa8fb557e3081ec408ee10bf01aaff