Swarm: Bad conversation re-appearing

Scenario

Alice 1 device, Bob 2 devices (bob1, bob2)
Alice adds Bob
Bob1 accepts
Now Alice, Bob1 and Bob2 see the conversation
Bob2 removes Alice

Expected

Bob1 and Bob2 should not see Alice

Current result

Bob2 see an invite from Alice for the previous conversation