connectionmanager: erase pending on decline

if a shutdown is called while we are waiting for channel to be ready
we must remove the pending callback attached.

Change-Id: Ibe1d2a6517b5f1035d4031bf08bab294ce5111d7