manager: move answer call on io pool

answering and joining a participant can take quite some time,
avoid to lock main thread for that.

Change-Id: I4a2982ba8c35cdc7861ff5db01cffd0678777bea