When StreamObserver is destroyed, observablesFrames_ is removed
from the container while iterating over it. This causes undefined
behavior and leads to a crash on macOS when the call is finished.
GitLab: #827
GitLab: #845
Change-Id: Ifac8ffe7741b8bf32662767a549a5ffb2c580a12