vcard: Only call getNumber when the contact is fully loaded

Else, this will cause strange duplicates in the PhoneDirectoryModel,
leading to duplicated TextRecording objects later on, in turn
making it impossible to access some contact chat history.

Tuleap: #190
Change-Id: If733a43f915d98941ac722eee8bfa43582971e50