In the “Conversation” screen with your contact, click on “Trash”
.
A message appears asking you to confirm the operation. By tapping “OK” all contents exchanged in this conversation with this contact are removed from both your and your contact’s device simultaneously.