But when it's the other way round he'll ask why.

Isn't that always the case for Whatsapp? 

This is why I prefer privatizing my account so that I won't have to see all those stupid last seen(s).