Hours after Kerala Governor Arif Mohammed Khan slammed Chief Minister Pinarayi Vijayan on Monday, the latter hit back, saying khan should not have done this while holding the post.