Not spending time with second wife

Respected Moulana

I want to know what is the sin or punishment for someone who has two wives but does not spend any nights with his second wife due to the influence of his family. What is the sin for the people influencing him and is there any sawaab for the wife to stay in a marriage in a situation like this?