Wife and children are hostages given to fortune.

He abandoned his family.

Hatoyama says that he supports his family by gambling on horse racing.

With his wife and children in the country, he was at loose ends for something to do.