You will be sorry for it some day.

I'm sorry for your not having come with us.

We are sorry we can't help you.

It's a pity when somebody dies.

It's a pity that you should leave Japan.

It's a pity that you can't come.