deny oneself

phrase

: to not allow oneself to enjoy things or to have the things one wants

On this diet, I don't feel like I'm denying myself.

I'm not denying myself the foods that I love, I'm just eating smaller amounts.

He's always denied himself the simple pleasures in life.