sit by

verb

sat by; sitting by; sits by

: to make no effort to stop something bad or unpleasant from happening

I won't sit idly by while he ruins his life!