fuss with

phrasal verb

fussed with; fussing with; fusses with

: to move or handle (something) in a nervous or uncertain way : to fiddle with (something)

He fussed with his tie the whole time we were talking.

She's always fussing with her hair.