Perhaps it's defective ? I've never seen one that worked any other way. I generally use the screw I'm trying to turn, push the handle down hard enough to compress the spring and turn firmly in the direction I want the impact to go.
Of course, about the only time I have to change mine is when it accidentally flips itself while I'm whaling on a tough screw.