The trigger is not pulling you. When you pull the trigger, you are using too much finger.
Try to stage the trigger, re align your sights and then squeeze off the last 1/16" and you'll be dead on every time. When you practice doing this it will start to be a natural thing. It will improve your shooting with other guns 10 fold