I feel you are putting too MUCH finger on the trigger as you squeeze.
However, a way to solve this:
Place the gun in a ransom rest and shoot a few rounds. See where it is hitting vs aim point. Then you will know if it is the gun, the sights or you.
I would shoot from a sand bag and take your time. That should show what is going on and then take the correct action be it sight adjustment or whatever else is needed.