If you want consistency in your POI, free float the barrel. Every time you rest the the rifle on a bag, bipod, barrier, or use a sling to shoot, the harmonics of the barrel change and therefore changes the POI. There is plenty of info out there about barrel harmonics and its affect on accuracy. Make your own determination as to whether or not the difference is enough to matter to you. Free floating will improve accuracy and precision. How much it will improve will depend on the quality of the rifle and your ability as a shooter.
When injustice becomes law, rebellion becomes duty.