Don't want your gun to show any signs of wear? Put it back in the safe.
Ever had a nice pair of shoes that got scuffed no matter how careful you tried to be with them? Same thing. You wear it, carry it, it's gonna pick up dings, scratches, and nicks.
That said, a leather holster is less likely to produce any wear marks on the gun. At least, until you get in your car/truck and you're wearing jeans with rivets.