it should be just fine. the smith will should be able to get it out no problem. im surprised you werent able to get it punched out but sometimes its better to be safe than sorry. i doubt there will be any damage to your rifling. good luck
I have been a silent witness
to all of America's finest hours.
But my finest hour comes
when I am torn into strips and used as bandages
for my wounded comrades on the battlefield,
When I fly at half-mast to honor my soldiers,
Or when I lie in the trembling arms
of a grieving mother
at the graveside of her fallen son.