I am building a lower from an Anderson stripped lower and a PSA parts kit. When I try dropping the safety detent into the hole, it will not drop in all the way. It is stuck halfway. To me, it looks like the hole is not drilled right. Could I just hit with a drill and bit, or what should I do? Thank you.