You said, "It can be tough to see a 9mm hole at 20 yards."
Yes, it can. I was shooting a stage last year and my little 9mm holes were tough to see. It had an impact on my speed for sure. In my head I was saying, "Did I hit that target? I can't tell."
When shooting, you must trust that your shot was on target and not look for a hole. You are wasting time by looking for the hole. Take the shot and move on. You will find that you are a better shooter than you might think. I shot with Mike Seeklander this weekend and this was one of many pieces of advice he gave me.