A .410 slug is .410, versus the .452 bullet of the Colt. The Colt is also rated at about 2,000 PSI higher than the shotshell- and a totally different burn rate for powder.
Revolvers like the Judge can do it because they are designed for it. Your .410 is not, and WILL eventually kill or maim you after you abuse it enough.
What we have here is... failure- to communicate.