A few thoughts ...
Patching material should always be a very tighly woven unsized, washed, never permanent press or "wrinkle-free, 100% cotton material. Pillow ticking is very good but/and comes in a variety of thicknesses. You'll have to find the right one.
Blown patches (like yours) can come from a fit that is too tight (they are cut during loading in a muzzle without sufficient crown) or too loose ("cut" by gasses blowing by the ball/patch combo).
A rough bore can also contribute.
Be careful of any patching when hunting. Be very, very careful of wasp nest or other wadding. Both will start a fire if smoldering patches/wadding find dry tinder.
I assume you are shoot a 50 caliber rifle. The land-to-land dimension in these can vary greatly. Keep trying until you find a ball/patch combo that leaves a hole free patch after firing. It will make a WORLD of difference for you.
Feel free to follow up if you have questions ... and, keep your powder dry!