If it is loose enough (even with a patch) to be pushed down the barrel, the accuracy will suffer. A tight fit is essential for complete burn of the powder and an accurate shot. Traditionally the smooth bore is used unpatched. The fit is loose enough to ram with relative ease allowing for fouling build up in subsequent shots. The ball obturates when fired to fill the bore.
In life, strive to take the high road....It offers a better field of fire.
"Robo is right" Fuzzball