It is called black powder and you can mail order the firearms that utilize it.
Here is an alternative. Use a revolver and a rifle that take the same round. 357, 44 mag etc. Lee sells a small hand loading tool that works very well with the pistol rounds. Carry bullets, primers, powder and reuse the brass. This was done in the wild west as ammunition was expensive.