It is not the initial cost you have to worry about, it is how much you will spend once you start liking it
A Lee single stage basic kit (which I still use) costs $150 and includes almost everything you need, figure an RCBS die set runs about $35 around here and I got my last set of calipers for $27, and my trimmer was about $30. If you already have some brass you can cut that cost completely out, if not I get alot from the local shooting range, once fired brass works as good as the new stuff, and is either free from individuals or cheap in the range store (about $0.15 each for rifle around here) I normally get enough brass from individuals that I never need to buy any for any common caliber, I help people sight in rifles and give them shooting tips and they give me their brass, works out nicely
OK back to the math, bullets for rifle calibers run about $30 per 100 for my SGKs and SSTs sometimes a little less, but there are less expensive bullet out there that work plenty good, as low as $23 for 30 cal Pro Hunters and Hot Cores. Good powders run me around $23 a lbs (1lbs will make about 120 30-06 rounds) and a brick of 1,000 primers normally costs me $30 for CCIs.
So to start reloading one rifle caliber is $242 plus your components, boil down the math on what it costs per round after that and I get my premium 30-06 165gr SGKs for $.50 each one quarter of what they cost me from Federal Premium.
You will eventually want to upgrade to a digital scale ($30-$50) a better hand primer I like the one from Hornady ($35) and some way of thoroughly cleaning your brass I recommend a Hornady ultrasonic cleaner they are on sale for $89 on Midway right now.
Not that expensive, that whole setup and a hundred rounds is less then one car payment and saves me a fortune in the long run.