Thanks for the reply.
I am in Canada so get chemicals is a lot harder/more expensive. None of the companies in the USA such as B&H will ship cross border and the only places I can find in Canada that actually deal with that are very expensive. Last time I checked it would have been close to $400 just to get started. I currently don't have $400 laying around just to play with. I might have to do some more research because if I can get started for under $100 I'd be all over it.
EDIT: Would you mind posting up what you use? I see so many different suggestions online and it would be nice to be able to hear from someone about what actually works for them.
You can get started really cheap in Canada! There isn't much you need to develop b&w. Sorry if I'm repeating anything mentioned earlier as I haven't had a chance to read it all.
For slow films you can use a developer like Rodinal (in Canada it's distributed as Blazinal and you can get it at filmplus.ca in Toronto). It's just pennies to develop a roll! For faster films you can use something like ilford DD-X and it costs about 1-2 bucks a roll. There are cheaper options but I just find it easy to use and readily available in Toronto. Then you need a fixer and stopper but those are so cheap I don't even consider the cost.
For hard materials you need a developing tank (25 dollars), changing bag (25$), thermometer (10-30$), measuring cylinder that holds 1L (10$), and some jugs you can buy at a dollar store to hold your fixer and stopper. You can get all those things at Downtown Camera in Toronto or B&H.
I do it all in my bathroom sink too.