Stamp collecting is a very enjoyable low cost hobby. Although it is possible to spend Millions of dollars on some of the extreme rarities an enjoyable collection should not be done with the anticipation of making money. It should be done simply as a hobby and not as an investment.
Well over 90% of the worlds stamps are available at very low cost and often for free. The most enjoyable part is to buy a large selection of mixed stamps by weight and then spend several months sorting through them and saving all of the duplicates to trade with other collectors.
As a person gets involved they usually eventualy want an Album I have found the best and most reasonably priced ones to be albums by H.E. Harris and the ones by Minkus.
Some places you can get some good guidelines are at the library. In the reference section look for the Scott catalogs.
You may be able to find a copy of Linns Stamp News at a newstand. That is always interesting. Also Minkus puts out a good monthly magazine.
An album is not essential. Many people keep their collection in envelopes and shoe boxes.
Here are a few links for people interested in either expanding their collection or in starting one.
The APS only advanced collectors need to think of joining it. But they are always helpful even for non-members.
http://www.stamps.org/
A very helpful site for beginners and even a good resource for advanced collectors. Not of any use for Dealers or for people that are wanting it to be an investment or business. But, an outstanding site for people that want to try it as an enjoyable hobby.
http://members.aol.com/shobansen/
One of the better known stamp clubs. Good source for info
http://www.askphil.org/
the next few links are companies I have dealt with and have been very Pleased with.
http://www.mysticstamp.com/
http://www.whitmanbooks.com/default.aspx?page=80&SubCatOID=24
This nest one was started by people that lived not far from me when I was a kid in Connecticut.
http://www.littletoncoin.com/html/Who_we_are.htm
this next company is located in Littleton Colorado, it is often mistaken for the above company. It is an honest reliable company also.
http://www.arapahoecoin-stamp.com/
you will find those companies in many magazine ads. I just listed those above because I know they are established and I have personaly done gbusiness with them and was satisfied.
Here is an online link to Linn's Stamp News and the free price is my favorite price. It is an excellent weekly online newpaper about world stamps.
http://www.linns.com/default.asp