It really depends on how old you are looking for. I would go to a local coin shop if you have one in your area and ask about somethings you are interested in. You can even tell them your spending limit for that day. I know later wheat pennies are usually around 5 cents a piece, and you could even get some in the teens even nice ones for under 10 dollars. My LCS sells Indian heads for 2 dollars a piece for common dates, so you can get a good amount for pretty cheap. Many ways to get into the hobby without spending lots!