I use www.freehostia.com for my web hosting. Their free service is absolutely phenomonal (no ads, access to MySQL, PHP, CGI; it's full fledged hosting).
As for learning, I highly recommend http://www.pageresource.com
as a great website. Plus, their forum is chock full of web content experts of all types (no offense to BC's own web site development forum, it's just that pageresource's forum is completely focused on the topic.)
Also, there's a great HTML book called HTML in an Instant (link to Amazon, where' it's only 10 cents!)
Here's a quick tutorial about web hosting from W3schools: http://www.w3schools.com/hosting/default.asp
Another interesting tutorial I found: http://www.davesite.com/webstation/html/index.shtml
Any experienced webmaster will tell you that you need a good FTP program. One of (if not the) best such programs is Filezilla
, which is open source and free (as in free beer).
Edited by Amazing Andrew, 14 November 2007 - 06:19 PM.