Working on a small site is a good idea, get your feet wet and try out a few things first. I do this for a living, and I'm a big fan of looking around for inspiration from other sites. Certainly no need to reinvent anything.
I'm a programmer type, so I use a general text editor (JEdit), don't particularly like any of the WYSIWYG editors, but I'm a bit of a code fascist and hate to think of another program writing my web code -- that's why I wrote my own web software. But I'm not a normal sort when it comes to this sort of thing.
DreamWeaver and Filezilla are both good tools, they'll help you keep it updated with a minimum of fuss.