Hardware :
http://www.supermicro.com - great machines at a nice price
Software : download an OS like Red Hat Fedora, get it installed and install a control panel like Ensim or Plesk on top of it. It will help you maintaining your sites, but the server WILL still need some administration through the shell, so you'll need some Linux knowledge.
Good luck !