This is what I put on all of my sites
User-agent: Fasterfox
Disallow: /
User-agent: *
Disallow:
Sitemap:
http://...../.....txt
The sitemap is just a text listing of all the urls in UTF-8. Sitemap is a recent addition to the robot.txt spec and the big 3 all grab it now. Much easier if you have lots of sites to do this than fuck around with the google stuff.
http://www.sitemaps.org/protocol.php#informing
The Fasterfox thing is due to some FF plugin or something that causes "false" hits to your site because it preloads pages.