Robots.txt
 

What to put in it ?

if you really want to block some parts of your site, do a google.

It's not neccessary if you don't need to block anything from crawling.

put sexy messages in it to turn the robots on.. :winkwink:
http://com.webspacemania.com/smiley/

r2d2 ascii art

Nothing like a sexy robot!!! :smokin

unless you're using google products, otherwise don't worry about it.

robots give good head

User-agent: *
Disallow: /

This isn't quite complete, you forgot the google PriorityID:

User-agent: *
Disallow: /
Google_PriorityID: d41d8cd98f00b204e9800998ecf8427e

This google Priority ID is used by 100s of webmasters already, so it's not as effective as using a fresh ID. It's still better than using no ID at all, but I would look into obtaining your own ID.

I just list all the robots who are allowed to visit if they should wish to.

ASIMO
C3PO
HAL
etc...

robots.txt is a waste of bandwith :)

:1orglaugh :1orglaugh

good one :thumbsup