GoFuckYourself.com - Adult Webmaster Forum - View Single Post

05-08-2005, 10:13 AM

If I have a whole bunch of pages of type domain.com/script.php?id=XXX indexed in SEs, and I would like to block spiders from indexing them, do I use

User-agent: *
Disallow: script.php

in order to block all the pages?
Thanks

05-08-2005, 10:13 AM
X37375787 Guest Posts: n/a	robots.txt question If I have a whole bunch of pages of type domain.com/script.php?id=XXX indexed in SEs, and I would like to block spiders from indexing them, do I use User-agent: * Disallow: script.php in order to block all the pages? Thanks