GoFuckYourself.com - Adult Webmaster Forum - View Single Post

nico-t · 03-03-2005, 12:18 PM

is this mandatory if u want your site indexed by all SE's?

and, it looks like it that a robots txt file is the same as the robot meta tags.... am i right?
mean this tag: <META NAME="ROBOTS" CONTENT="INDEX, FOLLOW">

03-03-2005, 12:18 PM
nico-t emperor of my world Join Date: Aug 2004 Location: nethalands Posts: 29,903	robots.txt file? is this mandatory if u want your site indexed by all SE's? and, it looks like it that a robots txt file is the same as the robot meta tags.... am i right? mean this tag: <META NAME="ROBOTS" CONTENT="INDEX, FOLLOW">