Quote:
Originally Posted by raymor
Yes, he's given Google permission to index, not scrape, the site, and thereby promote it.
|
he did ? i didnt see the part where he defined his submittion to google, i thought google just scraped his site like they scrape every site..
Quote:
Originally Posted by raymor
If you've been a webmaster for more than a few days, you know about robots.txt.
|
not a few , just a couple days
Quote:
Originally Posted by raymor
By choosing not to put up a "no indexing" sign (robots.txt), you've given implied
permission for Google to promote you by adding you to their index.
|
lol so by not posting a sign saying " do not break my car windows" you are implying that it's okay to smash your car windows ? ok got it..
by that theory everyone has permission , why would it be implied for google but not implied for others ? is it called the googlerobots.txt ?
Quote:
Originally Posted by raymor
Besides, use a ounce or so of common sense. Obviously webmasters want their
porno sites listed in search engines. Duh.
|
now they do .. before google it was just software downloading everything on your server
maybe thats what he wants to do is become so rich and well known you will beg him to come scrape your site just like google.