GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   Search engine spiders (https://gfy.com/showthread.php?t=272002)

Fabien 04-19-2004 07:37 PM

Search engine spiders
 
Hummm, do you think that they really spider the pages you submit to them right away ?
Or you stand a better chance if they find it accidently (which is what i think in fact)?


Just found this one on one of my site (doing some tests....) and i submittted a test page with a link to the real page and i think it worked
When: Mon Apr 19 22:28:29 2004 Who: msnbot/0.11 (+http://search.msn.com/msnbot.htm) Where:/youpig/assfucked.html From: 65.54.188.28

As for the page "brut submit", well it never spidered the damn thing

swami 04-19-2004 11:23 PM

There is a time delay in all search engine free submits.
Its nearly always quicker for them to find you via a link from a site that they are crawling already.the more frequently they are crawling the page you have a link from, the quicker they find you.


All times are GMT -7. The time now is 05:32 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123