Quote:
Originally Posted by danayster
Hmmm, I'm not sure how to block the serps from seeing /linkex in htaccess without blocking everyone. What would be the code?
|
If you don't want SE's to see your LinkEX directory, just rename it
It's very hard to block the search engines only, because you will have a HUGE list of their IP's and crawler's URL's. Not all search engines identify themselves in request headers.