Quote:
Originally Posted by cyberxxx
If you don't want SE's to see your LinkEX directory, just rename it 
It's very hard to block the search engines only, because you will have a HUGE list of their IP's and crawler's URL's. Not all search engines identify themselves in request headers. |
Good point, duly noted. I went ahead and renamed the /linkex directory to /partners and blocked it in robots.txt so the serps dont crawl it anyhow