|
Appreciate the info on htaccess for those that offered examples. Word to the wise for those of short of guru status. htaccess command results vary from server to server. Slight syntax chnage can make a big difference.
Suggest taking time to understand exactly what's going on with your particular server.
Seems easier to block them as they become known with your firewall. Problem is is there is software out there that loads on the surfers PC. So that would be the requesting IP. Obvious mess.
I was dumb and happy with my htaccess file I had in place. I picked it in part from a board and then studied each command and readup on htaccess. Didn't have a problem that I knew of anyway until I pulled the htaccess file. Then I found the fusker leak in fairly short time. Pulled it casue I lost serps and was worried that maybe it had something to do with googlebot and my htaccess file. It was a concern from day one to be honest, but all was going fine for along time.
All kinds of reasons to lose SERPs. So when that happens like it did, you look at everything and try to get rid of everything that could be a problem.
My fear is blocking the SE spiders... Sure google IPs are known. BUT ya have to keep up with changes. Then there is the rest of the SEs.
|