Hit Bot Detectors?
 

Let me start by saying i'm on of the most non technical people I know. I don't know the first thing about scripts or servers.

Now, I need some kind of program that will analyze my traffic and help me determine what is hitbots and what isn't. I'm noticing some strange traffic coming in and really want to figure it out. Also, what will help me block it?

Thanks in Advance Guys

Post the thing that seems strange

You can block suspect ip's through htaccess

also i have like 17,000 proxies in my suspect list if you want to compare it against something

17,000? thats all?

Newbie....

basically the suspect thing is the fact that my clickthroughs are like 6 times what my inbound links are. I'm using turbo traffic trader and that's the only access I have to IP's. The majority of the clicks come from no cookie hits and it doesn't track the ip's. Here is a list from just my top 150 bookmarks:

Top 150 Incoming IPs

Top 150 Incoming IPs

5 - 219.125.208.116
4 - 212.138.47.11
4 - 80.0.15.176
4 - 207.230.138.240
3 - 64.12.96.75
3 - 212.138.47.17
3 - 64.56.224.26
2 - 66.139.167.232
2 - 195.229.241.228
2 - 203.98.50.22
2 - 217.225.110.158
2 - 220.214.209.107
2 - 213.42.2.5
2 - 80.13.184.99
2 - 81.86.198.206
1 - 212.138.47.12
1 - 204.118.178.110
1 - 195.229.241.229
1 - 64.49.56.16
1 - 66.198.34.4
1 - 217.210.119.15
1 - 217.29.140.5
1 - 68.82.138.167
1 - 202.32.124.249
1 - 211.1.200.222
1 - 64.12.104.36
1 - 205.188.208.135
1 - 219.161.181.227
1 - 63.205.40.47
1 - 68.55.227.246
1 - 4.63.107.213
1 - 212.138.64.172
1 - 61.171.248.106
1 - 161.184.52.61
1 - 64.68.82.18
1 - 218.165.127.28
1 - 211.127.229.253
1 - 209.73.164.50
1 - 212.138.64.174
1 - 212.138.64.173
1 - 219.58.136.5
1 - 213.211.225.206
1 - 202.154.134.53
1 - 128.39.152.128
1 - 68.14.3.6
1 - 211.124.198.65
1 - 63.159.216.183
1 - 217.194.32.48
1 - 212.138.47.20
1 - 212.144.136.104
1 - 62.10.124.182
1 - 24.218.120.189
1 - 66.157.0.176
1 - 66.157.0.176
1 - 80.161.135.248
1 - 211.72.108.19
1 - 208.35.16.97
1 - 128.121.247.58
1 - 213.42.2.11
1 - 217.233.82.103
1 - 204.209.140.16
1 - 80.143.129.222
1 - 68.117.2.161
1 - 220.214.252.106
1 - 144.160.98.28
1 - 211.72.108.3
1 - 66.196.72.49
1 - 80.78.132.125
1 - 195.186.184.68
1 - 62.216.19.203
1 - 64.42.84.38
1 - 193.2.122.90
1 - 152.163.252.129
1 - 68.155.32.135
1 - 208.201.231.73
1 - 65.32.238.221
1 - 67.195.79.161
1 - 67.200.13.2
1 - 24.164.85.222
1 - 219.108.31.34
1 - 12.148.209.198
1 - 212.250.7.20
1 - 62.3.32.57
1 - 217.236.99.181
1 - 68.48.177.115
1 - 195.93.34.7
1 - 209.240.7.141
1 - 207.94.110.3
1 - 194.67.56.68
1 - 219.146.176.26
1 - 66.67.249.62
1 - 24.226.224.202
1 - 219.125.205.185
1 - 63.156.93.122
1 - 67.24.45.86
1 - 172.145.145.249
1 - 64.68.87.43
1 - 67.119.242.200

thats just from this past month

I dont see the problem

Same here

to me it's just totally bizarre that you can get in say (an example) 400 uniques with 10,000 clicks. Something just doesn't seem koesher about it. And about 70% of the clicks come from no cookie referrers. Just doesn't seem logical or normal to me to have such a high influx in clicks versus the same number in unique visitors. Although, i've seen it happen before but the higher click through number only lasted a day or so. This has been happening consistently for over a week now.

make a link on your page that is not visible to a surfer

such as:

out.php?hitbotsuckmydick

Then check the script to see if anything is clicking this

I dont know TTT that well but in UCJ you would do somehting like this


a href =" http://I am So Fucking Hot.com/cgi-bin/ucj/c.cgi?link=hitbotsuckmycock

well it certainly won't hurt to give it a try. I think I can manage to add something like that into the page. Thanks Juicy and I won't even ruin your guido status by telling everyone what a nice guy you are. I'll buy you a drink in Vegas:)

first step is re-drirecting no cookie traffic then see if that makes a difference.

Also do what juicy says.. make an invisible link and track who is clicking it

If you are SERIOUS about getting rid of no cookie traffic use this code exactly as is and place it into your .htaccess

RewriteEngine on
RewriteCond %{HTTP_COOKIE} !^.*ttt_cookie.*$
RewriteRule .*ttt-out.php.*$ http://www.juicylinks.com [R,L]

That should work

let me know if that helps

hmmmm for some reason I think that really would get rid of my "strange" traffic and probably my not so strange traffic as well....:Graucho

Well if you could kindly explain to me what you where going to do with the no cookie traffic?

That only takes out no cookie traffic ,which as far as trading purposes go, is worthless

that's why you gotta get a hitbot that supports cookies, duuh

Hmmmm...we actually wrote something for a buddy of ours who runs several tgps to detect hitbots. The entire thing is pretty complicated, but it works decently. It's currently in beta, just to see if there are any problems on other sites. Nocookie traffic doesn't effect the functionality of most scripts, so you shouldn't really worry about that.

Gak, I really hate advertising, so you can just grab the software off of http://www.google.com/search?hl=en&l...=Google+Search, we're the second link. Don't ask me why, but I feel better about that somehow.

BTW, we're not taking any traffic while we're in beta. If you have any problems, just get in touch with me.

Sorry...lol...to my untrained eye it looked like it would take out my cookied traffic.

Thanks for the link testuser i'll check it out.

Upgrade to a better script and you won't have these problems.