So we just recently started submitting galleries. We use a separate high bandwidth server that we have tweaked with squid to handle static content. I have a little script I wrote that I keep running and monitor hits real time to get an idea of who is listing us and what URLS etc. My goal was to learn more about when we get listed where and watching traffic patterns real time.
So I noticed a certain site/IP keeps hitting us, so I ran the following command on just today's traffic
cat /var/log/squid/access.log | grep 76.9.31.34 | awk '{print $1 " - "$7 " - "$11}' >> /var/www/html/domains/jaysbabes.com/wtf.txt
http://www1.jaysbabes.com/wtf.txt
Is this normal? What is going on here? Are they just making sure I don't have dead links?
So I noticed a certain site/IP keeps hitting us, so I ran the following command on just today's traffic
cat /var/log/squid/access.log | grep 76.9.31.34 | awk '{print $1 " - "$7 " - "$11}' >> /var/www/html/domains/jaysbabes.com/wtf.txt
http://www1.jaysbabes.com/wtf.txt
Is this normal? What is going on here? Are they just making sure I don't have dead links?
Comment