Quote:
Originally Posted by Kard63
Why do you use a linux box to spider your sites?
|
I check to make sure that all the links on my tgp's are good first. Then I spider through to determine if the gallery is a movie gallery or a picture gallery. Then I scan the gallery and download a thumb for our "tooltip" feature on the mouseover on the main page listing of galleries.
Many servers won't allow another server to do those things. So we discovered that as long as we did it from a home ip address we could do those things. So the linux box sits all day checking and spidering as I cue up galleries for each evening, then at midnight eastern time all hell breaks loose on Grampland.Com, ShavedGoat.Com, Sex-Ahoy.Com, and FlopDonkeys.Com as each site updates and archives.
Too bad the fucking illegit tubes stole all my traffic lol My tgps have never been better.
