Demonic Angel,
Quote:
|
At first glance have the pages scanned for that , and then if there are and changes after being posted they are placed on autoban.
|
is not as simple as it sounds.
I wrote a spider in Perl, (short, sweet, very efficient) that will do what you described. To check a page the size of JJJs,
takes about 60 seconds. This may not sound like alot, but in terms of working at ethernet speeds with full cpu recources, it's an eternity. To go 1 link deeper and check all images pages would increase that by a factor of at least 15. Without a specially set up server it would be unmanageable.
The TGP owners are just trying to save themselves alot of unnecessary work.
------------------
Bob
3x-x.com
Gallery Quest