Quote:
|
Originally Posted by Big Ray
Like others, you make many assumptions on how this board works knowing what?s under the hood. It?s analogous to assuming an engine takes unleaded to find out that, opps, in fact it takes diesel.
|
With the way the search has been you might want to consider installing a supercharger?
Quote:
|
Originally Posted by Big Ray
No one said that your site is THE ONE that is causing the problems. What I am saying is that it contributes to the problem.
Seems everyone that spiders the site assumes they are the only one doing it.
That computer resources are limitless and that what they are doing is ?small enough? not to cause a problem. Easy enough to crank up that spider a few more notches. Let?s see how far it can go!
|
I guess having hundreds of members trying to run their own keyword alert/monitoring service for themselves which relies on your search function is better than 1 or 2 sites who provide that service and don't touch the search function?
As for cranking it up a notch, the spider will only spider as many posts as the board has to offer, nothing more and nothing less...sounds like a more traditional SE bot that you're talking about[QUOTE=Big Ray]
Quote:
|
Originally Posted by Big Ray
The fact is that computer resources are not infinite and you are not the only one doing it. How many times an hour does your spider hit the site? A Minute? (we have logs).
|
The bot continuously downloads posts until it's up to date at which point it goes back to sleep for 5 minutes. This is so that instead of hitting your site once a month and downloading hundreds of thousands of pages over a couple of days it's balanced out over the month.
Quote:
|
Originally Posted by Big Ray
When does a spider stop being a spider and become the source in a DoS attack. What?s the difference?
|
is 8300 page views considered a DOS attack?