Quote:
|
Originally Posted by JaceXXX
|
That is a misconception..the search on STB is completely independant of the GFY search issues and AFAIK had absolutely nothing to do with the problems happening recently..I dont consider 8.3k page loads (from memory) much..
If there was infact 15 spidering running on GFY all you would need to do is subtract 15 from the total views of each thread to get the amount of views not including the bots.
The search on STB spans about 7 different database servers which is why we're able to search 14+ million posts within a fairly reasonable amount of time. Thats also the reason we're spidering mainstream boards such as dbforums.com, maxbimmer.com, bodybuilding.com and a few others...
To date, our of the 40+ boards i've been spidering for the last few months i havent crashed any of them or had any admins accusing me of DOS'ing them, except for GFY.