View Single Post
Old 05-20-2005, 02:49 PM  
fris
Too lazy to set a custom title
 
fris's Avatar
 
Industry Role:
Join Date: Aug 2002
Posts: 55,382
Quote:
Originally Posted by Big Ray
So, for the last week I have sat here and read several posts about search being down and other GFY related problems.

Some folks have been supportive, but others have kind of shit on Lensman and Jupiter.

First off, for those who have lent support, it is appreciated.

For those who have shit on why search is down, and why the site gets slow, I say before you open your mouth and profess to understand the workings of this board, read below.

GFY is no doubt a popular board. Several folks think they have something they can add by building tools like outside search engines and spiders to try and make a quick buck or earn a good rap.

To those who do that, do you realize that that this is a main cause of issues on the board?

For example, yesterday, we had over 15 spiders crawling the site. Clicking every thread for the last year and indexing every new post. Aggressive spiders and screen scrapers alone contribute to an estimated 15x load on the site as a whole over regular users.

Now lets take the search. Search is directly mapped to spiders who provide search services for keywords. Are you getting a clue why GFY Search maybe down at this time?

Let's add in the weekly DDoS attacks from some kiddie who was pissed he got called a "kiddie", it takes a full time well paid engineer to just keep the site up and running.

Ease up. Lensman has thrown some serious cash at this to both stop the problems from happening, and to shore up the infrastructure. It's a daily effort and I were you I would thank him.

15x load, add more ram in the sql server. how many system admins do you have on staff. other than the ones that have quit?

what do you do at jupiter incase of a DDOS attack. anybody knows you nullroute the ip. but you ofcourse know that right?

i have worked in many datacenters before. with much bigger servers bigger applications. this is smalltime compared to what you are dealing with. when a fortune 500 company has 1 min of downtime they are up your ass. just imagine if you were hired to setup a forum for a companies internal lan. if you cant successfully do it on the outside. why would someone hire you to do it on the inside.
__________________
Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence.


WP Stuff
fris is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote