View Single Post
Old 05-05-2008, 10:43 AM  
Evil E
Confirmed User
 
Join Date: Apr 2005
Location: Lazyness is a lifestyle
Posts: 3,201
You shouldn't have any power failure at any good data center. One of the main obligations of hosting companies is to have very redundant electricity. Never had a problem myself but I don't do any hosting at a "adult host". If you do a lot of business with your hosting co, a cool thing to do is to take a tour of their data centers and operations.

"However.. Boxes rebooting in the middle of the night, not cool. We don't have startup scripts setup on all the boxes quite yet, it's a real pain in the ass."

-Like other said, before putting a box in production, you should make sure that if it reboots everything is fine and all the scripts load starting whatever services you need if it happens to reboot.

"PS: This last time we had no clue the boxes even went down, except that shit wasn't working right.. They came back up, but things weren't right, as I mentioned above.. No phone call, no e-mail, we had to find out ourselves and wonder WTF is going on.. When I saw /raid/ wasn't there I almost swallowed my head."

You should have notification traps setup, so that when any service or box is unreacheable you get an email, or you can even do some more funky custom scripts stuff like getting a call with nagios for example.


Best of luck! Get your startup scripts and notification traps set up ASAP
__________________


A girl once told me "Give me 8 inches and make it HURT".

So, I fucked her twice and hit her with a brick.
Evil E is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote