GoFuckYourself.com - Adult Webmaster Forum - View Single Post - server experts: varnish crashing and taking my websites down with it

Socks · 08-08-2011, 12:40 AM

Every once in a while I'll have a huge HD spike that takes my websites offline, a "swap death spiral". Varnish seems to be the culprit, as I can manually get the websites back up by restarting memcached, varnish and apache. When varnish restarts it says "shutting down: failed!" so I assume it's the problem.

Anyways short of figuring out what the actual problem is, I'd like to just find a workaround so that I don't have to worry about hours of downtime between crash and me realizing things are down.

I guess I could put something in cron that used lynx to hit my websites and if it didn't get a response it would go ahead and restart the three processes?

Someone mind typing out what I'd put in cron for me to do that, or other ideas perhaps?

08-08-2011, 12:40 AM
Socks Confirmed User Industry Role: Join Date: May 2002 Location: Toronto Posts: 8,475	server experts: varnish crashing and taking my websites down with it Every once in a while I'll have a huge HD spike that takes my websites offline, a "swap death spiral". Varnish seems to be the culprit, as I can manually get the websites back up by restarting memcached, varnish and apache. When varnish restarts it says "shutting down: failed!" so I assume it's the problem. Anyways short of figuring out what the actual problem is, I'd like to just find a workaround so that I don't have to worry about hours of downtime between crash and me realizing things are down. I guess I could put something in cron that used lynx to hit my websites and if it didn't get a response it would go ahead and restart the three processes? Someone mind typing out what I'd put in cron for me to do that, or other ideas perhaps?