GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   attn: Reality Check Network (https://gfy.com/showthread.php?t=992770)

webair 10-18-2010 09:31 PM

Quote:

Originally Posted by gleem (Post 17620574)
ISprime was less than enthusiastic about my call to them setting up my box, the guy there sounded just as jaded and hectic as the RCN techs except this guy was in the sales dept. which really freaks me out. Could tell by the way this guy talked to me it's going to be a long time before I get my other box restored. :disgust

Evidently, they are incredibly overwhelmed. I'm sure BOTH companies have been up and plugging away for countless, exhausting hours. This is an incredibly devastating situation to all involved, but when you are up against a tidal wave, and all you have is a life vest, there really isn't much you can do.

Zagi, I would personally like to say that the post you made earlier was that of a true leader. It took a lot of heart to stand up and refer clients to their best option in getting their business / sites back up and running, even if it meant telling them to change hosts! For a company to lose it's clients / business with the stroke of a keyboard is unimaginable to me. Years of hard work, blood, sweat, tears and passion for the company is immeasurable. If there is anything we can do to help, please do not hesitate to contact us.

Best to all.

M

CYF 10-18-2010 09:44 PM

Quote:

Originally Posted by zagi (Post 17619646)
Here are the facts:

The network was attacked on Saturday morning at 5:30AM. The attackers were able to break into the management servers, from there they were able to get to all the customer servers that we manage.

They ran malicious commands to overwrite the filesystems corrupting the servers to a point where they need to be reformatted.

Our backup system was never meant to restore so many servers at once, it was designed to help an individual customer recover a single server, or some files in case of accidental deletion, or other action.

We manage nearly 1,000 servers and each server currently takes nearly 4 hours to recover, in other words 4000 man hours. This is not to mention that the backups are compressed, some customers have more data than others, and even when everything is restored there is still configuration work that is required to get everything working, ultimately this means that its over 4000 hours to get this completed.

We are simply not capable of recovering this many servers in any reasonable period of time, it will take over 1 month to get this done, and by then the customers will lose their businesses as well.

The backup system uses a custom format to compress and store the files so it is not easy to provide direct access to the data. In other words in order for anyone to get their files we need to go through a lengthly, and complicated restore procedure.

We wish nothing more than for this to be business as usual, but we are simply incapable of dealing with the circumstances.

Additionally the servers for our customers are on lease, these leases are owned by banks and from our projections the business would not be able to generate enough revenue to continue. That means that even if we brought up customers onto our network, in some time we would still go out of business due to loss of revenue and piling liabilities.

We have been working around the clock as we were not prepared for an event of this magnitude, the action that was carried out is malicious and criminal and we do not have a way to properly come back from this.

We are doing our best to work with each customer and get their servers back online, but we are simply overwhelmed. Some of our servers were hosted in ISPrime's facility, our other main facility is in North Bergen, NJ just a couple of miles away from ISPrime - and we are giving customers another option. We are not holding data hostage, and allow customers to move to any host that they choose. Please understand that we have nearly 200 customers and 1000 servers, and can only do single digit number of restores at a time, making it impossible to get to everyone's request at once.

Please bare with us as we look to restore your information and find a new home for your business.

We would also like to say that we do not concretely know who the attacker was, or what their intentions were, but we have opened a case with the FBI to investigate this matter and find out who is responsible for this malicious and criminal attack.

Wow, that really sucks. I feel for you guys right now, and if I was local I'd offer to come help out.

cosis 10-18-2010 09:56 PM

Quote:

Originally Posted by webair (Post 17620727)
Evidently, they are incredibly overwhelmed. I'm sure BOTH companies have been up and plugging away for countless, exhausting hours. This is an incredibly devastating situation to all involved, but when you are up against a tidal wave, and all you have is a life vest, there really isn't much you can do.

Zagi, I would personally like to say that the post you made earlier was that of a true leader. It took a lot of heart to stand up and refer clients to their best option in getting their business / sites back up and running, even if it meant telling them to change hosts! For a company to lose it's clients / business with the stroke of a keyboard is unimaginable to me. Years of hard work, blood, sweat, tears and passion for the company is immeasurable. If there is anything we can do to help, please do not hesitate to contact us.

Best to all.

M

If your looking for cheery customer service it's probably not the best time. Right now it seems like the quickest option to get your site back online. You can always change next month.

FlexxAeon 10-18-2010 10:06 PM

how come you hosting companies are always so goddamn lovey-dovey with each other?! :mad:

teomaxxx 10-18-2010 11:29 PM

Quote:

Originally Posted by gleem (Post 17620574)
ISprime was less than enthusiastic about my call to them setting up my box, the guy there sounded just as jaded and hectic as the RCN techs except this guy was in the sales dept. which really freaks me out. Could tell by the way this guy talked to me it's going to be a long time before I get my other box restored. :disgust

so with my two virtual accounts at realitychecknetwork I can be sure to be last on the line with Isprime. F.ck, they dont even have virtual accounts, only servers which I dont need at all. Where do they have pricing list on their website? I am not even able to find that out.

madawgz 10-19-2010 12:40 AM

Quote:

Originally Posted by teomaxxx (Post 17620943)
so with my two virtual accounts at realitychecknetwork I can be sure to be last on the line with Isprime. F.ck, they dont even have virtual accounts, only servers which I dont need at all. Where do they have pricing list on their website? I am not even able to find that out.

try to get a backup of this from RCN directly

aleck 10-19-2010 02:38 AM

Quote:

Originally Posted by teomaxxx (Post 17620943)
so with my two virtual accounts at realitychecknetwork I can be sure to be last on the line with Isprime. F.ck, they dont even have virtual accounts, only servers which I dont need at all. Where do they have pricing list on their website? I am not even able to find that out.

Just get new virtual account in some other place and use your own backups, for virtual accounts they are usually tiny.

tg989 10-19-2010 02:45 AM

Ugh, after looking around at new hosts and their offerings I can say I know why we are with RCN. Bunch of "2-3 days" for setups and only "email" support after hours... :\

:\ If anybody is going to pull through on customer loyalty alone despite this, RCN would be it.

- LOL - 10-19-2010 02:56 AM

Quote:

Originally Posted by tg989 (Post 17621163)
Ugh, after looking around at new hosts and their offerings I can say I know why we are with RCN. Bunch of "2-3 days" for setups and only "email" support after hours... :\

:\ If anybody is going to pull through on customer loyalty alone despite this, RCN would be it.

This is true. If the local assclowns think Mojohost or Phatservers are good, well, i will tell you that they are SHIT in comparison to RCN. Those guys were so tech savy like you wouldn't believe. They could configure a server with a massive load to run in the 0.01 0.01 0.01. The support was one of a kind in the hosting industry.

I laugh at the idiots spamming webair in this thread who don't have a clue about a proper hosting.

And before anyone says "haha look where they ended up now", to you I answer: it could happen to anyone.

Emil 10-19-2010 03:02 AM

Fucking hackers, why do they have to destroy stuff? Ok if they change the index-pages but I dont see the point of doing something like what happened to RCN.

OneWhoKnows 10-19-2010 03:15 AM

Quote:

Originally Posted by - LOL - (Post 17621178)
I laugh at the idiots spamming webair in this thread who don't have a clue about a proper hosting.

Ok, well looks like you had bad experiences with Webair, which sucks then, but it's just your experiences. Why can't you or other Webair haters in here accept that there are other people who are actually happy with Webair and never had any serious problems with them?

I rarely spam the boards for Webair, but if someone asks I do recommend them, as I think their support is pretty decent, especially the live support is great to have.

sf86 10-19-2010 03:15 AM

Quote:

Originally Posted by madawgz (Post 17621024)
try to get a backup of this from RCN directly

They won't even pack the content of my hosting account (which fortunately hasnt been affected by this hacking shit) into one file so I cant download a backup to my local hard drive. :mad: I've asked them about 10 times now, no reaction. I will probably have to wait for the next hack..

Oracle Porn 10-19-2010 03:17 AM

Quote:

Originally Posted by - LOL - (Post 17621178)
Those guys were so tech savy like you wouldn't believe.

It's indeed hard to believe of what can happen when a "tech savy" person gets mad.

madawgz 10-19-2010 03:31 AM

Quote:

Originally Posted by sf86 (Post 17621196)
They won't even pack the content of my hosting account (which fortunately hasnt been affected by this hacking shit) into one file so I cant download a backup to my local hard drive. :mad: I've asked them about 10 times now, no reaction. I will probably have to wait for the next hack..

aww, sorry to hear that..hopefully they will come through soon for you

Abracadabra_nl 10-19-2010 03:40 AM

Quote:

Originally Posted by zagi (Post 17619646)
Here are the facts:

The network was attacked on Saturday morning at 5:30AM. The attackers were able to break into the management servers, from there they were able to get to all the customer servers that we manage.
(...)
We would also like to say that we do not concretely know who the attacker was, or what their intentions were, but we have opened a case with the FBI to investigate this matter and find out who is responsible for this malicious and criminal attack.

So all this shit didn't happen because of some disgruntled ex-employee. I really wonder who is behind it and why this hack was done. I wonder if we'll ever find out.

kichi 10-19-2010 03:40 AM

i thought rcn had monitors and file alteration monitors and shit like that in place. I was under the impression something like this would have been impossible. I mean isnt there something monitoring the servers for mass deletions or injections or shit like that? how is it even possible that an exploit can come out and wipe out 1,000 servers in 2010 on a managed hosting situation like RCN. I am telling you this was preventable and they just got complacent after all these years. You live, you learn RCN. I am sure we have all learned valuable leasons from this.

RBC 10-19-2010 04:04 AM

whom to contact about getting backup data?

mlove 10-19-2010 04:12 AM

Quote:

Originally Posted by kichi (Post 17621234)
i thought rcn had monitors and file alteration monitors and shit like that in place. I was under the impression something like this would have been impossible. I mean isnt there something monitoring the servers for mass deletions or injections or shit like that? how is it even possible that an exploit can come out and wipe out 1,000 servers in 2010 on a managed hosting situation like RCN. I am telling you this was preventable and they just got complacent after all these years. You live, you learn RCN. I am sure we have all learned valuable leasons from this.

As rcn posted, they basically had one single box that had access to every server that they manage. I'm not exactly sure how they set this up, but there are two likely scenarios: this was a linux box with an ssh key setup, and accessing every server they manage was as easy as knowing a single ssh key's authentication passphrase.

Or it could have possibly been a single windows webserver that never logged out of it's own account, and always had pageant open with it's ssh key loaded in so that the attacker wouldn't even need to know the ssh key pass.

Or it could have been a single server with a text file that contained every root password for every box.

Regardless, I don't think any 'fully managed' host is actually secure, as each employee workstation will usually have access to a shit load of of boxes via a single ssh key phrase. Ideally, I would have each server setup with a unique ssh key, and have the 'management box' have a new user account for each box they manage, and from there have an unique ssh key & ssh key passphrase.

Let this be a lesson in liability.

- LOL - 10-19-2010 04:50 AM

Quote:

Originally Posted by RBC (Post 17621272)
whom to contact about getting backup data?

you will be lucky if there ARE any backups, mate

:(

ladida 10-19-2010 04:51 AM

Quote:

Originally Posted by mlove (Post 17621286)
I would have each server setup with a unique ssh key, and have the 'management box' have a new user account for each box they manage, and from there have an unique ssh key & ssh key passphrase.

No you wouldn't. And there's a reason they didn't.

blablabla 10-19-2010 05:20 AM

so, now I decided to move away from rcn and cant wait for isprime to have time for my business. Anyone can suggest solid managed hosting for me pls?

nolongerexists 10-19-2010 05:24 AM

yeah isprime is solid but they are pretty slow with setting up new boxes

ISPrime_dimi 10-19-2010 06:26 AM

We are working overtime and tirelessly to recover and migrate RCN clients that wish to transition to ISPRIME. There are some major limitations in the recovery rate. All content was compressed and encrypted on the backup servers, and the Disk I/O limitations further complicate matters. We’ve brought in additional manpower, and employees have been working extra hours to try and move this along as quickly as possible. Of course we are faced with a difficult task and are doing our best to set up clients as fast as we can. As mentioned before we are limited by the existing RCN backups and Disk I/O.

I know a lot of you have questions that you’d like to get answered; please understand that by calling our sales line and asking questions such as the “what’s the ETA” will not get you a definite answer. Our sales guys are there to give you a quote on a setup. Once that’s done and you've decided to move forward, you would get an invoice with a payment link. Once you are signed up, our sales guys will forward the setup details to the Support team, who will begin your setup. We ask that you contact us via email to [email protected] with the following information:

Your RCN customer #
Server Alias
First and Last Name

Please do not ICQ or call in, as this will only slow down the account creation process.
We ask for some understanding due to the highly difficult circumstances of this situation. We are working as fast as possible to restore accounts of customers who are migrating to ISPRIME, and again asking you to keep in mind that we are limited by the existing RCN backup servers and disk I/O limitations.

Please understand that this is not only a new server setup, but also a data recovery process -- which does require extra time.

teomaxxx 10-19-2010 06:39 AM

Quote:

Originally Posted by RBC (Post 17621272)
whom to contact about getting backup data?

bump for this question

SGx 10-19-2010 06:52 AM

rcn is not replying me anymore, hugh

and isprime is : signup if you want more infos
hugh

i have been paying for backups for several years... and it has been 3 days now i have been waiting those backups, that's crazy

demon666777 10-19-2010 07:00 AM

yeah, the situation is worst than yesterday,
RCN ignore me too and dont answer

4 days down & no good news - actually no news

Spudstr 10-19-2010 07:13 AM

Quote:

Originally Posted by tg989 (Post 17621163)
Ugh, after looking around at new hosts and their offerings I can say I know why we are with RCN. Bunch of "2-3 days" for setups and only "email" support after hours... :\

:\ If anybody is going to pull through on customer loyalty alone despite this, RCN would be it.

We have servers in stock and ready to be rolled out. If your intersted zak @ yellowfiber.net or icq me below. I'll be around all day.

Father_of_HereIsThePorn 10-19-2010 07:34 AM

Here´s an example of how "excellent" the icq-support at ISPrime is.

Me 13:17
I´m wondering how the progress with restoring my sites is going...

isprime13:23
one min please

isprime13:37
should work now

*I went ahead and changed DNS setting at this time.

Me 15:41
Hi! The DNS changes have now taken place where I´m located, but my sites are down... you said that it should work...

isprime15:45
one moment

Me 16:02
so how is it going? will the sites be online soon or shall I change back dns? I´m sorry if I´m nagging, but it´s very important that my sites get online... and if I can help in any way, please let me know.

isprime16:03
51

cosis 10-19-2010 07:44 AM

Quote:

Originally Posted by Father_of_HereIsThePorn (Post 17621787)
Here´s an example of how "excellent" the icq-support at ISPrime is.

Me 13:17
I´m wondering how the progress with restoring my sites is going...

isprime13:23
one min please

isprime13:37
should work now

*I went ahead and changed DNS setting at this time.

Me 15:41
Hi! The DNS changes have now taken place where I´m located, but my sites are down... you said that it should work...

isprime15:45
one moment

Me 16:02
so how is it going? will the sites be online soon or shall I change back dns? I´m sorry if I´m nagging, but it´s very important that my sites get online... and if I can help in any way, please let me know.

isprime16:03
51

frustrating - i got replies faster with the email support

b2kill 10-19-2010 07:54 AM

Quote:

Originally Posted by Father_of_HereIsThePorn (Post 17621787)
Here´s an example of how "excellent" the icq-support at ISPrime is.

Me 13:17
I´m wondering how the progress with restoring my sites is going...

isprime13:23
one min please

isprime13:37
should work now

*I went ahead and changed DNS setting at this time.

Me 15:41
Hi! The DNS changes have now taken place where I´m located, but my sites are down... you said that it should work...

isprime15:45
one moment

Me 16:02
so how is it going? will the sites be online soon or shall I change back dns? I´m sorry if I´m nagging, but it´s very important that my sites get online... and if I can help in any way, please let me know.

isprime16:03
51

You're at least lucky that they working on your move. I faxed the document, paid $$ ... last night and still no news from them.

- LOL - 10-19-2010 08:07 AM

ISprime is worthless right now. All the big dogs (xnxx, xvideos) got them cornered.

Doenst look like there's any backups either. Try moving elsewhere.

mlove 10-19-2010 08:14 AM

You guys wouldn't have this problem if you had purchased dedicated backup servers. All of the available disk i/o would be dedicated to getting your sites back online.

gleem 10-19-2010 08:15 AM

Quote:

Originally Posted by ISPrime_dimi (Post 17621590)
We ask that you contact us via email to [email protected] with the following information:

Your RCN customer #
Server Alias
First and Last Name

Please do not ICQ or call in, as this will only slow down the account creation process.
We ask for some understanding due to the highly difficult circumstances of this situation. We are working as fast as possible to restore accounts of customers who are migrating to ISPRIME, and again asking you to keep in mind that we are limited by the existing RCN backup servers and disk I/O limitations.

Please understand that this is not only a new server setup, but also a data recovery process -- which does require extra time.


I did this with no response yesterday the min it was announced, I called in at night and they said it must have got deleted.

So I did it again last night, and you are telling me I shouldn't call to ask if you even have my email let alone my server?

cybermike 10-19-2010 08:17 AM

So will Isprime be the new home to xvideos?

nolongerexists 10-19-2010 08:20 AM

Quote:

Originally Posted by - LOL - (Post 17621874)
ISprime is worthless right now. All the big dogs (xnxx, xvideos) got them cornered.

Doenst look like there's any backups either. Try moving elsewhere.

you might have a point here

blablabla 10-19-2010 08:43 AM

rcn told me they are setting up servers and copying the backups there. They said we will receive our username/pass to connect and get our data. I asked when and they answered no ETA yet

BIGTYMER 10-19-2010 08:48 AM

Man what a catastrophe... :(

tom3k 10-19-2010 08:59 AM

this whole situation is the finest example of the duality of karma.

on one side you have a group of people who are extremely distressed by all that has surpassed over the last 4 days, the webmasters who had servers at rcn, and the staff at rcn.

on the other end, you have a group of people who are extremely happy with what has surpassed, the webmasters who dislike xvideos/xnxx, the people who have seen a bump in traffic because the fore mentioned have been offline, those who will snatch up the business that rcns demise will result in and hell, even those at isprime who will see a bigger paycheck thanks to the overtime hours that have resulted thanks to all of this.

remember kids, regardless of what side you are on today... in the end, it is all just temporary.

kong 10-19-2010 10:27 AM

Thought I would jump in and make a comment. ISPrime seems to be doing the best they can to help some of us get back up.

Most of my stuff is coming back online... 6 servers from RCN. Mainstream though, not much content... just a lot of transactional databases.

Porko 10-19-2010 10:30 AM

I would like to see a list of sites coming back online from their RCN´s backups.
Any idea?

pichunter.com is up
more?


All times are GMT -7. The time now is 07:27 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123