03/08/08 - BlueSquare 1 DC Power Outage

[oshs]

Please be advised that servers located in our BlueSquare 1 DC just went offline in what appears to be due to a power outage that has affected the entire facility.

We sincerely apologise for this outage, and are awaiting further details from BlueSquare regarding the reason for this power outage.

Customers on servers housed in our BlueSquare 2 DC are not affected.

[oshs]

All servers are back online now with the total downtime being less than 15 minutes.

The outage was actually not due to power issues, but rather due to problems with a network distribution switch at the DC. BlueSquare network engineers are investigating futher, but as of now this outage has been resolved.

[oshs]

There was additional intermittent connectivity in the last 2 hours, and we just got this reply from our DC regarding this:

Quote:Dear Customer,

In response to your ticket regarding network issues this afternoon, we beleive we have now identified the cause for various network issues and in some cases outages seen today.

Our monitoring has shown an internal broadcast storm which acted as a DoS attack on valid servers, thus consuming valid network bandwidth.

The server which appeared to start the broadcast storm has now been disconnected for the last 25 minutes and the network has remained stable.

We apologize for any inconvenience this may have caused, and we will be speaking with the customer who's server started the storm to ensure this will not happen again.

[patrick101]

Still VERY slow and intermittant responses from my websites on Server 17. They are mostly timing out and email is also an issue.

Can I take it that the server is still overloaded??

Patrick

[oshs]

The server was running backups earlier this evening which may explain the problem. If it happens again, please open a support ticket at the Helpdesk.