Pingdom – false alarm

Tuesday, 21st June, 2011 19:08 UTC

We have received a false alarm from Pingdom about all our data centers. However, our independent monitoring shows no issues in any of our data centers. We have informed pingdom and until they resolve the problem would keep an open eye on our running services using our internal monitoring tools. All data centers are up and running as usual.

Connectivity loss to data center 2

Thursday, 16th June, 2011 06:23 UTC

UPDATE: Connectivity appears to have been restored. We keep monitoring in case there are further issues.

UPDATE: Our hosting provider reported wide scale networking affecting the whole data center, resulting from network backbone issues. We will be monitoring the situation and take action to move to a different data center if the situation continues for much longer.

There is currently no connectivity to data center 2. This is being investigated with the hosting provider. Our trial service is affected as a result.

Connectivity issues data center 2

Wednesday, 15th June, 2011 15:34 UTC

Our hosting provider has reported a Distributed Denial of Service (DDOS) attack on its infrastructure, affecting the service to our trial users. Data center 2 was unavailable for approximately 17 minutes. Service is now restored and back to normal.

RESOLVED – Connectivity issues to data centers 3 & 5

Friday, 3rd June, 2011 15:22 UTC

UPDATE: Whilst not observing any connectivity issues since the last update, we were made aware of some further work by our hosting provider to replace some network equipment. This might cause further intermittent issues. We are carefully monitoring the situation and will take action if necessary.

Our hosting provided reported that the problem was caused by a routing loop that disabled some network ports temporarily. Our monitoring systems only observed a brief period of connectivity drops. All services are fully operational at this point.

Connectivity issues to data centers 3 & 5

Friday, 3rd June, 2011 14:31 UTC

One of our hosting providers reported connectivity issues which may affect data center 3 and 5. We are awaiting further updates whilst investigating. Service is still available, however high latency and packet loss issues have been observed.