www.ably.io
Back

Incident Details

All times are shown in UTC

28th January 2016 07:01:55 AM

Degraded performance and intermittent failures

Following a routine recycle of our databases, our realtime system is attempting to connect to old database servers in all regions that do not exist.

This has resulted in an increased rate of 500, 401 and timeout errors.

We are looking into this now.

28th Jan 01:19 PM

We have identified the root cause of the issue and have fixed it.

We are also going to modify our monitoring systems to better detect intermittent failures as our monitoring systems were unfortunately reporting everything as healthy.

Resolved

in about 5 hours