www.ably.io
Back

Incident Details

All times are shown in UTC

4th December 2020 12:10:00 PM

Some Reactor queues briefly unavailable to consumers

Between about 12:10 and 12:15 UTC, a subset of Reactor queues were unavailable for consumers, due to one rabbitmq server becoming unavailable. We use mirrored queues with a replication factor of 2, and only one node was affected, so no messages were lost. However, consumers whose queues have primaries on the affected node may have been unable to consume for a few minutes; the consumer would have been rejected with error `home node 'rabbit@queue-b3d24b09.queue-production-us-east-1-a-internal.ably.io' of durable queue ':' in vhost '/shared' is down or inaccessible`.

Resolved

in 5 minutes