Home Back to RCA

2024-06-13 - London location internet services down. Some services unavailable

What went wrong?

At 20:40 BST. The internet connection at the London location went down. This caused some services to be unavailable.

Impact

Some services were unavailable for 10 minutes. The services affected were:

Timeline

Time Event
20:40 BST ISP Connection is interrupted
20:42 BST Page recieved from Pagerduty dead mans switch
20:44 BST Router restarted
20:46 BST While starting up router started an automatic update. Very poor timing.
20:49 BST Update finished and connection was restored
20:50 BST Services available

Root Cause

Unclear. The ISP has not provided a reason for the outage. The router was restarted and an update was applied. This may have been the cause of the issue.

Resolution

The router was restarted and an update was applied. This resolved the issue.

Corrective Actions

None at this time

Supporting Information

Grafana Dashboard Router