Connectivity Incident

Posted: Friday, March 22nd, 2013 at 11:07 by Richard Partridge

We are aware of an network incident affecting WBC connectivity this morning at approximately 10:00. Traffic was rerouted across alternative paths and service was reinstated minutes after.

Our initial investigations have suggested this may be a third party related issue however this is still being validated. Further updates will be provided as and when they become available.

9 Responses to “Connectivity Incident”

  1. Richard Partridge says:

    We are aware of a repeat of the same issue experienced earlier this morning. We have identified a line card issue which we are expecting to rectify shortly. We will update again once we have further information.

  2. Richard Partridge says:

    Services has now been stabilised following the rerouting of connectivity away from the affected line card. We are continuing to work on rectifying the underlying issue. We are aiming to update this every 30 minutes until the problem is fully resolved.

    Following further investigation, the subject of this post has been modified to more accurately reflect the nature of this incident.

  3. Richard Partridge says:

    We believe the line card issue has been rectified, and it is now ready for normal operation once again. However, we are only passing minimal traffic through the card to give us an opportunity to monitor it before returning it to full service.

    As per the previous update, customer traffic continues to be routed around this card for the time being.

    We will update again in approximately 30 minutes.

  4. Richard Partridge says:

    The line card has remained stable since our last update. We are continuing to monitor the line card at the moment and customer traffic is still being routed around it.

    We will update again in approximately 30 minutes.

  5. Richard Partridge says:

    Our engineers are still monitoring the line card at the moment, and it has continued to remain stable since the previous update.

    We will update again in approximately one hour.

  6. Richard Partridge says:

    We are gradually increasing the amount of traffic routing through the original path and the service has remained stable as expected.

    We will continue to monitor the traffic and we will aim to provide another update at approximately 17:00 today.

  7. Richard Partridge says:

    The line card has remained stable, however the underlying cause which triggered this incident in the first place warrants further investigation with Cisco. As a result of this, the line card will remain running on a reduced workload and we will continue monitoring it’s status for the time being.

    Once the case is fully investigated and concluded an incident report will be published. We expect to be able to provide the next update on Monday 25th March.

  8. Wayne Hawtin says:

    The service has been monitored closely and remained stable as expected over the weekend. We will continue to reroute traffic until we are satisfied the risk is fully removed.

  9. Richard Partridge says:

    An incident report has been made available for this issue. It can be found here.

Leave a Reply

You must be logged in to post a comment.