Posts Tagged ‘Incidents’

Incident: Vodafone Circuits

Posted: Friday, October 6th, 2017 at 19:34 by Mark Yardley

We are aware of a loss of connectivity for a number of Vodafone Ethernet circuits. Initial diagnostics show the affected circuits are delivered on the same NNI that has recently suffered disruption of service. We are liaising with our suppliers to get the issue investigated further and resolved as quickly as possible. Further updates will be provided as they become available.

  1. David Brewis says:

    Following investigations, Vodafone are arranging to dispatch engineers tonight.

    Further updates to follow once engineers have attended site.

  2. Mark Yardley says:

    Vodafone engineers have attended their site to replace suspect faulty equipment. We currently see the affected services have been restored but should still be considered at risk until our suppliers have advised fault is cleared.

  3. Mark Yardley says:

    These services have again lost connectivity and Vodafone are investigating further. Updates to be provided once available.

  4. David Brewis says:

    Vodafone have escalated the incident and are dispatching engineers to restore service. Further updates to follow as made available.

  5. David Brewis says:

    Connections are restoring to service following hardware replacement, until fault closure consider service at risk.

  6. David Brewis says:

    After 48 hours of monitoring, we have received correspondence from the supplier to show the fault is now closed.

Incident: Cardiff

Posted: Sunday, October 1st, 2017 at 10:25 by Jake Turner

Shortly after 10:00 we experienced an unexpected reload of the cardiff.core router which on first examination appears to be the result of a temporary loss of power. Directly connected customers would have experienced a brief drop in connectivity. Traffic passing through this router will have diverted across alternative paths. Connectivity to most services has been restored and engineers are investigating.

Incident: Vodafone Circuits

Posted: Wednesday, September 20th, 2017 at 00:02 by Richard Partridge

We are currently aware of an issue causing a loss of service for a small number of Vodafone based Ethernet circuits. Engineers are investigating and the supplier has also been engaged. Further updates will be provided as and when they become available.

  1. Richard Partridge says:

    Connectivity is currently restored. Engagement with Vodafone has yet to provide an explanation for this loss of service, however we are continuing to pursue an answer.

    For the time being Vodafone circuits terminating in redbus-sov.core should be considered at risk.

Incident: Preston

Posted: Thursday, August 24th, 2017 at 13:54 by Richard Partridge

We have just experienced a brief loss of power to our equipment located in our Preston PoP. Power is currently restored however engineers are investigating with our colocation provider.

Further updates will be provided when available.

  1. Richard Partridge says:

    Our investigation has determined that the problem related to an unexpected reload of the Preston core router and we are continuing to investigate. The core router has shown no signs of any further problems.

  2. David Derrick says:

    The Preston router has again reported a reboot caused by power failure. Services terminating at that POP will have experienced disruption; other services will have had their traffic rerouted automatically.

    Investigations into the power outage on 24th are still ongoing, this incident will be added to the case as a matter of urgency.

  3. Richard Partridge says:

    The core router has shown no further signs of problems. However, we already had plans to replace this core router with a higher specification and capacity device. In light of these recent problems, we’ve accelerated these plans and will be replacing the core as outlined in this emergency maintenance notification:

    http://noc.enta.net/2017/08/emergency-maintenance-preston/

Incident: Interxion

Posted: Friday, July 28th, 2017 at 09:42 by Richard Partridge

We are currently experiencing a loss of connectivity to one of our switches in Interxion. Engineers are already investigating and local engineering resources are on the way to site. Further updates will be provided as and when they become available.

  1. Richard Partridge says:

    Connectivity has been restored, however we are still investigating the underlying cause.

Incident: VoIP Disruption

Posted: Thursday, July 13th, 2017 at 10:46 by Richard Partridge

Engineers are currently investigating an incident that is causing a loss of service on our VoIP platform. Further information will be provided as and when it becomes available.

  1. Richard Partridge says:

    Service has now been restored. We apologise for any inconvenience.

Incident: Glasgow

Posted: Thursday, March 23rd, 2017 at 01:50 by Mark Yardley

We have experienced two brief losses of power to our equipment located in our Glasgow PoP. Engineers are investigating with our colocation provider. Power is currently restored however should still be considered at risk. Further updates will be provided when available.

  1. Mark Yardley says:

    After additional discussion with our colocation provider, we are currently monitoring the situation in this location while further investigation is undertaken. All services provided at this location are currently restored, however they should still be considered at risk. Further updates will be provided when available.

Incident: Edinburgh

Posted: Tuesday, March 21st, 2017 at 22:58 by Mark Yardley

We have experienced a loss of power to our equipment located in our Edinburgh PoP. Power has already been restored however some services still remain affected. Engineers are investigating and further updates will be provided when available.

  1. Mark Yardley says:

    A second brief power interruption has been experienced at this location. Engineers are still currently investigating the issue with our colocation provider.

  2. Mark Yardley says:

    Updates from our colocation provider indicate that they have seen power disruption at this location and investigating. Further updates from them are not expected until their engineers have been able to attend site.

    Although power is currently restored at this location and the majority of services appear to be function at this time, they should still be considered at risk until our suppliers can confirm the incident is resolved.

  3. Mark Yardley says:

    We have had confirmation from our colocation provider that the disruption was caused by the failure of the local power supply and the failure of their on site backup generator to take over.

    Our provider is currently on site and installing a replacement generator. As such this location should still be considered at risk until this work is complete. Further updates will be provided when they are available.

Incident: Birmingham 3 Power Loss

Posted: Wednesday, February 15th, 2017 at 13:55 by Richard Partridge

We are currently experiencing a loss of power within our Birmingham 3 point of presence. This is causing a loss of service for a small number of directly connected leased line customers.  Affected customers have been contacted and advised directly.

Engineers are currently investigating and already have resources on their way to site to continue their investigation. Further updates will be provided as and when they become available.

  1. Mark Yardley says:

    Power has been restored to the affected customers. However, replacement equipment is required to restore fully redundant power to this site. Further updates on the progress of this work will be provided as and when available.

Incident: VoIP Disruption

Posted: Wednesday, February 1st, 2017 at 09:37 by Mark Yardley

We are currently aware of an issue affecting some VoIP Enrich customers. Engineers are currently investigating and further updates will be provided as and when they become available.

  1. Richard Partridge says:

    The issue has been rectified and normal service has now resumed. Engineers will continue to monitor the platform closely.