Archive for January, 2018

Planned Maintenance: Scolocate Power

Posted: Wednesday, January 31st, 2018 at 16:11 by Gurinder Bansal

Tuesday 27th February 22:00 – Wednesday 28th February 06:00

During the above window, our supplier will be carrying out essential power work. Whilst this work takes place, the building will be run on generator backups.

Whilst no downtime is expected, the site should be considered at-risk for the duration of the work.

At Risk: Bristol and Cardiff

Posted: Wednesday, January 31st, 2018 at 14:43 by Adam Heath

Due to a core network link failure both Bristol and Cardiff cores are currently operating with reduced resilience.  The failure is currently under investigation with the supplier.

Further updates will be provided as soon as they become available.

  1. Jamie Smith says:

    Virgin Media have identified a fault with the link between Bristol and Slough. Engineers have been dispatched for further investigation.

    No ETA has been provided as of yet, updates to follow.

  2. Jamie Smith says:

    Virgin Media have advised that this is a suspected fibre break. Fibre splicers have been assigned in readiness for work to commence, ETA is approx 17:30. Work will commence once OTDR tests have been carried out at both locations to determine where the break lies.

    Updates to follow.

  3. Jamie Smith says:

    Virgin Media have advised OTDR testing has now been carried out and confirmed where the breaks are. Engineers are continuing to work towards fixing this issue.

  4. Richard Partridge says:

    The fibre break affecting the core link was resolved at approximately 19:30 yesterday evening. Following a period of overnight monitoring, the core link as performed as expected. Both Bristol and Cardiff cores are once again operating at full resilience.

Planned Maintenance: Equinix – Interxion

Posted: Monday, January 29th, 2018 at 17:03 by Gurinder Bansal

Tuesday 6th February 2018 00:00 – Tuesday 6th February 2018 06:00

During the above maintenance window, we will be undertaking work on core links between the above locations as part of ongoing network expansion.

No down time is expected and all precautions will be taken to avoid any disruption, however during this window both sites should be considered at risk.

  1. Gurinder Bansal says:

    This work has now been completed

Incident: Vodafone circuits

Posted: Thursday, January 25th, 2018 at 18:50 by David Derrick

We have suffered a recurrence of previous incidents related to one of our Vodafone interconnects. Staff are already on the case with Vodafone.

  1. David Brewis says:

    Vodafone have advised that a field engineer has been assigned and is on route with an eta of 20:00

  2. David Brewis says:

    Investigations have discovered a fibre break, fibre engineers are currently working to restore service

  3. Adam Heath says:

    Vodafone engineers have now re-spliced a snapped fibre. Once the fibre was re-spliced and connected, alarms cleared and services have been restored. Vodafone are continuing to monitor the links.

  4. David Brewis says:

    A report is now available for this incident, which can be found here.

Incident: PWAN Connectivity

Posted: Wednesday, January 24th, 2018 at 19:05 by Ryan Berrisford

We are aware of an incident affecting some PWAN connectivity. Engineers are already engaged and are investigating.

Further updates will be provided as and when they become available.

  1. Mark Yardley says:

    Connectivity to the affected services has now been restored and engineers are continuing to investigate the underlying cause. We apologise for any inconvenience.

  2. David Brewis says:

    A report is now available for this incident which can be found here.

Incident: Vodafone Circuits

Posted: Wednesday, January 24th, 2018 at 17:09 by Jake Turner

We are currently seeing a number of Vodafone circuits a down. Initial diagnostics indicate the circuits are related to a single Vodafone handoff. Engineers are investigating and engaging with our supplier. Further updates will be provided when available.

  1. Ryan Berrisford says:

    We have been advised by the Vodafone Network Operations Centre that the incident is potentially linked to a transmission card failure within the Vodafone network.

    Field engineers are being assigned and an estimated time of arrival will follow.

  2. Mark Yardley says:

    Vodafone have advised that the field engineer has been assigned and is on route with an ETA of 21:00.

  3. Mark Yardley says:

    The Vodafone engineer has now attended site and connectivity has been restored to the affected services. Vodafone have advised the issue has been cleared. We will continue to liaise with Vodafone for an RFO.

Incident: Vodafone Circuits

Posted: Wednesday, January 24th, 2018 at 00:19 by Mark Yardley

We are currently experiencing a loss of connectivity for a number of Vodafone circuits. Initial diagnostics indicate the circuits are related to a single Vodafone handoff. Engineers are investigating and engaging with our supplier. Further updates will be provided when available.

  1. Richard Partridge says:

    Service was restored at approximately 02:30 this morning. It appears that this incident related to planned maintenance being carried out by Vodafone. We do not appear to have received pro-active notification for the work being carried out. This is something that will be raised with Vodafone for further investigation.

    We apologise for the inconvenience caused by this.

Planned Maintenance: Kingston Power

Posted: Tuesday, January 23rd, 2018 at 10:50 by Gurinder Bansal

Tuesday 27th February 08:00 – 18:00

During the above window, our supplier will be carrying out essential power work. Whilst this work takes place, the building will be run on generator backups.

Whilst no downtime is expected, the site should be considered at-risk for the duration of the work.

Incident: Bristol

Posted: Monday, January 22nd, 2018 at 10:12 by Jamie Smith

We have just experienced a loss of service to our Bristol node. Engineers are currently investigating and further updates will be provided as and when they become available.

  1. Jamie Smith says:

    Service has been restored. Engineers are still investigating to determine a cause.

Incident: Vodafone Circuits

Posted: Thursday, January 18th, 2018 at 12:30 by Mark Yardley

We are currently experiencing a loss of connectivity for a number of Vodafone circuits. Initial diagnostics indicate the circuits are related to a single Vodafone handoff. Engineers are investigating and engaging with our supplier. Further updates will be provided when available.

  1. Mark Yardley says:

    This incident has been escalated with Vodafone and their engineers are being dispatched to site to investigate. Further updates to follow. This incident has been raised to senior management at Vodafone due to this handoff being affected by previous issues.

  2. Scott Morgan says:

    We have had confirmation that Vodafone field engineers will be onsite between 15:15 and 15:30. This is following extensive diagnostics indicating a potential fault with the Vodafone network terminating equipment.

    We are in constant communication with Vodafone and further updates will follow as and when they become available.

  3. Adam Heath says:

    We have just received confirmation from the Vodafone engineer that they have reached the site and are about to begin their investigations. Further updates will follow once available.

  4. Scott Morgan says:

    We have been notified by the onsite engineer that he is currently in the process of replacing the Vodafone network termination hardware.

    We have been advised that this should be completed by approximately 17:15.

    We will continue to update as necessary.

  5. Scott Morgan says:

    Service has been restored since the Vodafone network termination hardware was replaced at 17:00.

    We will be liaising with Vodafone post incident and a full RFO will be provided.

  6. David Brewis says:

    A report is now available for this incident, which can be found here.