Archive for March, 2018

Incident: Vodafone Circuits

Posted: Tuesday, March 27th, 2018 at 00:42 by Adam Heath

We are aware of an issue currently affecting some Vodafone circuits.  This has been raised with the supplier who are currently investigating.  We’ll provide further information once it becomes available.

  1. Adam Heath says:

    Vodafone have identified an issue and are in the process of dispatching engineering resource to the relevant location. Further updates will be available in due course.

  2. Jamie Smith says:

    Latest supplier update:

    Vodafone engineers have identified a fibre break and are engaging the relevant fibre team to site. Further updates will be available in due course.

  3. Jamie Smith says:

    We have been advised by our supplier that fibre engineers are due on site between 7.30 – 7.40am to begin working towards a fix.

    Further updates to be provided as and when they become available

  4. Adam Heath says:

    Vodafone have confirmed the incident is due to a multiple fibre break. They have engineers present on site and are currently exploring other suitable service options.

  5. David Brewis says:

    Service has been restored following a repair on the Vodafone fibre break and confirmation received at 10:33.

    We are liaising with Vodafone post incident and a full RFO will be provided.

  6. David Brewis says:

    An interim report can be found here, whilst we await a full RFO.

  7. David Brewis says:

    A full incident report can be found here.

Incident:Vodafone Circuits

Posted: Friday, March 23rd, 2018 at 14:50 by Jamie Smith

We have experienced a brief loss of service to a number of Vodafone circuits  Initial diagnostics indicate the circuits are related to a single Vodafone handoff. Engineers are investigating and engaging with our supplier.

The circuits in question are now showing as back up, further updates to be provided.

  1. Scott Morgan says:

    After further discussion with Vodafone, they have confirmed the brief drop of connection was caused by human error.

    Whilst conducting diagnostics on a leased line fault, a Vodafone engineer inadvertently carried out loop testing to a Vodafone hub serving Entanet customers. As a result, this caused disruption between 14:43:45 until service was restored at 14:48:09 as the engineer rectified their mistake.

    We apologise for the inconvenience caused by this. We are in talks with our suppliers to see how this can be avoided in future.

At Risk: Leeds POP

Posted: Monday, March 19th, 2018 at 09:50 by Jamie Smith

Thursday 22nd March 22:00 – 02:00 Friday 23rd March 

After a power check at the above location, an issue has been identified with the power infrastructure. Emergency work will, therefore, take place in the above window to swap out a faulty UPS.

No downtime is expected however all directly connected services should be considered at risk.

Emergency Maintenance: At Risk: Leeds POP

Posted: Monday, March 12th, 2018 at 09:29 by Jamie Smith

Monday 12th March 12:00 – 17:00

After a power check at the above location, an issue has been identified with the power infrastructure. Emergency work will, therefore, take place in the above window to swap out a faulty UPS.

No downtime is expected however all directly connected services should be considered at risk.

  1. Jamie Smith says:

    This work has been aborted, It will be re-scheduled for a later date.

At Risk: Planned Core Maintenance

Posted: Friday, March 9th, 2018 at 15:57 by Ming-Yu Hsieh

Thursday 15th March 2018 20:00 – 23:00

During the above maintenance window, we will be undertaking work on the core network.

No down time is expected and all precautions will be taken to avoid any disruption, however during this window routing may take different paths than usual.

  1. Ming-Yu Hsieh says:

    This work has now been completed.

Planned Maintenance: Telford DC1 BT circuit moves

Posted: Friday, March 9th, 2018 at 14:40 by Iain Beveridge

Thursday 15th March 00:00 – 02:00

During the above window we will be moving all 1Gbps BT EAD circuits that are directly connected into our Telford DC2 core into Telford DC3 core. Our support team are in the process of contacting any customers that will be moved. Circuits will be switched over one by one and although there is a 2 hour window, downtime for each circuit is anticipated to be less than 5 minutes.

  1. Jamie Smith says:

    This work has now been completed.

Incident: GMS 8.2

Posted: Wednesday, March 7th, 2018 at 15:52 by Jamie Smith

We are currently Investigating an issue that is causing an outage to our GMS 8.2 platform.

  1. Jamie Smith says:

    Engineers are still investigating the root cause of this issue, we are aiming to get this service live again as quick as possible.

    We apologise for any inconvenience

  2. Jamie Smith says:

    This issue has now been fixed, GMS is once again accessible. It may take up to 1 hour for Information to populate

  3. Mark Yardley says:

    We are experiencing residual issues with the GMS platform. Engineers are continuing to investigate.

  4. Jamie Smith says:

    Engineers are still working to resolve the issues currently being experienced with the GMS platform. Updates will be provided when they become available

Incident: telford-dc1.core

Posted: Tuesday, March 6th, 2018 at 13:29 by Jamie Smith

We are currently experiencing a loss of service to telford-dc1.core. Engineers are currently investigating, further updates to follow.

  1. Richard Partridge says:

    Service has now been restored. This incident was caused by failed PSUs which have now been replaced. We apologise for the inconvenience caused.

  2. David Brewis says:

    A report is now available for this incident, which can be found here.

At-Risk: Telford Data Centre Equipment Relocation

Posted: Monday, March 5th, 2018 at 13:59 by Richard Partridge

Monday 12th March 17:00  – Friday 16th March 23:59

During the above window, we will be carrying out equipment relocation work in the Telford Data Centre. No downtime is expected however customers will be notified individually in advance regarding any specific risks to their service as and when work is taking place.

Incident: Mirada Portal

Posted: Monday, March 5th, 2018 at 11:33 by Jamie Smith

Engineers are investigating an issue which is currently rendering the Mirada portal unavailable. Further updates will be provided as and when they become available.