Planned Work: Broadband Upgrades

Posted: November 23rd, 2018 at 17:03 by David Wheeler

Monday 3rd December 2018 00:00 – 06:00

During the above window broadband users connected via Colindale, Columbo and Kingston interconnects will be disconnected to reconnect via higher capacity interconnects. The time per user to reconnect will usually be less than 10 minutes, if your connection does not re-establish in 10 minutes it may be necessary to reboot your router.

Users on Colindale, Columbo and Kingston interconnects that reconnect before the maintenance will reconnect on the new higher capacity interconnects.

  1. Robin Posadas says:

    This work is now commencing.

  2. Robin Posadas says:

    This work is now complete.

Incident: Vodafone circuits

Posted: November 21st, 2018 at 22:25 by Neil Watson

Our monitoring has alerted us to a number of Vodafone circuits that are currently out of service. Our initial diagnostics indicate that the circuits are related to a single handoff point between Vodafone and us. Our engineers are investigating and are engaged with Vodafone. Further updates will be provided via this site. We apologise to any customers that are impacted and want to reassure you that we are working to return full service as soon as possible.

  1. John Benge says:

    Vodafone have confirmed that an engineer is conducting tests on fibres to ascertain the nature of the outage. We will provide further updates as soon as possible.

  2. John Benge says:

    Vodafone have arranged multiple engineer resources to this issue who are working on the fault. We will provide further updates as soon as possible.

  3. David Brewis says:

    Vodafone engineers are located within the data centre and working to troubleshoot and restore service.

    We will provide the next update by 10:45am

  4. David Brewis says:

    Vodafone engineers have identified a fibre break resulting in the loss of service. Appropriate teams have already been engaged to locate the break and resolve service.

    We will provide the next update by 11:45am

  5. David Brewis says:

    Vodafone field engineers continue to locate the fibre break, spare fibres have been identified to restore a level of service whilst a permanent fix is identified.

    We will provide the next update by 12:45pm

  6. Scott Morgan says:

    We are currently seeing a significant number of circuits reconnecting. Further investigation is ongoing to ensure all remaining services are brought back online.

    Further updates will be provided by 14:15.

  7. Scott Morgan says:

    As part of ongoing investigation into this issue, Vodafone are sending out additional engineering resources to their data centre.

    Vodafone believe the break to be located 43 meters into the fibre handoff, which they are working on to resume full service.

    Further updates will be provided at 15:15.

  8. David Brewis says:

    Engineers at the data centre are continuing to work with Vodafone fibre teams and resolve the second identified fibre break.

    Further updates will be provided by 16:15

  9. David Brewis says:

    Vodafone fibre engineers continue to examine the length of the fibre for further issues impacting service. The Entanet service centre are speaking with Vodafone incident managers to understand anticipated clear time.

    Further updates will be provided by 17:30

  10. David Brewis says:

    Vodafone engineers remain on site tracing the underlying infrastructure so that a permanent fix can be put in place for all affected services. We continue to work with the carrier to expedite the resolution with regular communication.

    Currently the agreed next stage is for engineers to work to determining the exact location for the fibre fault.

    Further updates will be provided by 18:45

  11. David Brewis says:

    We believe service to be restored following the identification of a faulty fibre patch. An incident report will be made available within 5 working days.

    We apologise for any disruption caused, if however you continue to be without service, please contact the service desk at your earliest convenience.

  12. David Brewis says:

    An interim report can be found here, whilst we await a full RFO.

At Risk: Planned Works – Edinburgh

Posted: November 21st, 2018 at 10:40 by Jamie Smith

Friday 30th November 2018 00:01 – 06:00  

During the above window our supplier will be carrying out essential power works to both of our racks in this location. No downtime is expected due to the preventative measures being taken, however all services at this location should be considered at risk for the duration of the window this includes; DSL, Leased lines and Pseudowires terminating at this location.

Incident: Telford Power Outage – services at risk

Posted: November 14th, 2018 at 03:08 by Neil Watson

There is currently a power outage that is affecting our Telford HQ and our datacentres. As a consequence, we are currently running on our back up generator power. All services that are delivered from this location must, therefore, be considered to be at risk. This a mains power failure that is being worked on by the supplier and they have estimated a return in service at approximately 03:30hrs.

  1. Neil Watson says:

    Power has now been restored and has been stable for a short while. We are no longer running on generator power, and therefore the site is considered to be fully operational again.

Planned Work: Broadband Upgrades

Posted: November 13th, 2018 at 19:01 by Steve Lalonde

Tuesday 20th November 2018 00:00 – 06:00

During the above window broadband users connected via Glasgow, Edinburgh and Faraday interconnects will be disconnected to reconnect via higher capacity interconnects.

The time per user to reconnect will usually be less than 10 minutes, if your connection does not reestablish in 10 minutes it may be necessary to reboot your router.

Users on Glasgow, Edinburgh and Faraday interconnects that reconnect before the maintenance will reconnect on the new higher capacity interconnects.

  1. David Wheeler says:

    This work is about to start.

  2. David Wheeler says:

    The work is now completed.

At Risk: Planned Maintenance – Coventry

Posted: November 13th, 2018 at 13:12 by Ming-Yu Hsieh

Thursday 22nd Nov 2018 00:01 – 06:00

During the above maintenance window, we will be integrating Coventry pop into our combined national network.

No down time is expected and all precautions will be taken to avoid any disruption, however during and after this maintenance routing will take different paths.

  1. Ming-Yu Hsieh says:

    This work is now commencing.

  2. Ming-Yu Hsieh says:

    This work is now complete.

Planned Maintenance: Interxion & Telehouse East

Posted: November 13th, 2018 at 11:49 by Gurinder Bansal

Wednesday 21st November 2018 00:00 – 06:00

During the above window we will be completing a planned maintenance to upgrade hardware within telehouse-east4.core & Interxion3.core. No downtime is expected and all precautions will be taken to avoid any disruption, however during this window both sites should be considered at risk.

  1. Gurinder Bansal says:

    This work is now commencing.

  2. Gurinder Bansal says:

    This work is now complete.

Planned Work: Broadband Upgrades

Posted: November 12th, 2018 at 12:04 by Steve Lalonde

Monday 19th November 2018 00:00 – 06:00

During the above window broadband users connected via Bristol and Birmingham interconnects will be disconnected to reconnect via higher capacity interconnects.

The time per user to reconnect will usually be less than 10 minutes, if your connection does not reestablish in 10 minutes it may be necessary to reboot your router.

Users on Bristol and Birmingham interconnects that reconnect before the maintenance will reconnect on the new higher capacity interconnects.

  1. David Wheeler says:

    This work is about to start.

  2. David Wheeler says:

    This work is now complete.

Planned Work: Broadband Upgrades

Posted: October 29th, 2018 at 17:11 by Steve Lalonde

Monday 5th November 2018 22:00 to Tuesday 6th November 2018 02:00

During the above window broadband users connected via Cardiff, Manchester and Nottingham interconnects will be disconnected to reconnect via higher capacity interconnects.

The time per user to reconnect will usually be less than 10 minutes, if your connection does not reestablish in 10 minutes it may be necessary to reboot your router.

Users on Cardiff, Manchester and Nottingham interconnects that reconnect after 30th October 2018 will automatically be reconnected to the high capacity interconnects and will avoid the forced disconnect.

  1. Steve Lalonde says:

    Note: Users on Cardiff, Manchester and Nottingham interconnects can now choose to reconnect to migrate to the higher capacity interconnects.

  2. Steve Lalonde says:

    This work is about to start

  3. Steve Lalonde says:

    This work is now complete.

Emergency Maintenance: columbo.core

Posted: October 23rd, 2018 at 14:08 by Jamie Smith

Wednesday 24th October 03:00– 06:00

During the above window our supplier will be carrying out essential power works to one of our racks in this location. There will be disruption to services at this location, this includes DSL, Leased lines and Pseudowires terminating at this location. Whilst actual downtime is expected to be no more than 1 hour, the full 3 hours may be required to account for any unforeseen issues.

We apologise for the short notice and any inconveniences this may cause

  1. Jamie Smith says:

    Our supplier has advised that this work has had to be rolled back to the previous state due to an unforeseen fault that occurred with the new equipment once Installed. The supplier engineer has advised they will be liaising with the manufacturer to try and ascertain why this fault occurred.

    This work will need to be re-scheduled in due course.

    Apologies for any inconvenience caused by this.