Planned Work: Power Supply Upgrades

Posted: October 15th, 2014 at 09:54 by Steve Lalonde

Upgrades to power supplies at 20 BT exchanges

Contractors will be replacing the UPS and Auto Transfer Switches to the following schedule

  • Mon 20/10/2014 Nottingham
  • Tue 21/10/2014 Sheffield
  • Wed 22/10/2014 Leeds
  • Thu 23/10/2014 Newcastle
  • Fri 24/10/2014 Peterborough
  • Mon 27/10/2014 Manchester
  • Tue 28/10/2014 Preston
  • Wed 29/10/2014 Edinburgh
  • Thu 30/10/2014 Glasgow
  • 3/11/2014 Bristol
  • 4/11/2014 Cardiff
  • 5/11/2014 Birmingham
  • 6/11/2014 Wolverhampton
  • 7/11/2014 Milton Keynes
  • Mon 10/11/2014 Slough
  • Tue 11//11/2014 Stepney Green
  • Wed 12/11/2014 Colindale
  • Thu 13/11/2014 Columbo
  • Fri 14/11/2014 Kingston
  • Mon 17/11/2014 Faraday

The work is planned from 08:00 – 18:00 each day.

No downtime is expected, there is a small risk of power loss if the building power fails while the UPS are changed.

  1. Steve Lalonde says:

    Work at Nottingham was completed successfully. Apologies for the delayed notification.

  2. Steve Lalonde says:

    Work at Sheffield has been completed. Additional work is required to restore from temporary power feed and will be notified separately.

  3. Steve Lalonde says:

    Yesterdays work at Leeds was completed, due to illness the contractors are rescheduling the remaining 17 sites. We will update the revised plan as soon as we can.

Outage: Sheffield

Posted: October 14th, 2014 at 16:16 by David Derrick

We have lost connectivity to our equipment in Sheffield. Other traffic will reroute round the outage but services originating or terminating in Sheffield are currently down.

More details will follow when we know what has happened.

  1. David Derrick says:

    Service has been restored, the cause appears to be failure of power to the whole rack. Investigations are continuing into the root cause.

Planned Maintenance: Sonicwall GMS

Posted: October 14th, 2014 at 11:57 by David Derrick

Wed 22 October 2014 10:30-12:30 BST

During the above window the management system for our Sonicwalls will be upgraded. During this time, customers will be unable to view reports and our support staff will be unable to make changes.

The operation of the appliances themselves will be unaffected and urgent changes can still be made by the NOC team.

Since this is only a point release no loss of data is expected but full backups will be taken should we need to roll back.

  1. David Derrick says:

    This work is complete and GMS access for customers has been restored.

Internal Systems Issues

Posted: October 9th, 2014 at 14:48 by Wayne Hawtin

We are currently experiencing issues affecting access to many of our internal systems. This failure will impact the efficiency of our teams in being able to deal with your queries as access to certain information is currently unavailable. We ask that you please bear with us during this period and request your patience when dealing with the teams.

In addition to this partners will not be able to access our Synergi Portal.

We are working to rectify the situation as quickly as possible and will make a further post when systems are restored.

  1. Wayne Hawtin says:

    Service has now been restored and we apologise for any inconvenience caused.

Telehouse-east.core.enta.net

Posted: September 30th, 2014 at 20:15 by Steve Lalonde

We are currently investigating a problem with telehouse-east.core.enta.net

Further updates will follow.

  1. Steve Lalonde says:

    We have stabilised telehouse-east.core, investigations are continuing.

  2. Wayne Hawtin says:

    After a further incident that occurred at around 04:20 this morning was stabilised, service has remained stable since, however the issue is still under investigation and further updates will be provided when they become available.

  3. Wayne Hawtin says:

    An incident report has been made available for this issue. It can be found here.

Power Maintenance: Interxion, London

Posted: September 18th, 2014 at 15:22 by David Derrick

Saturday 27 and Sunday 28 September 2014
Following conversations with Interxion management we have been advised that the rescheduled intrusive power upgrade is likely to take place over the above weekend with the non-critical feed being done on Saturday 27 and the critical feed being done on Sunday 28. Please note this is subject to official confirmation and we will post an update with full details when we receive the formal notice from Interxion.

  1. David Derrick says:

    Interxion have now confirmed the schedule for this weekend.

    On Saturday 27 September between 08:00 and 19:30 BST, the current non-critical feed will be upgraded to the new UPS B feed.

    On Sunday 28 September between 08:00 and 19:30 BST the current critical feed will be upgraded to the new UPS A feed.

    In both cases the power is expected to be down for a minimum of 1.5 hours but may be longer. When the power is restored, engineers will check the breakers on our feeds in case any trip when the power returns.

    Entanet’s equipment is all dual fed so we do not expect any outage to our services, however the site should be considered at risk during the maintenance windows.

  2. David Derrick says:

    Interxion have advised that today’s power work has been completed.

  3. David Derrick says:

    Interxion have advised that all the power upgrade work has now been completed.

Power Maintenance: Interxion, London

Posted: September 17th, 2014 at 11:34 by David Derrick

Saturday 20 September 2014 08:00 to 17:30 BST

Today we have received notification that Interxion will be performing the previously postponed intrusive power upgrade work on both critical and non-critical feeds during the above maintenance window.

The following is the notice received:
“All upgrade works will be undertaken by specialist contractors under the direct supervision of Interxion staff.

The works below are planned for Saturday 20th September. The upgrade works will consist of the non-critical electrical supplies being transferred onto new UPS system (feed ‘B’.) Following satisfactory confirmation of the transfer of the Non critical electrical supplies, we plan to transfer the critical loads onto new UPS system (feed ‘A’). Dual corded equipment if wired correctly should not be impacted. However, single corded equipment WILL be impacted.”

Entanet equipment has already been moved to dual fed supplies so will not be affected although the site should be considered at risk during the maintenance window. Colocated customers with single fed equipment will however be affected.

  1. David Derrick says:

    We have been advised that Interxion are postponing the work planned for this weekend. We will post details of the new schedule when we have more details.

Planned Maintenance: Equinix Slough – Installation of new core router.

Posted: September 11th, 2014 at 09:47 by Ming-Yu Hsieh

21:00 Monday 22nd Sept 2014 – 02:00 Tuesday 23rd Sept 2014

During the above window we will be installing additional core router in Equinix Slough.

The new router will be connected to the existing router and core links will be moved to the new routers. Where a core link is being moved traffic will be switched to alternate paths before the link is moved.

 

 

  1. Ming-Yu Hsieh says:

    This work is now complete.

Virgin Media Leased Lines

Posted: August 27th, 2014 at 10:06 by Richard Partridge

We are currently aware of an incident on Virgin Media’s network which is causing a loss of service to several Virgin Media provided leased lines.

Virgin Media are currently investigating and updates will be provided as and when they become available.

  1. Richard Partridge says:

    Virgin Media have identified a problem with one of their core routers in Telehouse and they are continuing their investigation although no ETR is available as of yet.

  2. Richard Partridge says:

    Service appears to have been restored and stable for approximately 10 minutes now however no further information is available from Virgin Media as of yet. The affected circuits should be considered at risk until further information on this incident is available.

  3. Richard Partridge says:

    Service has remained stable and the incident is now considered closed. We are awaiting an incident report from Virgin Media which should be made available to us next week.

Power blip at Telford HQ

Posted: August 26th, 2014 at 16:55 by Neil Watson

We have recently lost power at our Telford Headquarters for approximately 5 minutes. This was due to a high voltage fault in the local area that affected 170 properties. During the failure our backup generators took the load and services remained in operation as normal. Power has now been restored and no further issues are anticipated by the power distributors.

  1. Neil Watson says:

    We have had a further incident of power loss and are again running on back up generator. Sixteen properties remain without power in the area and the expected time for restoration is 21:00hrs.