Archive for the ‘Uncategorized’ Category

pwanstack.wolv6.core

Posted: Tuesday, December 17th, 2019 at 11:13 by Iain Beveridge

We are currently experiencing intermittent loss of connectivity to the above device, some PWAN customers with equipment located within our suite in VeloxServ may have experienced a short outage. Remote hands at the DC are currently investigating and we will aim to provide an update shortly.

  1. From the first drop at around 10:40 we have seen 2 subsequent drops. Upon initial investigation it does not appear to be an issue with the physical cabling causing a link loss. We are therefore going to perform an emergency reload of the switch stack to try and rectify the issue.

  2. The switch stack has now reloaded and connectivity should start to be restored. Engineers are monitoring closely and continuing to investigate a possible cause for the initial losses of connectivity.

  3. Connectivity has been lost again after the emergency reload. Work is continuing to try and bring back stability to the switch stack. We will provide further updates as they become available.

  4. Work is continuing, however the longest period of stability since the initial outage this morning has just been observed. Our engineers may have found the possible cause however we will continue to provide updates until we are certain the issue has been fully resolved.

  5. We now believe this incident to be resolved. Investigations are still ongoing as to the root cause, which may result in additional works being required. These works (if required) will be scheduled and conducted as per normal change process.

  6. Jamie Smith says:

    Between the hours of 17:00 – 18:00 we will be carrying out emergency works to restore resiliency to this device by re-introducing the uplinks back into an ether-channel. This work is non service affecting however all PWAN services and PWAN colocation in this location should be considered at risk for the duration of this window.

  7. Jamie Smith says:

    This work is now commencing

  8. Jamie Smith says:

    This work has now been completed.

Resolved incident: VoIP outbound calls

Posted: Thursday, September 26th, 2019 at 17:23 by david labouchardiere
We are aware of an incident earlier this morning caused by our anti-fraud measures briefly blocking outbound calls. This issue has been resolved and we are making changes to ensure this is not repeated.
Apologies for any inconvenience caused.

Planned Maintenance 20th August.

Posted: Tuesday, August 20th, 2019 at 15:48 by Adam Heath

As part of our ongoing drive to improve the new VoIP platform, we shall be carrying out essential maintenance to our VoIP service this evening, which will necessitate a short period of down-time.

The outage window will occur on Tuesday 20 August from 21:00 to 21:30 hours.

 

Kindest regards

 

 

Incident: VoIP calls

Posted: Wednesday, August 7th, 2019 at 14:13 by david labouchardiere

We are currently aware of an issue affecting calls on the Unify platform. Engineers are currently investigating, updates to follow as soon as available.

We apologise for any inconvenience caused.

  1. david labouchardiere says:

    We can confirm service has now been restored to the platform. Please ask any affected customers to reboot their equipment if they continue to experience issues.

    We apologise for any inconvenience caused.

Incident: VoIP calls

Posted: Wednesday, July 31st, 2019 at 10:25 by david labouchardiere

We are currently aware of an issue affecting calls on the Unify platform. The issue should now be resolved so we would request affected handsets are rebooted prior to retesting.

We apologise for any inconvenience caused.

Incident – Power Loss

Posted: Sunday, July 14th, 2019 at 05:02 by Adam Heath

We have just experienced a loss of power to the Telford Office . Generator and UPS protection kicked in as expected however some internal systems remain offline.  This has been reported and is part of a bigger power-cut affecting multiple areas throughout the Telford postcodes.

This page will be updated as this incident progresses.

  1. John Hope says:

    As of 5:45 power has been restored.

    We are awaiting confirmation that all power services are returned by the suppliers.

  2. John Hope says:

    Our Suppliers have confirmed that this issue has now been resolved.

    We apologise for any inconvenience caused.

Incident: L2TP broadband

Posted: Tuesday, June 25th, 2019 at 14:05 by david labouchardiere

We are currently aware of an issue affecting authentication for L2TP broadband circuits. Our engineers are working on the issue and further updates should be provided in the next hour.

We apologise to any customers that are impacted and want to reassure you that we are working to return full service as soon as possible.

  1. david labouchardiere says:

    Our NOC engineers have resolved an issue with the radius database and we can see services are now reconnecting. Please ask any affected customers to power cycle their router if they are still offline.
    We apologise for the inconvenience this may have caused.

Incident: Telecity outage (Resolved)

Posted: Wednesday, June 12th, 2019 at 00:29 by Adam Heath

We experienced  an issue with connections through our Telecity Hex affecting users on TalkTalk.  This outage lasted around 2 minutes, the cause of which is under investigation. Further updates will be provided shortly

We apologise to any customers that were impacted.

  1. John Hope says:

    We have confirmed that this outage was due to 3rd parties performing planned maintenance which required the restart of NTE’s. all services should be restored

Incident: Talk Talk Circuits

Posted: Friday, May 24th, 2019 at 13:29 by Jonathan Clarke

We have been advised by Talk Talk that a number of their circuits are down in the Northern Ireland area. We are currently speaking with suppliers for further investigation. Further updates will be provided on an hourly basis.

  1. Jonathan Clarke says:

    Suppliers have declared the incident as a major service outage. Talk Talk’s incidents team are still working towards a resolution and we will update upon receipt of further updates.

  2. Jonathan Clarke says:

    Suppliers have advised an engineer was dispatched to the affected network to investigate further. The engineer who attended identified the reason for the disruption to service. BT Openreach has now marked this major service outage as an MBORC (Matters Beyond Our Reasonable Control). This is due to a third party damaging fibre cables. Replacement cabling has been ordered by Openreach, they have requested authorities for traffic management to permit them to dig.

    Further updates will be provided as they are available.

  3. John Benge says:

    Our supplier has confirmed that services were fully restored overnight. The disruption to service was caused by a 3rd party breaking BT Openreach fibre on the A6 near Antrim. The fibre was pulled and respliced. All affected services should now be restored.

Incident: Virgin Media outage

Posted: Tuesday, May 21st, 2019 at 14:11 by david labouchardiere

We are currently aware of a number of Virgin Media circuits which have lost connectivity. We have raised this with the supplier to investigate as a matter of urgency. Further updates will be provided on an hourly basis.

  1. David Brewis says:

    Following investigations we believe this incident to be resolved. If you are still experiencing a loss of service following rebooting your devices please call into the helpdesk.

    We apologise for any disruption caused by this incident.