Archive for February 23rd, 2021

Emergency Work: Peterborough (PB1244)

Posted: Tuesday, February 23rd, 2021 at 16:28 by Jamie Smith

Tuesday 23rd February 2021, 19:00 – Tuesday 23rd February 2021, 23:59

During the above window, we will be completing emergency maintenance to upgrade and replace our core router at the above location. This is required in order to resolve the issues we have been experiencing in Peterborough. There will be a small window of downtime as we replace the chassis and migrate services across.

  1. Robin Posadas says:

    Work commencing.

  2. Robin Posadas says:

    Work completed

Incident: Peterborough

Posted: Tuesday, February 23rd, 2021 at 11:02 by david labouchardiere

Following the incident yesterday we are still working on restoring service to the portion of customers who remain impacted in Peterborough. Engineers are continuing to troubleshoot and further updates will be provided in the next hour

  1. david labouchardiere says:

    We are still investigating this issue with our senior agents within the NOC team and will provide further updates in the next hour.

  2. david labouchardiere says:

    Based on NOC troubleshooting we have engaged engineer resources to attend the affected site and carry out further testing. We will provide a further update once we have an ETA for the engineer

  3. david labouchardiere says:

    Engineer resources have been arranged with an ETA of 16:00. We will provide a further update upon the engineers arrival.

  4. Emily Pieniak says:

    Engineer resources have now arrived on-site where investigations have commenced. We will provide further updates in the next hour.

  5. Emily Pieniak says:

    Engineer resource is on-site investigating the physical link between PB1344 and PB1244. We will provide further updates in the next hour

  6. Emily Pieniak says:

    The link between PB1344 and PB1244 remains down where we are still seeing 1 way MAC betwenPB1344 and PB1244. The SFP and fibre on PB1344 and PB1244 link has been re-seated and cleaned.

    We will continue to provide updates in the next hour.

  7. Emily Pieniak says:

    A replacement ASR is on-site which at present is being installed where we are awaiting further feedback from the engineers on-site.

    We will continue to provide updates in the next hour.

  8. Emily Pieniak says:

    SPF swap has taken place at PB1244 where engineers are continuing to work at PB1344 and PB1244.

    We will continue to provide updates in the next hour.

  9. Emily Pieniak says:

    The link between PB1344 and PB1244 remains down. Engineers have attempted multiple optics on both PB1344 and PB1244 where the port still would not come up.

    Next action is for the fault to be logged with Nokia TAC for PB1344.

    We will continue to provide updates within the next 2 hours.

  10. Adam Wilson says:

    Our vendors are dispatching an engineer to replace a suspected faulty card in our PB1344-rtr-1 node.
    ETA is 02:30. A further update will be provided upon the engineer’s arrival.

  11. Adam Wilson says:

    Engineer is on site and about to commence work. Update will follow upon completion of the task.

  12. Adam Wilson says:

    The card has been replaced, and we have collected further diagnostic information. We will confirm operational status once this has been reviewed by our vendor.

  13. Adam Wilson says:

    We believe this issue to now be resolved, and request that any affected users retest their service.
    Please accept our apologies for any inconvenice that may have been caused.