Octet

An automated vty ACL change locks the NOC out of 72 switches

IncidentExpert

The ticket

A pipeline is pushing a new standard vty ACL to 300 access switches through Ansible, with save_when: modified. Fifteen minutes in, the NOC reports that they cannot SSH to any switch the job has touched. Monitoring still polls the switches over SNMP and user traffic is fine. The job is still running.

RUN1CI runner 10.0.60.0/24JUMP1NOC jump 10.0.50.0/24CORE1ASW1Changed and locked outASW300Not yet changed

Step 1 of 4

What is your first action?