Root Cause Analysis:

Level 1 engineer caused voice mail outage for half of the network.
Forwarded all voice mail calls to one number.
This effectively DOS’d the one number and resulted in a large prime-time outage
When questioned, the Engineer claimed “I was just seeing what that box did. I wasn’t sure so I just put a phone number in.”

Code Snippet:

!
Voicemail Outage

description Don’t remove the IP from this port or shut it down ###
no ip address
shutdown

!
!
1566 Views // November 23, 2015 // @kyzer_davis
More RCA

More RCA

Close
!

The Trunk Killer

description Primary trunk link to edge switch
shutdown

< you session has been disconnected >

!
!
!

Who Needs Email?

description More importantly, when was the last time you wrote and sent real mail?
no idea
postage cost-to-much
mail-users grandparents government credit-card-spam

!
!
!

Lick it to claim it

description The 5 second rule doesn’t often apply to dropped tech
no keepalive
linecode b8zs
yellow generation
no tunnel checksum

!
!
!

A Server is Never Lost, Just Misplaced

description Do we even really know where all our Wireless Access Points are?
no logging
no ip-buffer
no cares-as-long-as-it-works

!
!
!

I am actually impressed…

description USB Port
no ip address
no cdp enable
no common-sense

!
!
Comments

Leave a comment!

Close