Cisco Tips & Tricks

May 7, 2006

Turning the router in to Packet sniffer

Filed under: Access-lists — ciscotips @ 5:43 am

I see lot of posts on the net on troubleshooting of different applications being used on the network. People try to rely on third party sniffers to see what is happening. But do you know we can create a small sniffer script and add to make things lot more easier in troubleshooting. Moreover, Many applications need access through an access control list (ACL) on a router, but you might not know what ports or protocols to allow in the ACL rules. Simply use an access list and the router’s logging function to “sniff” and report what it sees.Take a transparent approach to locking the ACL down to only what is needed. The process takes some time, but is effective and can be used on virtually any interface ACL.

Follow these steps:

1. Discover: Use the router’s ability to log ACL matches in its own buffer in order to catalog the traffic that crosses it. The configuration is the following:

Router (config)# logging buffered 15000 (this creates a large enough buffer to look at locally on the router,or you can configure the router to log the ACL matches to a Syslog server).

Router (config)# access-list 101 permit tcp any gt 0 any gt 0 log

Router (config)# access-list 101 permit udp any gt 0 any gt 0 log

Router (config)# access-list 101 permit icmp any any

Router (config)# access-list 101 permit ip any any log (this entry is a “catch-all”)

Router (config)# interface interfaceRouter (config-if)# ip access-group 101 in

Look at the log by using the show log command from the exec prompt. You should see IP addresses (source and destination), along with the used TCP or UDP ports (in parentheses):

Mar 18 20:05:10.628: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50051) -> 10.2.9.30(15648), 1 packet

Mar 18 20:05:20.697: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50054) ->10.2.9.30(15648), 1 packet

Mar 18 20:05:30.757: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50057) ->10.2.9.30(15648), 1 packet

Mar 18 20:05:40.854: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50060) ->10.2.9.30(15648), 1 packet

Mar 18 20:05:51.006: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50063) ->10.2.9.30(15648), 1 packet

Mar 18 20:06:01.115: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50115) ->10.2.9.30(15648), 1 packet

Mar 18 20:06:10.354: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50118) ->10.2.9.30(15648), 1 packet

Mar 18 20:06:20.423: %SEC-6-IPACCESSLOGP: list 101 permitted tcp 192.168.19.137(50121) ->10.2.9.30(15648), 1 packet

When using earlier IOS versions you can specify permit ip any any log or permit tcp any any log. This showsyou the port numbers in the show log command. However, with later IOS versions, using these permit statements produces a port zero (0) in the show log command, which is why I use statements such as permit TCP any gto any gto log. This produces the TCP port numbers. The same goes for UDP.

In this example, two IP addresses need to communicate, and the destination TCP port is 15648. The source port changes, so I cannot create a static ACL for that port. I can create a TCP ACL that states:

access-list 101 permit tcp host 192.168.19.137 host 10.2.9.30 eq 15648

This should be sufficient for a tight access list. Using this information, I can create a new access list.

2. Notify: Even though we do not expect any connectivity issues, notify those who could be affected by an error or an unexpected condition during this process.

3. Implement: We do not want to interrupt a production environment to make changes. I used this method:

Router (config)# interface interface

Router (config-if)# no ip access-group 101 in(Removes the ACL from active service)

Router (config-if)# exit (I could use Crtl+Z here as well)

Router (config)# exitRouter# ena

Router (config)# no access-list 101 (Now go and delete the ACL.)

If you use “named” access lists, you can edit out individual access-list entries. I use Microsoft Notepad to edit the access list from the configuration by pasting it into the Telnet/SSH session. Next, Iadd the new access list:

Router (config)# access-list 101 permit tcp host192.168.19.137 host 10.2.9.30 eq 15648

Router (config)# access-list 101 permit tcp any gt 0any gt 0 log

Router (config)# access-list 101 permit udp any gt 0any gt 0 log

Router (config)# access-list 101 permit icmp any any

Router (config)# access-list 101 permit ip any any log

Router (config)# interface interface

Router (config-if)# ip access-group 101 in

4. Verify: Use the show access-list command and the show log command to verify that the access list is working.As the more specific access-list entries are added, the more general ones are pushed to the bottom of the list, and eventually the hit counters on the general ACL entries will be zero. Then you can delete those general ACL entries, leaving only the specific rules. The sequence of commands I used is important in retaining a transparent change to a production environment.

Advertisement

7 Comments »

  1. Don’t forget about “debug ip packet detailed”, it’ll take the same access list but log all interfaces, plus you don’t have to reconfig the router!

    BTW, another bit of trivia, you can use numbered acls like named ones to delete individual lines, just pretend it’s a named acl:

    config# ip access-list extended 101
    acl# no deny ip any any

    Love the blog, I’m subscribed to the feed!

    Sean

    Comment by Sean — May 7, 2006 @ 1:36 pm

  2. Sean,

    Spoken like an engineer that’s never touched a production network. I’d have your resume ready if you run that at work.

    Any of you guys know why you have to specify gt 0 to get the port information? (Now THAT’s a bit of trivia for you!)

    Just my 2 cents.

    DirtySanchez

    Comment by DirtySanchez — July 11, 2007 @ 7:59 pm

  3. Check this out – this was done on in a LAB on a L3 Switch with a light load… skip down to the bottom to see the traceback :)

    IP packet debugging is on (detailed)
    lab-3750#
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending broad/multicast, proto=88
    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending full packet, proto=88
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from Vlan1 src 10.200.2.2 dst 224.0.0.10
    9w3d: FIBfwd-proc: Default:224.0.0.0/24 receive entry
    9w3d: FIBipv4-packet-proc: packet routing failed
    9w3d: IP: s=10.200.2.2 (Vlan1), d=224.0.0.10, len 60, rcvd 2, proto=88
    9w3d: IP: s=10.200.2.2 (Vlan1), d=224.0.0.10, len 60, stop process pak for forus packet, proto=88
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending broad/multicast, proto=88
    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending full packet, proto=88
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: %SYS-3-CPUHOG: Task is running for (2097)msecs, more than (2000)msecs (1/1),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-LOGGER_DROPPED: System dropped 209 console debug messages.

    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending broad/multicast, proto=88
    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending full packet, proto=88
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: %SYS-3-CPUHOG: Task is running for (2097)msecs, more than (2000)msecs (0/0),process = Logger.
    -Traceback= 68214C 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-CPUHOG: Task is running for (4194)msecs, more than (2000)msecs (0/0),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-CPUHOG: Task is running for (6291)msecs, more than (2000)msecs (0/0),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-LOGGER_DROPPED: System dropped 246 console debug messages.

    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: %SYS-3-LOGGER_DROPPED: System dropped 20 console debug messages.

    9w3d: FIBipv4-packet-proc: route packet from Vlan1 src 10.200.2.2 dst 224.0.0.10
    9w3d: FIBfwd-proc: Default:224.0.0.0/24 receive entry
    9w3d: FIBipv4-packet-proc: packet routing failed
    9w3d: IP: s=10.200.2.2 (Vlan1), d=224.0.0.10, len 60, rcvd 2, proto=88
    9w3d: IP: s=10.200.2.2 (Vlan1), d=224.0.0.10, len 60, stop process pak for forus packet, proto=88
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    lab-3750#
    9w3d: %SYS-3-CPUHOG: Task is running for (2098)msecs, more than (2000)msecs (3/2),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-LOGGER_DROPPED: System dropped 20 console debug messages.

    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending broad/multicast, proto=88
    9w3d: IP: s=10.200.2.1 (local), d=224.0.0.10 (Vlan1), len 60, sending full packet, proto=88
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    lab-3750#
    lab-3750#
    lab-3750#
    lab-3750#
    lab-3750#
    lab-3750#
    lab-3750#un all
    All possible debugging has been turned off
    lab-3750#
    lab-3750#
    lab-3750#
    9w3d: %SYS-3-CPUHOG: Task is running for (2098)msecs, more than (2000)msecs (0/0),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-CPUHOG: Task is running for (4195)msecs, more than (2000)msecs (0/0),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-CPUHOG: Task is running for (6293)msecs, more than (2000)msecs (2/0),process = Logger.
    -Traceback= 6E4C7C 70BB00 6815C8 681570 683A08 683F40 681678 683900 682134 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-LOGGER_DROPPED: System dropped 276 console debug messages.

    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) src 10.200.2.1 dst 10.0.107.13
    9w3d: FIBfwd-proc: Default:0.0.0.0/0 proces level forwarding
    9w3d: FIBfwd-proc: depth 0 first_idx 0 paths 1 long 0(0)
    9w3d: FIBfwd-proc: try path 0 (of 1) v4-anh-10.200.2.2-Vl1 first short ext 0(-1)
    9w3d: FIBfwd-proc: v4-anh-10.200.2.2-Vl1 valid
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 deag 0 via fib 0 path type attached nexthop
    9w3d: FIBfwd-proc: packet routed to Vlan1 10.200.2.2(0)
    9w3d: FIBipv4-packet-proc: packet routing succeeded
    9w3d: FIBfwd-proc: ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0
    9w3d: FIBfwd-proc: sending link IP ip_pak_table 0 ip_nh_table 65535 if Vlan1 nh 10.200.2.2 uhp 1 deag 0 ttlexp 0 rec 0
    9w3d: FIBipv4-packet-proc: route packet from (local) sr

    Comment by routermonkey — March 20, 2008 @ 7:02 pm

  4. There is some extra trash in my previous post – what I was confirming for Dirty, was if you run “debug ip packet detailed” on a busy PROD router or L3 Switch, you will achieve a state know as 57005 on your router.

    Check it:
    lab-3750#
    9w3d: %SYS-3-CPUHOG: Task is running for (2098)msecs, more than (2000)msecs (0/0),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-CPUHOG: Task is running for (4195)msecs, more than (2000)msecs (0/0),process = Logger.
    -Traceback= 682144 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-CPUHOG: Task is running for (6293)msecs, more than (2000)msecs (2/0),process = Logger.
    -Traceback= 6E4C7C 70BB00 6815C8 681570 683A08 683F40 681678 683900 682134 683278 CC6B48 CC5BB0 CC62F0 CC8354 9F1BF8 9E8FE4
    9w3d: %SYS-3-LOGGER_DROPPED: System dropped 276 console debug messages.

    Comment by routermonkey — March 20, 2008 @ 7:13 pm

  5. You don’t just turn on “debug ip packet detail”… Only an idiot does that. You make an access list specifically defining the traffic you’re looking for, ie

    ip access list extended 105
    pemit tcp host 10.1.1.1 host 10.2.2.2 eq 443
    pemit tcp host 10.2.2.2 eq 443 host 10.1.1.1

    “debug ip packet det 105″

    This will show you SYN’s, SYN/ACK’s, RST’s, ETC… much more detail than logging ACL hits.

    I do this on remote routers all the time in a production network with more than 3000 nodes.

    Than being said, I still wouldn’t do this in the core or an access switch such as a 3750. Get your FATASS up, hook up a cable, set a monitor span, and do a proper sniff.

    Comment by jomama — June 13, 2009 @ 1:17 am

  6. [...] Turning the router in to Packet sniffer May 2006 5 comments 5 [...]

    Pingback by 2010 in review « Cisco Tips & Tricks — January 2, 2011 @ 6:55 am

  7. Umm yeah, I would fire an engineer for blatantly running “debug ip packet detail”.

    Comment by Network Manager — May 27, 2011 @ 7:42 pm


RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Connecting to %s

Theme: Silver is the New Black. Blog at WordPress.com.

Follow

Get every new post delivered to your Inbox.