How to troubleshooting HW FIB on ASR9k | PBTS/TE

Problem Description

Follow Topology

 

 10.200.0.24               10.200.0.26    10.200.0.32
   +------+      +------+     +------+     +------+
   |XiAn  |      | SZ   |     |HKBR  |     |Canada|
   |Huawei+------+      +-----+ASR9k +-----+ASR9k |
   +------+      +------+     +------+     +------+

For the issue, HuaWei is Head, asr9k should mid and end node. And Huawei found they put the traffics to Canada by LDP label, not TE label. So traffics should arrive to HK ASR9k by LDP label, then forwarding by LDP too from HK ASR9k to Canada. That not match normal scenario.

For normal scenario, should use TE label from head to end. And after Huawei put traffics to TE LSP, the issue will recovery to normal. Refer to why Huawei send traffics by LDP, that should their issue, will fix in future by them, but even if to do that, 9k shouldn’t drop packets. We need find whether packets drop at 9k and due to label issue first. Now set up test environment in customer site. waiting update.

Resolution

 

For the issue, after discussed with DE, we found the root reason. As our design, all traffics should punt to different TE by PBTS, and all TE take different forward-class. Then traffics should forward by rsvp label swap in BR devices. Refer to rsvp label, no any PBTS/forward-class concept, that only forward. As follow pic:

But due to Huawei abnormal behaviour, cause packets forward by LDP label. As you saw, packets can arrived HKBR, but drop at input NP: RSV_DROP_MPLS_NRLDI_NO_MATCH, as follow pic:

Why our ASR9k drop the packets, there are any different? When packets arrive ASR9k, will check LFIB that two path(because test bed only have 2 tunnel) point to Canada. and take forward-class. But the port face to P, so no any PBTS, so traffics couldn’t punt to those tunnel, so couldn’t complete reprogramming, and drop the packets:

Follow HW LFIB analyzing when use LDP label on HKBR2

RP/0/RSP0/CPU0:A07-A9K-HK#sh mpls for
Wed Nov 11 09:47:28.385 Beijing
Local  Outgoing    Prefix             Outgoing     Next Hop        Bytes       
Label  Label       or ID              Interface                    Switched    
------ ----------- ------------------ ------------ --------------- ------------
......         
16019  Pop         10.200.0.32/32     tt1501       10.200.0.32     0           
       Pop         10.200.0.32/32     tt1505       10.200.0.32     0           
    
RP/0/RSP0/CPU0:A07-A9K-HK#sh mpls traffic-eng forwarding
Wed Nov 11 09:49:04.597 Beijing
P2P tunnels:

Tunnel ID                  Ingress IF     Egress IF      In lbl  Out lbl Backup 
-------------------------- -------------- -------------- ------- ------- -------
10.200.0.32 1261_28             Te0/0/1/0      Te0/0/0/1 16035   32887   unknown
10.200.0.32 1265_28             Te0/0/1/0      Te0/0/0/1 16036   32913   unknown
10.200.0.12 102_56598           Te0/0/0/1      Te0/0/1/0 16024   3       unknown
10.200.0.12 202_56599           Te0/0/0/1      Te0/0/1/0 16025   3       unknown
10.200.0.24 102_15278           Te0/0/0/1      Te0/0/1/0 16022   3       unknown <<<
10.200.0.24 202_15279           Te0/0/0/1      Te0/0/1/0 16023   3       unknown <<<
10.200.0.26 1261_3                      -      Te0/0/0/1 16033   32900   unknown
10.200.0.26 1265_3                      -      Te0/0/0/1 16034   32912   unknown
10.200.0.26 1501_3                      -      Te0/0/1/0 16037   3       unknown
10.200.0.26 1505_3                      -      Te0/0/1/0 16038   3       unknown

Displayed 4 tunnel heads, 11 label P2P rewrites
Displayed 0 tunnel heads, 0 label P2MP rewrites
RP/0/RSP0/CPU0:A07-A9K-HK#
RP/0/RSP0/CPU0:A07-A9K-HK#
RP/0/RSP0/CPU0:A07-A9K-HK#sh mpls for labels 16019 hardware ingress detail lo 0/0/cpu0
Wed Nov 11 09:52:26.136 Beijing
Local  Outgoing    Prefix             Outgoing     Next Hop        Bytes       
Label  Label       or ID              Interface                    Switched    
------ ----------- ------------------ ------------ --------------- ------------
16019  Pop         10.200.0.32/32     tt1501       10.200.0.32     N/A         
     Updated Nov 11 03:30:53.643
     Version: 46, Priority: 1
     MAC/Encaps: 14/14, MTU: 1500
     Label Stack (Top -> Bottom): { Imp-Null Imp-Null }
     Packets Switched: 0

       Pop         10.200.0.32/32     tt1505       10.200.0.32     N/A         
     Updated Nov 11 03:30:53.643
     MAC/Encaps: 14/14, MTU: 1500
     Label Stack (Top -> Bottom): { Imp-Null Imp-Null }
     Packets Switched: 0

LEAF - HAL pd context : 
 sub-type : MPLS, ecd_marked:0, has_collapsed_ldi:0, collapse_bwalk_required:0, ecdv2_marked:0
Leaf H/W Result:

Leaf H/W Result on NP:0

    Raw Data0: 0x11050805 98030000 00000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000
    cb0
                 vpn_special: 0                vc_label: 0
                  evpn_label: 0                   match: 1
                        rsvd: 0                   valid: 1

    cb1
      p2mp_ip_lookup: 0
             p2mp_or_tp_wrap: 0                      tp: 0
                    igp_pref: 1               recursive: 0
               non_recursive: 1    

    cb2
          flow_label_dispose: 0                      tp: 0
          receive_entry_type: 0           vc_label_vpws: 0
                         fwd: 1    control_word_enabled: 0
                 imp_ttl_255: 0               recursive: 0

               ecmp_size: 5

    nr_fwd_entry
                   nrldi_ptr: 0x980300    
                 vpn_key: 0
               stats_ptr: 0
         ecmp_stats_base: 0

nrLDI eng ctx:
     flags: 0x10501, proto: 2, npaths: 0, nbuckets: 2    ldi_tbl_idx: 0x37c, ecd_ref_cft: 0
pbts_ldi_tbl_idx: 0x398 

 PBTS NR-LDI H/W Result for path 0 [Common to all NPs: index: 0x398 (BE)] << forward-class 1

    Raw Data0: 0x31060001 00000098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x1     nr_ldi_base : 0x0 (LE)
pbts_ldi_base: 0x980300 (LE)

 PBTS NR-LDI H/W Result for path 1 [Common to all NPs: index: 0x399 (BE)] << forward-class 2

    Raw Data0: 0x31060003 7c030098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x3     nr_ldi_base : 0x7c0300 (LE) << link to nr_ldi patch, data revers, should 0x00037c 
pbts_ldi_base: 0x980300 (LE)

 PBTS NR-LDI H/W Result for path 2 [Common to all NPs: index: 0x39a (BE)] << forward-class 3

    Raw Data0: 0x31060003 7d030098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x3     nr_ldi_base : 0x7d0300 (LE) << same above, should 0x00037d
pbts_ldi_base: 0x980300 (LE)

 PBTS NR-LDI H/W Result for path 3 [Common to all NPs: index: 0x39b (BE)]

    Raw Data0: 0x31060001 00000098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x1     nr_ldi_base : 0x0 (LE)
pbts_ldi_base: 0x980300 (LE)

 PBTS NR-LDI H/W Result for path 4 [Common to all NPs: index: 0x39c (BE)]

    Raw Data0: 0x31060001 00000098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x1     nr_ldi_base : 0x0 (LE)
pbts_ldi_base: 0x980300 (LE)

 PBTS NR-LDI H/W Result for path 5 [Common to all NPs: index: 0x39d (BE)]

    Raw Data0: 0x31060001 00000098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x1     nr_ldi_base : 0x0 (LE)
pbts_ldi_base: 0x980300 (LE)

 PBTS NR-LDI H/W Result for path 6 [Common to all NPs: index: 0x39e (BE)]

    Raw Data0: 0x31060001 00000098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x1     nr_ldi_base : 0x0 (LE)
pbts_ldi_base: 0x980300 (LE)

 PBTS NR-LDI H/W Result for path 7 [Common to all NPs: index: 0x39f (BE)]

    Raw Data0: 0x31060001 00000098 03000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000    PBTS LDI:
        ecmp size       : 0x1     nr_ldi_base : 0x0 (LE)
pbts_ldi_base: 0x980300 (LE)

NR-LDI H/W Result for path 0 [NP Id: 0 index: 0x37c (BE)] << 0x7c0300

    Raw Data0: 0x111a00ff 05000000 00000000 0003e931
    Raw Data1: 0x00004000 0001600b 61600000 00000000
    ldi_resolve_control_byte0:
                         bvi: 0                reserved: 0
                       match: 1                   valid: 1
      txadj_internal: 0
    ldi_resolve_control_byte1: 
                        mldp: 0          default_action: 1
                      rx_adj: 0            te_IpFrr_adj: 1
               label_1_valid: 0           label_2_valid: 0
           local_label_valid: 1     ldpBkup_label_valid: 0
    ldi_resolve_control_byte2: 
                  pwhe_nrldi: 0                   spare: 0
                ipldp_FRR_TE: 0                     bvi: 0
    np_bit_map: 0xff
    label_stats_index: 0x600b61

        igp_local_label:
                   label_msb: 1001               label_lsb: 3
                         exp: 0                     eos: 1 << not bottom label

        output_label:
                   label_msb: 0               label_lsb: 4
                         exp: 0                     eos: 0 << bottom label
    Adj (te_nh):
               te_nh_adj_ptr: 0x500 (LE)

        te_nh_control:
                    reserved: 0        doNotIncStatsIng: 0
                isMPinNR_LDI: 0             uturn_check: 0

        backup_LDP_label:
                   label_msb: 0(null)                         exp: 0(null)                 eos: 0

        PQ_label:
                       label: 0(null)                         exp: 0                     eos: 0

NR-LDI H/W Result for path 1 [NP Id: 0 index: 0x37d (BE)] << 0x7d0300

    Raw Data0: 0x111a00ff 07000000 00000000 0003e931
    Raw Data1: 0x00004000 0001700b 61a00000 00000000
    ldi_resolve_control_byte0:
                         bvi: 0                reserved: 0
                       match: 1                   valid: 1
      txadj_internal: 0
    ldi_resolve_control_byte1: 
                        mldp: 0          default_action: 1
                      rx_adj: 0            te_IpFrr_adj: 1
               label_1_valid: 0           label_2_valid: 0
           local_label_valid: 1     ldpBkup_label_valid: 0
    ldi_resolve_control_byte2: 
                  pwhe_nrldi: 0                   spare: 0
                ipldp_FRR_TE: 0                     bvi: 0
    np_bit_map: 0xff
    label_stats_index: 0x700b61

        igp_local_label:
                   label_msb: 1001               label_lsb: 3
                         exp: 0                     eos: 1

        output_label:
                   label_msb: 0               label_lsb: 4
                         exp: 0                     eos: 0
    Adj (te_nh):
               te_nh_adj_ptr: 0x700 (LE)

        te_nh_control:
                    reserved: 0        doNotIncStatsIng: 0
                isMPinNR_LDI: 0             uturn_check: 0

        backup_LDP_label:
                   label_msb: 0(null)                         exp: 0(null)                 eos: 0

        PQ_label:
                       label: 0(null)                         exp: 0                     eos: 0

TE-NH eng ctx:
  flags: 0x402, te_nh: 0x5, path_ss: 0, rx_adj : 0x19 tx_adj: 0x28e, bkup_te_nh: 0 
stats_ptr : 
0: 0x530157, 1: 0x53014a, 2: 0, 3: 0
4: 0, 5: 0, 6: 0, 7: 0 
IPv6 tenh :0
 
 TE-NH H/W Result for 1st NP:0 (index: 0x5 (BE)):

    Raw Data0: 0x51000003 ea500000 00b80a61 0000008e
    Raw Data1: 0x02000000 19000000 00000000 00000000
    cb0
                       spare: 0          default_action: 1
           backup_indication: 0                   match: 1
                        rsvd: 0                   valid: 1
    cb1
                    spare_cb: 0              tp_path_ss: 0
    te_nh_incomplete: 0
          tunnel_over_tunnel: 0                   spare: 0
    cb2
                       spare: 0        te_nh_incomplete: 0
                    spare_cb: 0
    TE_local_label:
                       label: 16037 << HKBR2 TE local label 
                         exp: 0                     eos: 0
    TE_tunnel_label:
                       label: 0
                         exp: 0                     eos: 0
         te_nh_stats_ptr: 0xb80a61
    merge_point_label:
                       label: 0
                         exp: 0                     eos: 0
              tx_adj_ptr: 0x8e0200 (LE)
            bu_te_nh_ptr: 0x0 (LE)
              rx_adj_ptr: 0x190000 (LE)
    

 RX H/W Result for 1st NP:0 (index: 0x19 (BE)):

    Raw Data0: 0x91000000 00000060 040002c0 04000000
    adj_resolve_control_byte0
                       match: 1                   valid: 1
                  iptunl_adj: 0
                 remote_rack: 0

    adj_resolve_control_byte1
                    adj_down: 0                mgscp_en: 0
              rx_lag_hash_en: 0              rx_lag_adj: 0
                        pwhe: 0    
    adj_resolve_control_byte2
                  rx_lag_adj: 0            rx_adj_null0: 0
                 rp_destined: 0                 rx_punt: 0
                     rx_drop: 0
    sfp/vqi         : 0x60 << can check by "show controller pm inter ten x/x/x/x"
    egress np port  : 0x400
    if_handle       : 0x40002c0

 TX H/W Result for NP:0 (index: 0x28e (BE)):

    Raw Data0: 0x91040000 0600dc05 00000000 00000000
    Raw Data1: 0x10f31138 ad600000 00000000 00000000
    adj_resolve_control_byte0
                    reserved: 0       egr_uidb_internal: 1
                       match: 1                   valid: 1
                  iptunl_adj: 0
    adj_resolve_control_byte1
                tx_adj_null0: 0                     tx_punt: 0                 tx_drop: 0
              default_action: 1                        pwhe: 0                   spare: 0
    adj_resolve_control_byte2
                        pwhe: 0                       spare: 0                spare_cb: 0
    flags
        gre_adj         : 0
                 pwhe_cw: 0    
    uidb_index      : 0x600 (LE)
    l3_mtu          : 1500
    adj_stats_index : 0x0
    dest_mac        : 0x10f3.1138.ad60
    ether reserved  : 0000000000000000

 TX H/W Result for NP:1 (index: 0x28e (BE)):

    Raw Data0: 0x91040000 0600dc05 18006100 00000000
    Raw Data1: 0x10f31138 ad600000 00000000 00000000
    adj_resolve_control_byte0
                    reserved: 0       egr_uidb_internal: 1
                       match: 1                   valid: 1
                  iptunl_adj: 0
    adj_resolve_control_byte1
                tx_adj_null0: 0                     tx_punt: 0                 tx_drop: 0
              default_action: 1                        pwhe: 0                   spare: 0
    adj_resolve_control_byte2
                        pwhe: 0                       spare: 0                spare_cb: 0
    flags
        gre_adj         : 0
                 pwhe_cw: 0    
    uidb_index      : 0x600 (LE)
    l3_mtu          : 1500
    adj_stats_index : 0x180061
    dest_mac        : 0x10f3.1138.ad60
    ether reserved  : 0000000000000000

TE-NH eng ctx:
  flags: 0x402, te_nh: 0x7, path_ss: 0, rx_adj : 0x19 tx_adj: 0x28e, bkup_te_nh: 0 
stats_ptr : 
0: 0x530161, 1: 0x53014c, 2: 0, 3: 0
4: 0, 5: 0, 6: 0, 7: 0 
IPv6 tenh :0
 
 TE-NH H/W Result for 1st NP:0 (index: 0x7 (BE)):

    Raw Data0: 0x51000003 ea600000 00080b61 0000008e
    Raw Data1: 0x02000000 19000000 00000000 00000000
    cb0
                       spare: 0          default_action: 1
           backup_indication: 0                   match: 1
                        rsvd: 0                   valid: 1
    cb1
                    spare_cb: 0              tp_path_ss: 0
    te_nh_incomplete: 0
          tunnel_over_tunnel: 0                   spare: 0
    cb2
                       spare: 0        te_nh_incomplete: 0
                    spare_cb: 0
    TE_local_label:
                       label: 16038 << HKBR2 TE local label
                         exp: 0                     eos: 0
    TE_tunnel_label:
                       label: 0
                         exp: 0                     eos: 0
         te_nh_stats_ptr: 0x80b61
    merge_point_label:
                       label: 0
                         exp: 0                     eos: 0
              tx_adj_ptr: 0x8e0200 (LE)
            bu_te_nh_ptr: 0x0 (LE)
              rx_adj_ptr: 0x190000 (LE)
    

 RX H/W Result for 1st NP:0 (index: 0x19 (BE)):

    Raw Data0: 0x91000000 00000060 040002c0 04000000
    adj_resolve_control_byte0
                       match: 1                   valid: 1
                  iptunl_adj: 0
                 remote_rack: 0

    adj_resolve_control_byte1
                    adj_down: 0                mgscp_en: 0
              rx_lag_hash_en: 0              rx_lag_adj: 0
                        pwhe: 0    
    adj_resolve_control_byte2
                  rx_lag_adj: 0            rx_adj_null0: 0
                 rp_destined: 0                 rx_punt: 0
                     rx_drop: 0
    sfp/vqi         : 0x60
    egress np port  : 0x400
    if_handle       : 0x40002c0

 TX H/W Result for NP:0 (index: 0x28e (BE)):

    Raw Data0: 0x91040000 0600dc05 00000000 00000000
    Raw Data1: 0x10f31138 ad600000 00000000 00000000
    adj_resolve_control_byte0
                    reserved: 0       egr_uidb_internal: 1
                       match: 1                   valid: 1
                  iptunl_adj: 0
    adj_resolve_control_byte1
                tx_adj_null0: 0                     tx_punt: 0                 tx_drop: 0
              default_action: 1                        pwhe: 0                   spare: 0
    adj_resolve_control_byte2
                        pwhe: 0                       spare: 0                spare_cb: 0
    flags
        gre_adj         : 0
                 pwhe_cw: 0    
    uidb_index      : 0x600 (LE)
    l3_mtu          : 1500
    adj_stats_index : 0x0
    dest_mac        : 0x10f3.1138.ad60
    ether reserved  : 0000000000000000

 TX H/W Result for NP:1 (index: 0x28e (BE)):

    Raw Data0: 0x91040000 0600dc05 18006100 00000000
    Raw Data1: 0x10f31138 ad600000 00000000 00000000
    adj_resolve_control_byte0
                    reserved: 0       egr_uidb_internal: 1
                       match: 1                   valid: 1
                  iptunl_adj: 0
    adj_resolve_control_byte1
                tx_adj_null0: 0                     tx_punt: 0                 tx_drop: 0
              default_action: 1                        pwhe: 0                   spare: 0
    adj_resolve_control_byte2
                        pwhe: 0                       spare: 0                spare_cb: 0
    flags
        gre_adj         : 0
                 pwhe_cw: 0    
    uidb_index      : 0x600 (LE)
    l3_mtu          : 1500
    adj_stats_index : 0x180061
    dest_mac        : 0x10f3.1138.ad60
    ether reserved  : 0000000000000000

 

Follow HW LFIB analyzing when use RSVP label on HKBR2

RP/0/RSP0/CPU0:A07-A9K-HK#sh mpls traffic-eng forwarding
Wed Nov 11 15:37:38.577 Beijing
P2P tunnels:

Tunnel ID                  Ingress IF     Egress IF      In lbl  Out lbl Backup 
-------------------------- -------------- -------------- ------- ------- -------
10.200.0.32 1261_28             Te0/0/1/0      Te0/0/0/1 16035   32887   unknown
10.200.0.32 1265_28             Te0/0/1/0      Te0/0/0/1 16036   32913   unknown
10.200.0.12 102_56598           Te0/0/0/1      Te0/0/1/0 16024   3       unknown
10.200.0.12 202_56599           Te0/0/0/1      Te0/0/1/0 16025   3       unknown
10.200.0.24 102_15278           Te0/0/0/1      Te0/0/1/0 16022   3       unknown
10.200.0.24 202_15279           Te0/0/0/1      Te0/0/1/0 16023   3       unknown
10.200.0.26 1261_3                      -      Te0/0/0/1 16033   32900   unknown
10.200.0.26 1265_3                      -      Te0/0/0/1 16034   32912   unknown
10.200.0.26 1501_3                      -      Te0/0/1/0 16037   3       unknown
10.200.0.26 1505_3                      -      Te0/0/1/0 16038   3       unknown

Displayed 4 tunnel heads, 11 label P2P rewrites
Displayed 0 tunnel heads, 0 label P2MP rewrites

RP/0/RSP0/CPU0:A07-A9K-HK#sh mpls forwarding labels 16022 hardware ingress detail location 0/0/cpu0
Wed Nov 11 15:39:05.928 Beijing
Local  Outgoing    Prefix             Outgoing     Next Hop        Bytes       
Label  Label       or ID              Interface                    Switched    
------ ----------- ------------------ ------------ --------------- ------------
16022  Pop         102                Te0/0/1/0    192.168.0.10    N/A         
     Updated Nov 11 03:30:48.395
     Version: 35, Priority: 2
     MAC/Encaps: 14/14, MTU: 1500
     Label Stack (Top -> Bottom): { Imp-Null }
     Packets Switched: 0

LEAF - HAL pd context : 
 sub-type : MPLS, ecd_marked:0, has_collapsed_ldi:0, collapse_bwalk_required:0, ecdv2_marked:0
Leaf H/W Result:

Leaf H/W Result on NP:0

    Raw Data0: 0x11050803 1a030000 00000000 00000000
    Raw Data1: 0x00000000 00000000 00000000 00000000
    cb0
                 vpn_special: 0                vc_label: 0
                  evpn_label: 0                   match: 1
                        rsvd: 0                   valid: 1

    cb1
      p2mp_ip_lookup: 0
             p2mp_or_tp_wrap: 0                      tp: 0
                    igp_pref: 1               recursive: 0
               non_recursive: 1    

    cb2
          flow_label_dispose: 0                      tp: 0
          receive_entry_type: 0           vc_label_vpws: 0
                         fwd: 1    control_word_enabled: 0
                 imp_ttl_255: 0               recursive: 0

               ecmp_size: 3

    nr_fwd_entry
                   nrldi_ptr: 0x1a0300 << prt should 0x00031a  
                 vpn_key: 0
               stats_ptr: 0
         ecmp_stats_base: 0

nrLDI eng ctx:
     flags: 0x1, proto: 2, npaths: 0, nbuckets: 1    ldi_tbl_idx: 0x31a, ecd_ref_cft: 0
pbts_ldi_tbl_idx: 0x0 

NR-LDI H/W Result for path 0 [index: 0x31a (BE),  common to all NPs]:

    Raw Data0: 0x91160002 8e020019 00000000 0003e961
    Raw Data1: 0x00004004 0002a809 61c00000 00000000
    ldi_resolve_control_byte0:
                         bvi: 0                reserved: 0
                       match: 1                   valid: 1
      txadj_internal: 1
    ldi_resolve_control_byte1: 
                        mldp: 0          default_action: 1
                      rx_adj: 1            te_IpFrr_adj: 0
               label_1_valid: 0           label_2_valid: 0
           local_label_valid: 1     ldpBkup_label_valid: 0
    ldi_resolve_control_byte2: 
                  pwhe_nrldi: 0                   spare: 0
                ipldp_FRR_TE: 0                     bvi: 0
    np_bit_map: 0x02
    label_stats_index: 0xa80961

        igp_local_label:
                   label_msb: 1001               label_lsb: 6
                         exp: 0                     eos: 1

        output_label:
                   label_msb: 0               label_lsb: 4
                         exp: 0                     eos: 0
    Adj (non_te):
        tx_adj_ptr      : 0x8e0200 (LE)    rx_adj_ptr  : 0x190000 (LE)

TX H/W Result for NP:0 (index: 0x28e (BE)): << match tx prt 0x8e0200

    Raw Data0: 0x91040000 0600dc05 00000000 00000000
    Raw Data1: 0x10f31138 ad600000 00000000 00000000
    adj_resolve_control_byte0
                    reserved: 0       egr_uidb_internal: 1
                       match: 1                   valid: 1
                  iptunl_adj: 0
    adj_resolve_control_byte1
                tx_adj_null0: 0                     tx_punt: 0                 tx_drop: 0
              default_action: 1                        pwhe: 0                   spare: 0
    adj_resolve_control_byte2
                        pwhe: 0                       spare: 0                spare_cb: 0
    flags
        gre_adj         : 0
                 pwhe_cw: 0    
    uidb_index      : 0x600 (LE)
    l3_mtu          : 1500
    adj_stats_index : 0x0
    dest_mac        : 0x10f3.1138.ad60
    ether reserved  : 0000000000000000

TX H/W Result for NP:1 (index: 0x28e (BE)):

    Raw Data0: 0x91040000 0600dc05 18006100 00000000
    Raw Data1: 0x10f31138 ad600000 00000000 00000000
    adj_resolve_control_byte0
                    reserved: 0       egr_uidb_internal: 1
                       match: 1                   valid: 1
                  iptunl_adj: 0
    adj_resolve_control_byte1
                tx_adj_null0: 0                     tx_punt: 0                 tx_drop: 0
              default_action: 1                        pwhe: 0                   spare: 0
    adj_resolve_control_byte2
                        pwhe: 0                       spare: 0                spare_cb: 0
    flags
        gre_adj         : 0
                 pwhe_cw: 0    
    uidb_index      : 0x600 (LE)
    l3_mtu          : 1500
    adj_stats_index : 0x180061
    dest_mac        : 0x10f3.1138.ad60
    ether reserved  : 0000000000000000

RX H/W Result on NP:0 [Adj ptr:0x19 (BE)]: << match rx ptr 0x190000

    Raw Data0: 0x91000000 00000060 040002c0 04000000
    adj_resolve_control_byte0
                       match: 1                   valid: 1
                  iptunl_adj: 0
                 remote_rack: 0

    adj_resolve_control_byte1
                    adj_down: 0                mgscp_en: 0
              rx_lag_hash_en: 0              rx_lag_adj: 0
                        pwhe: 0    
    adj_resolve_control_byte2
                  rx_lag_adj: 0            rx_adj_null0: 0
                 rp_destined: 0                 rx_punt: 0
                     rx_drop: 0
    sfp/vqi         : 0x60 << come from which switch port
    egress np port  : 0x400
    if_handle       : 0x40002c0 << check by "show controller pm" and "sh im database ifhandle"

RX H/W Result on NP:1 [Adj ptr:0x19 (BE)]:

    Raw Data0: 0x91000000 00000060 040002c0 04000000
    adj_resolve_control_byte0
                       match: 1                   valid: 1
                  iptunl_adj: 0
                 remote_rack: 0

    adj_resolve_control_byte1
                    adj_down: 0                mgscp_en: 0
              rx_lag_hash_en: 0              rx_lag_adj: 0
                        pwhe: 0    
    adj_resolve_control_byte2
                  rx_lag_adj: 0            rx_adj_null0: 0
                 rp_destined: 0                 rx_punt: 0
                     rx_drop: 0
    sfp/vqi         : 0x60
    egress np port  : 0x400
    if_handle       : 0x40002c0

 

Workaround

 

  1. Please Huawei fix the hash issue
  2. Set up a new tunnel and not take any forward-class, that the issue will recovery even if Huawei choose the LDP.
  3. Set PBTS on income port at HKBR, and match topmost label, then point traffics to correct forward-class.
本文出自 Frank's Blog

版权声明:


本文链接:How to troubleshooting HW FIB on ASR9k | PBTS/TE
版权声明:本文为原创文章,仅代表个人观点,版权归 Frank Zhao 所有,转载时请注明本文出处及文章链接
你可以留言,或者trackback 从你的网站

留言哦

blonde teen swallows load.xxx videos