Replaced mLACP and NV Cluster by EVPN + Anycast IRB on NCS5500/Fretta

0

Introduction

There are two old great features that can achieve Active/Active in multi-chassis:

  • mLACP: ASR9k support, and by ICCP.
  • NV Cluster: only ASR9k support, not need other protocol (e.g ICCP), but not support from 6.x.

So could we have the similar solution on NCS55xx? The answer is “Yes”, we can deploy EVPN + Anycast IRB to achieve the similar function. For this article, no reference to real EVPN environment, only use multi-home A/A EVPN function. And include testing when link failure.

Conclusion

  • If you deploy EVPN + Any IRB, you must to know there are no dynamic IGP protocol between CE/mPE or Host/mPE, only Static or default GW. That due to we couldn’t deploy the same IGP process at two chassis. That should different with NV Cluster. As follow:
  • Due to deploy EVPN that belong to BGP, so we need underlay protocol that can be achieved by LDP or Segment Routing. In this example, will deploy Segment Routing.
  • Traffic(via EVPN) will not forward to the link between two PEs, so no need to deploy inter-link. Except customer has other L3 business in the same PEs.

Topology

Physical Topology

  • Both NCS5502 and NCS5508 are 6.3.3.
  • For R2/3/CE, bundle id 77, and enable LACP
  • For R2/3, BVI/Bridge-group/Bridge-Domain/EVI are 77 too.
  • For R2/3/4/5/6 address should xy.1.1.x|y.  E.g R2 <-> R3, 23.1.1.2 and 23.1.1.3.
  • For R2/3/4/5/6, Loopback number is lo77, address same as Router name, E.g R2’s lo77 is 22.22.22.22, R3 is 33.33.33.33.

Default Traffic Topology after set up EVPN

  • IGP is ISIS and enables SR, Ti-LFA
  • Only enable BGP/EVPN on R2 and R31, not enable BGP on R4/5/6
  • Enable Bundle + LACP between H1/CE and PE R2/3
  • Static route point to 122.122.1.0/24 + BVI at same PE R2/3, and redistribute to IGP
  • Set Default GW or Static route point to 22.22.1.0/24 + Bundle-e at H1/CE

Set Up EVPN + IRB

Enable IGP/SR/TI-LFA on R2/3/4/5/6

interface x/x/x/x
 ip add x.x.x.x 255.255.255.0
 no shut
 
int lo77
ip add x.x.x.x 255.255.255.255
!
router isis yonzhao2
 net 49.1921.6800.00xx.00
 address-family ipv4 unicast
  metric-style wide
  segment-routing mpls
 !
 interface Loopback77
  passive
  circuit-type level-2-only
  address-family ipv4 unicast
   prefix-sid absolute 1700x
  !
 !
 interface x/x/x/x
  circuit-type level-2-only
  point-to-point
  address-family ipv4 unicast
  fast-reroute per-prefix
  fast-reroute per-prefix ti-lfa
   metric 1
  !
 ! 

Enable EVPN + IRB on PE R2/2

Only show R2’s example, R3 should same

lacp system mac 1.1.1 <<< you can defined based on bundle port too
!
interface Bundle-Ether77
 l2transport
 !
!
interface TenGigE0/0/0/1/0
 bundle id 77 mode active
!
interface BVI77
 host-routing
 ipv4 address 123.1.1.2 255.255.255.252
 mac-address 1.2.3
!
router bgp 65001
bgp router-id 22.22.22.22
 address-family l2vpn evpn
 !
 neighbor 33.33.33.33
 remote-as 65001
 update-source Loopback77
 address-family l2vpn evpn
 ! 
 !
!
cef adjacency route override rib <<< must have in EVPN
evpn
 evi 77
 advertise-mac
 !
 !
 interface Bundle-Ether77
 ethernet-segment
 identifier type 0 11.11.11.11.11.11.11.11.11 <<< if need A/A, ESI must same at R2/3
 bgp route-target 1111.1111.1111
 !
 !
!
l2vpn
 bridge group 77
 bridge-domain 77
 interface Bundle-Ether77
 !
 routed interface BVI77
 !
 evi 77
 !
 !
 !
!

Set Static Route on R2/3 and redistribute

Only show R2’s example, R3 should same

route-policy yonzhao2
  if destination in (122.122.1.0/24) then
    pass
  else
    drop
  endif
end-policy
!
router static
 address-family ipv4 unicast
  122.122.1.0/24 BVI77 123.1.1.1
 !
!
router isis yonzhao2
 address-family ipv4 unicast
  redistribute static route-policy yonzhao2
 !

Set Static Route on H1/CE

router static
 address-family ipv4 unicast
  22.22.1.0/24 Bundle-Ether77 123.1.1.2
  122.122.1.0/24 TenGigE0/0/0/5 123.123.0.2

Check EVPN/CEF/TI-LFA Info

show evpn ethernet-segment esi 11.1111.1111.1111.1111 detail

How to “elected” in MH scenario? You can referenece my blog: Type4:Ethernet Segment Route

RP/0/RP0/CPU0:NCS-5502-A#show evpn ethernet-segment esi 11.1111.1111.1111.1111 detail
Tue Oct  9 10:38:23.709 UTC

Ethernet Segment Id      Interface                          Nexthops            
------------------------ ---------------------------------- --------------------
0011.1111.1111.1111.1111 BE77                               22.22.22.22
                                                            33.33.33.33
      
  ES to BGP Gates   : Ready
  ES to L2FIB Gates : Ready
  Main port         :
     Interface name : Bundle-Ether77
     Interface MAC  : 008a.960c.b0da
     IfHandle       : 0x0800004c
     State          : Up
     Redundancy     : Not Defined
  ESI type          : 0
     Value          : 11.1111.1111.1111.1111
  ES Import RT      : 1111.1111.1111 (Local)
  Source MAC        : 0000.0000.0000 (N/A)
  Topology          :
     Operational    : MH, All-active
     Configured     : All-active (AApF) (default)
  Primary Services  : Auto-selection
  Secondary Services: Auto-selection
  Service Carving Results:
     Forwarders     : 1
     Permanent      : 0
     Elected        : 0
     Not Elected    : 1
  MAC Flushing mode : STP-TCN
  Peering timer     : 3 sec [not running]
  Recovery timer    : 30 sec [not running]
  Carving timer     : 0 sec [not running]
  Local SHG label   : 64021
  Remote SHG labels : 1
              64008 : nexthop 33.33.33.33
RP/0/RP1/CPU0:NCS5008_SJ_CX#show evpn ethernet-segment esi 11.1111.1111.1111.1111 detail
Wed Oct 10 08:04:08.716 PDT

Ethernet Segment Id      Interface                          Nexthops            
------------------------ ---------------------------------- --------------------
0011.1111.1111.1111.1111 BE77                               22.22.22.22
                                                            33.33.33.33
           
  ES to BGP Gates   : Ready
  ES to L2FIB Gates : Ready
  Main port         :
     Interface name : Bundle-Ether77
     Interface MAC  : 0078.88f3.8c96
     IfHandle       : 0x088000f4
     State          : Up
     Redundancy     : Not Defined
  ESI type          : 0
     Value          : 11.1111.1111.1111.1111
  ES Import RT      : 1111.1111.1111 (Local)
  Source MAC        : 0000.0000.0000 (N/A)
  Topology          :
     Operational    : MH, All-active
     Configured     : All-active (AApF) (default)
  Primary Services  : Auto-selection
  Secondary Services: Auto-selection
  Service Carving Results:
     Forwarders     : 1
     Permanent      : 0
     Elected        : 1
     Not Elected    : 0
  MAC Flushing mode : STP-TCN
  Peering timer     : 3 sec [not running]
  Recovery timer    : 30 sec [not running]
  Carving timer     : 0 sec [not running]
  Local SHG label   : 64008
  Remote SHG labels : 1
              64021 : nexthop 22.22.22.22

show bgp l2vpn evpn neighbors 33.33.33.33 routes

As follow info, you can find there are 7 * EVPN route each local/remote, that include RT-1, RT-2, RT-3 and RT-4. Refer to how to ES:GLOBAL and EVPN RD, you can reference my blog: http://www.zhaocs.info/evpn-summary.html#EVPN_RD

RP/0/RP0/CPU0:NCS-5502-A#show bgp l2vpn evpn neighbors 33.33.33.33 routes 
Tue Oct  9 10:51:06.321 UTC
BGP router identifier 22.22.22.22, local AS number 65001
BGP generic scan interval 60 secs
Non-stop routing is enabled
BGP table state: Active
Table ID: 0x0   RD version: 0
BGP main routing table version 34
BGP NSR Initial initsync version 17 (Reached)
BGP NSR/ISSU Sync-Group versions 0/0
BGP scan interval 60 secs

Status codes: s suppressed, d damped, h history, * valid, > best
              i - internal, r RIB-failure, S stale, N Nexthop-discard
Origin codes: i - IGP, e - EGP, ? - incomplete
   Network            Next Hop            Metric LocPrf Weight Path
Route Distinguisher: 22.22.22.22:0 (default for vrf ES:GLOBAL)
*>i[4][0011.1111.1111.1111.1111][32][33.33.33.33]/128
                      33.33.33.33                   100      0 i
Route Distinguisher: 22.22.22.22:77 (default for vrf 77)
* i[1][0011.1111.1111.1111.1111][0]/120
                      33.33.33.33                   100      0 i
*>i[1][0011.1111.1111.1111.1111][4294967295]/120
                      33.33.33.33                   100      0 i
* i[2][0][48][008a.960d.b818][0]/104 <<<  0/6's mac in H1/CE
                      33.33.33.33                   100      0 i
* i[2][0][48][008a.960d.b8db][0]/104 <<<  bundle-e 77's mac in H1/CE
                      33.33.33.33                   100      0 i
* i[2][0][48][008a.960d.b8db][32][123.1.1.1]/136
                      33.33.33.33                   100      0 i
*>i[3][0][32][33.33.33.33]/80
                      33.33.33.33                   100      0 i
Route Distinguisher: 33.33.33.33:0
*>i[4][0011.1111.1111.1111.1111][32][33.33.33.33]/128
                      33.33.33.33                   100      0 i
Route Distinguisher: 33.33.33.33:1
*>i[1][33.33.33.33:1][0011.1111.1111.1111.1111][4294967295]/184
                      33.33.33.33                   100      0 i
Route Distinguisher: 33.33.33.33:77
*>i[1][0011.1111.1111.1111.1111][0]/120
                      33.33.33.33                   100      0 i
*>i[2][0][48][008a.960d.b818][0]/104
                      33.33.33.33                   100      0 i
*>i[2][0][48][008a.960d.b8db][0]/104
                      33.33.33.33                   100      0 i
*>i[2][0][48][008a.960d.b8db][32][123.1.1.1]/136
                      33.33.33.33                   100      0 i
*>i[3][0][32][33.33.33.33]/80
                      33.33.33.33                   100      0 i

Processed 14 prefixes, 14 paths

show bgp l2vpn evpn rd 22.22.22.22:77 [2][0][48]xxx

RP/0/RP0/CPU0:NCS-5502-A#sh bgp l2vpn evpn rd 22.22.22.22:77 [2][0][48][008a.960d.b8db][32][123.1.1.1]/136 detail 
Tue Oct  9 11:13:51.113 UTC
BGP routing table entry for [2][0][48][008a.960d.b8db][32][123.1.1.1]/136, Route Distinguisher: 22.22.22.22:77
Versions:
  Process           bRIB/RIB  SendTblVer
  Speaker                 34          34
    Local Label: 64019 (no rewrite); 
    Flags: 0x00041001+0x00020000; 
Last Modified: Oct  8 15:26:32.804 for 19:47:18
Paths: (2 available, best #1)
  Advertised to peers (in unique update groups):
    3.3.3.3         33.33.33.33     
  Path #1: Received by speaker 0
  Flags: 0x400002000504000b, import: 0x00
  Advertised to peers (in unique update groups):
    3.3.3.3         33.33.33.33     
  Local
    0.0.0.0 from 0.0.0.0 (22.22.22.22)
      Origin IGP, localpref 100, valid, redistributed, best, group-best, import-candidate, rib-install
      Received Path ID 0, Local Path ID 1, version 34
      Extended community: SoO:33.33.33.33:77 RT:65001:77 
      EVPN ESI: 0011.1111.1111.1111.1111
  Path #2: Received by speaker 0
  Flags: 0x4000020004020005, import: 0x80
  Not advertised to any peer
  Local
    33.33.33.33 (metric 1) from 33.33.33.33 (33.33.33.33)
      Received Label 64007 
      Origin IGP, localpref 100, valid, internal, import-candidate, imported, rib-install
      Received Path ID 0, Local Path ID 0, version 0
      Extended community: SoO:33.33.33.33:77 RT:65001:77 
      EVPN ESI: 0011.1111.1111.1111.1111
      Source AFI: L2VPN EVPN, Source VRF: default, Source Route Distinguisher: 33.33.33.33:77

show evpn evi mac 008a.960d.b8db private | R3/PE

RP/0/RP0/CPU0:NCS5008_SJ_CX#sh evpn evi mac 008a.960d.b8db private 
Wed Oct 10 14:48:35.944 PDT

EVI        MAC address    IP address                               Nexthop                                 Label   
---------- -------------- ---------------------------------------- --------------------------------------- --------
77         008a.960d.b8db ::                                       22.22.22.22                             64019   
   Ethernet Tag                            : 0
   Multi-paths Resolved                    : True
   Local Static                            : No
   Remote Static                           : No
   Local Ethernet Segment                  : 0000.0000.0000.0000.0000
   Remote Ethernet Segment                 : 0011.1111.1111.1111.1111
   Local Sequence Number                   : 0
   Remote Sequence Number                  : 0
   Local Encapsulation                     : N/A
   Remote Encapsulation                    : MPLS
   ESI Port Key                            : 0
   Source                                  : Remote
   Flush Requested                         : 0
   Flush Received                          : 0
   Multi-paths Local Label                 : 64006
   SOO Nexthop                             : 22.22.22.22
   BP XCID                                 : 0x0
   MAC State                               : Remote (w/ SOO)
   MAC Producers                           : 0x0 (Best: 0x0)
   Local Router MAC                        : 0000.0000.0000
   L3 Label                                : 0

   Object: EVPN MAC
   Base info: version=0xdbdb0008, flags=0x481c0100, type=8, reserved=0
   EVPN MAC event history  [Num events: 16]
   ----------------------------------------------------------------------------
     Time                Event                         Flags      Flags      
     ====                =====                         =====      =====      
     Oct 10 14:03:18.528 Encode NLRI                   404c0110, 00000000 M  - 
     Oct 10 14:03:18.528 Got BGP update                00010001, 00000001 -  - 
     Oct 10 14:03:18.528 Modify                        00000000, 00000000 -  - 
     Oct 10 14:03:18.528 Advertise to BGP;rejected     00000010, 00000000 -  - 
     Oct 10 14:03:18.528 FSM Event (event, state)      00000002, 00030003 -  - 
     Oct 10 14:03:18.528 L2RIB Download                0000fa06, 01010000 -  - 
     Oct 10 14:03:18.528 Encode NLRI                   405c0110, 00000000 M  - 
     Oct 10 14:45:54.944 Advertise to BGP;rejected     00000008, 00000000 -  -  <<< If MAC routes have been received by EVPN and are not being advertised
     Oct 10 14:45:54.944 Advertise to BGP              483c0110, 00000000 -  - 
     Oct 10 14:45:54.944 L2RIB Download                00000000, 01000100 -  - 
     Oct 10 14:45:54.944 Encode NLRI                   483c0110, 00000000 M  - 
     Oct 10 14:45:54.944 Got BGP update                00010001, 00000001 -  - 
     Oct 10 14:45:54.944 Modify Redundant              00000000, 00000000 -  - 
     Oct 10 14:45:54.944 FSM Event (event, state)      00000002, 00030003 -  - 
     Oct 10 14:45:54.944 L2RIB Download                00000000, 01000100 -  - 
     Oct 10 14:45:54.944 Encode NLRI                   483c0110, 00000000 M  - 
   ----------------------------------------------------------------------------
77         008a.960d.b8db 123.1.1.1                                22.22.22.22                             64019   
   Ethernet Tag                            : 0
   Multi-paths Resolved                    : True
   Local Static                            : No
   Remote Static                           : No
   Local Ethernet Segment                  : 0000.0000.0000.0000.0000
   Remote Ethernet Segment                 : 0011.1111.1111.1111.1111
   Local Sequence Number                   : 0
   Remote Sequence Number                  : 0
   Local Encapsulation                     : N/A
   Remote Encapsulation                    : MPLS
   ESI Port Key                            : 0
   Source                                  : Remote
   Flush Requested                         : 0
   Flush Received                          : 0
   Multi-paths Local Label                 : 64006
   SOO Nexthop                             : 22.22.22.22
   BP XCID                                 : 0x0
   MAC State                               : Remote (w/ SOO)
   MAC Producers                           : 0x0 (Best: 0x0)
   Local Router MAC                        : 0000.0000.0000
   L3 Label                                : 0

   Object: EVPN MAC
   Base info: version=0xdbdb0008, flags=0x481c0100, type=8, reserved=0
   EVPN MAC event history  [Num events: 16]
   ----------------------------------------------------------------------------
     Time                Event                         Flags      Flags      
     ====                =====                         =====      =====      
     Oct 10 14:03:18.528 Encode NLRI                   404c0110, 00000001 M  - 
     Oct 10 14:03:18.528 Got BGP update                00010001, 00000001 -  - 
     Oct 10 14:03:18.528 Modify                        00000000, 00000000 -  - 
     Oct 10 14:03:18.528 Advertise to BGP;rejected     00000010, 00000000 -  - 
     Oct 10 14:03:18.528 FSM Event (event, state)      00000002, 00030003 -  - 
     Oct 10 14:03:18.528 L2RIB Download                0000fa06, 01010000 -  - 
     Oct 10 14:03:18.528 Encode NLRI                   405c0110, 00000001 M  - 
     Oct 10 14:45:54.944 Advertise to BGP;rejected     00000008, 00000000 -  - 
     Oct 10 14:45:54.944 Advertise to BGP              483c0110, 00000000 -  - 
     Oct 10 14:45:54.944 L2RIB Download                00000000, 01000001 -  - 
     Oct 10 14:45:54.944 Encode NLRI                   483c0110, 00000001 M  - 
     Oct 10 14:45:54.944 Got BGP update                00010001, 00000001 -  - 
     Oct 10 14:45:54.944 Modify Redundant              00000000, 00000000 -  - 
     Oct 10 14:45:54.944 FSM Event (event, state)      00000002, 00030003 -  - 
     Oct 10 14:45:54.944 L2RIB Download                00000000, 01000001 -  - 
     Oct 10 14:45:54.944 Encode NLRI                   483c0110, 00000001 M  - 
   ----------------------------------------------------------------------------

show evpn evi mac 008a.960d.b8db private | R2/PE

RP/0/RP0/CPU0:NCS-5502-A#sh evpn evi mac 008a.960d.b8db private  
Tue Oct  9 17:29:25.455 UTC

EVI        MAC address    IP address                               Nexthop                                 Label   
---------- -------------- ---------------------------------------- --------------------------------------- --------
77         008a.960d.b8db ::                                       Bundle-Ether77                          64019   
   Ethernet Tag                            : 0
   Multi-paths Resolved                    : False
   Local Static                            : No
   Remote Static                           : No
   Local Ethernet Segment                  : 0011.1111.1111.1111.1111
   Remote Ethernet Segment                 : 0000.0000.0000.0000.0000
   Local Sequence Number                   : 0
   Remote Sequence Number                  : 0
   Local Encapsulation                     : N/A
   Remote Encapsulation                    : N/A
   ESI Port Key                            : fa15
   Source                                  : Local
   Flush Requested                         : 0
   Flush Received                          : 0
   Multi-paths Local Label                 : 0
   SOO Nexthop                             : ::
   BP XCID                                 : 0xa0000002
   MAC State                               : Local
   MAC Producers                           : 0x1 (Best: 0x1)
   Local Router MAC                        : 0000.0000.0000
   L3 Label                                : 0

   Object: EVPN MAC
   Base info: version=0xdbdb0008, flags=0x8004100, type=8, reserved=0
   EVPN MAC event history  [Num events: 10]
   ----------------------------------------------------------------------------
     Time                Event                         Flags      Flags      
     ====                =====                         =====      =====      
     Oct  8 11:37:09.888 Advertise to BGP              08204110, 00000000 -  - 
     Oct  8 11:37:09.888 FSM Event (event, state)      00000000, 00010000 -  - 
     Oct  8 11:37:09.888 Encode NLRI                   08204110, 00000000 -  - 
     Oct  8 11:37:09.888 Ignore BGP update             00000000, 00000000 -  - 
     Oct  9 14:40:05.120 Got L2RIB update              08004100, 00000000 -  - 
     Oct  9 14:40:05.120 Modify Redundant              00000000, 00000000 -  - 
     Oct  9 14:40:05.120 Advertise to BGP              08204110, 00000000 -  -  <<< if bgp not down, mac route will not withdrawn
     Oct  9 14:40:05.120 FSM Event (event, state)      00000000, 00010001 -  - 
     Oct  9 14:40:05.120 Encode NLRI                   08204110, 00000000 -  - 
     Oct  9 17:20:49.152 Ignore BGP update             00000000, 00000000 M  - 
   ----------------------------------------------------------------------------
77         008a.960d.b8db 123.1.1.1                                Bundle-Ether77                          64019   
   Ethernet Tag                            : 0
   Multi-paths Resolved                    : False
   Local Static                            : No
   Remote Static                           : No
   Local Ethernet Segment                  : 0011.1111.1111.1111.1111
   Remote Ethernet Segment                 : 0000.0000.0000.0000.0000
   Local Sequence Number                   : 0
   Remote Sequence Number                  : 0
   Local Encapsulation                     : N/A
   Remote Encapsulation                    : N/A
   ESI Port Key                            : fa15
   Source                                  : Local
   Flush Requested                         : 0
   Flush Received                          : 0
   Multi-paths Local Label                 : 0
   SOO Nexthop                             : ::
   BP XCID                                 : 0xa0000002
   MAC State                               : Local
   MAC Producers                           : 0x1 (Best: 0x1)
   Local Router MAC                        : 0000.0000.0000
   L3 Label                                : 0

   Object: EVPN MAC
   Base info: version=0xdbdb0008, flags=0x8004100, type=8, reserved=0
   EVPN MAC event history  [Num events: 4]
   ----------------------------------------------------------------------------
     Time                Event                         Flags      Flags      
     ====                =====                         =====      =====      
     Oct  9 14:40:05.120 Advertise to BGP              08204110, 00000000 -  - 
     Oct  9 14:40:05.120 FSM Event (event, state)      00000000, 00010000 -  - 
     Oct  9 14:40:05.120 Encode NLRI                   08204110, 00000041 -  - 
     Oct  9 17:20:49.152 Ignore BGP update             00000000, 00000000 M  - 
   ----------------------------------------------------------------------------

Ti-LFA and CEF info of 33.33.33.33 on R2/PE

RP/0/RP0/CPU0:NCS-5502-A#sh mpls forwarding prefix 33.33.33.33/32
Tue Oct  9 13:31:26.222 UTC
Local  Outgoing    Prefix             Outgoing     Next Hop        Bytes       
Label  Label       or ID              Interface                    Switched    
------ ----------- ------------------ ------------ --------------- ------------
64006  Pop         33.33.33.33/32     Te0/0/0/1/3  23.1.1.3        4280        
       17003       33.33.33.33/32     Te0/0/0/1/1  24.1.1.4        0            (!)

RP/0/RP0/CPU0:NCS-5502-A#show isis fast-reroute summary
Tue Oct  9 13:41:17.285 UTC

IS-IS yonzhao2 IPv4 Unicast FRR summary

                          Critical   High       Medium     Low        Total     
                          Priority   Priority   Priority   Priority             
Prefixes reachable in L2
  All paths protected     0          0          4          10         14        
  Some paths protected    0          0          0          0          0         
  Unprotected             0          0          0          0          0         
  Protection coverage     0.00%      0.00%      100.00%    100.00%    100.00% 

RP/0/RP0/CPU0:NCS-5502-A#sh cef 33.33.33.33/32 detail 
Tue Oct  9 13:42:16.543 UTC
33.33.33.33/32, version 101, labeled SR, internal 0x1000001 0x85 (ptr 0x972c7f18) [1], 0x0 (0x974998a8), 0xa28 (0x98438b10)
 Updated Aug 11 07:24:29.586 
 local adjacency 23.1.1.3
 Prefix Len 32, traffic index 0, precedence n/a, priority 15
  gateway array (0x9730bc48) reference count 3, flags 0x500068, source lsd (5), 2 backups
                [3 type 4 flags 0x8401 (0x97a149b0) ext 0x0 (0x0)]
  LW-LDI[type=1, refc=1, ptr=0x974998a8, sh-ldi=0x97a149b0]
  gateway array update type-time 1 Aug 11 07:24:29.586
 LDI Update time Oct  9 12:51:26.364
 LW-LDI-TS Oct  9 12:51:26.364
   via 23.1.1.3/32, TenGigE0/0/0/1/3, 14 dependencies, weight 0, class 0, protected [flags 0x400]
    path-idx 0 bkup-idx 1 NHID 0x0 [0x9879aa50 0x9879a890]
    next hop 23.1.1.3/32
     local label 64006      labels imposed {ImplNull}
   via 24.1.1.4/32, TenGigE0/0/0/1/1, 14 dependencies, weight 0, class 0, backup (Local-LFA) [flags 0x300]
    path-idx 1 NHID 0x0 [0x97d7c530 0x0]
    next hop 24.1.1.4/32
    local adjacency
     local label 64006      labels imposed {17003}


    Load distribution: 0 (refcount 3)

    Hash  OK  Interface                 Address
    0     Y   TenGigE0/0/0/1/3          23.1.1.3

CEF info on R4 and R5

RP/0/RSP0/CPU0:ASR-9010-29A#sh cef 122.122.1.0
Wed Oct 10 20:35:47.999 UTC
122.122.1.0/24, version 18361, internal 0x1000001 0x0 (ptr 0x71df24a8) [1], 0x0 (0x71dc2a38), 0x0 (0x0)
 Updated Oct 10 20:23:00.730 
 remote adjacency to TenGigE0/6/0/3
 Prefix Len 24, traffic index 0, precedence n/a, priority 2
   via 24.1.1.2/32, TenGigE0/6/0/3, 7 dependencies, weight 0, class 0, protected [flags 0x600]
    path-idx 0 bkup-idx 1 NHID 0x0 [0x713cd2ec 0x0]
    next hop 24.1.1.2/32
   via 34.1.1.3/32, TenGigE0/6/0/4, 7 dependencies, weight 0, class 0, protected [flags 0x600]
    path-idx 1 bkup-idx 0 NHID 0x0 [0x713ccb38 0x0]
    next hop 34.1.1.3/32

RP/0/RP0/CPU0:ASR-9922-4A4#sh cef 122.122.1.0
Mon Oct 10 05:24:34.613 UTC
122.122.1.0/24, version 4969, internal 0x1000001 0x1 (ptr 0x7215de1c) [1], 0x0 (0x721184e0), 0x0 (0x0)
 Updated Oct 10 05:11:36.424 
 remote adjacency to TenGigE0/2/0/5
 Prefix Len 24, traffic index 0, precedence n/a, priority 2
   via 25.1.1.2/32, TenGigE0/2/0/5, 6 dependencies, weight 0, class 0, protected [flags 0x600]
    path-idx 0 bkup-idx 1 NHID 0x0 [0x7157cd7c 0x0]
    next hop 25.1.1.2/32
   via 35.1.1.3/32, TenGigE0/2/0/6, 6 dependencies, weight 0, class 0, protected [flags 0x600]
    path-idx 1 bkup-idx 0 NHID 0x0 [0x7157d448 0x0]
    next hop 35.1.1.3/32

Testing and Verifying

Sent traffics between two IXIA

  • Many to many, 10000 flows, Bi-Directional in IXIA, 500M traffics
  • Traffics flow should same as above traffics topology
  • Follow basic line of loss packets:

Shutdown physical link between H1/CE and R3/PE

After shutdown, traffics flow as follow. Due to AC down that cause BVI77 down, so no route deliver to R4/R5

router static
 address-family ipv4 unicast
  122.122.1.0/24 BVI77 123.1.1.1

Follow EVPN info:

RP/0/RP0/CPU0:NCS-5502-A#show evpn ethernet-segment 
esi 11.1111.1111.1111.1111 detail
Tue Oct  9 14:55:30.087 UTC
Legend:

  ES to BGP Gates   : Ready
  ES to L2FIB Gates : Ready
  Main port         :
     Interface name : Bundle-Ether77
     Interface MAC  : 008a.960c.b0da
     IfHandle       : 0x0800004c
     State          : Up
     Redundancy     : Not Defined
  ESI type          : 0
     Value          : 11.1111.1111.1111.1111
  ES Import RT      : 1111.1111.1111 (Local)
  Source MAC        : 0000.0000.0000 (N/A)
  Topology          :
     Operational    : SH
     Configured     : All-active (AApF) (default)
  Primary Services  : Auto-selection
  Secondary Services: Auto-selection
  Service Carving Results:
     Forwarders     : 1
     Permanent      : 0
     Elected        : 1
     Not Elected    : 0
  MAC Flushing mode : STP-TCN
  Peering timer     : 3 sec [not running]
  Recovery timer    : 30 sec [not running]
  Carving timer     : 0 sec [not running]
  Local SHG label   : 64021
  Remote SHG labels : 0
RP/0/RP1/CPU0:NCS5008_SJ_CX#show evpn ethernet-segment 
esi 11.1111.1111.1111.1111 detail
Wed Oct 10 12:20:05.789 PDT
Legend:

  ES to BGP Gates   : M
  ES to L2FIB Gates : Ready
  Main port         :
     Interface name : Bundle-Ether77
     Interface MAC  : 0078.88f3.8c96
     IfHandle       : 0x088000f4
     State          : Down
     Redundancy     : Not Defined
  ESI type          : 0
     Value          : 11.1111.1111.1111.1111
  ES Import RT      : 1111.1111.1111 (Local)
  Source MAC        : 0000.0000.0000 (N/A)
  Topology          :
     Operational    : MH, All-active
     Configured     : All-active (AApF) (default)
  Primary Services  : Auto-selection
  Secondary Services: Auto-selection
  Service Carving Results:
     Forwarders     : 1
     Permanent      : 0
     Elected        : 0
     Not Elected    : 1
  MAC Flushing mode : STP-TCN
  Peering timer     : 3 sec [not running]
  Recovery timer    : 30 sec [not running]
  Carving timer     : 0 sec [not running]
  Local SHG label   : 64008
  Remote SHG labels : 1
              64021 : nexthop 22.22.22.22

Follow BGP in R2/PE

RP/0/RP0/CPU0:NCS-5502-A#show bgp l2vpn evpn neighbors 33.33.33.33 routes 
Tue Oct  9 15:13:41.343 UTC
BGP router identifier 22.22.22.22, local AS number 65001
BGP generic scan interval 60 secs
Non-stop routing is enabled
BGP table state: Active
Table ID: 0x0   RD version: 0
BGP main routing table version 46
BGP NSR Initial initsync version 17 (Reached)
BGP NSR/ISSU Sync-Group versions 0/0
BGP scan interval 60 secs

Status codes: s suppressed, d damped, h history, * valid, > best
              i - internal, r RIB-failure, S stale, N Nexthop-discard
Origin codes: i - IGP, e - EGP, ? - incomplete
   Network            Next Hop            Metric LocPrf Weight Path
Route Distinguisher: 22.22.22.22:77 (default for vrf 77)
* i[1][0011.1111.1111.1111.1111][0]/120
                      33.33.33.33                   100      0 i
*>i[3][0][32][33.33.33.33]/80
                      33.33.33.33                   100      0 i
Route Distinguisher: 33.33.33.33:77
*>i[1][0011.1111.1111.1111.1111][0]/120
                      33.33.33.33                   100      0 i
*>i[3][0][32][33.33.33.33]/80
                      33.33.33.33                   100      0 i

Processed 4 prefixes, 4 paths

Btw, we can find have some traffcis loss

Recovery and shutdown uplink between R3 and R4

After shutdown, traffics flow as follow. EVPN info not change.

Btw, we can find traffcis loss rate not change, due to have TI-LFA protect:

(In the scenario, I shutdown link between R2 and R3 too, loss rate not change, and EVPN not change)

Reload R3/PE

We can find only little packets drops rate update:

Reference

本文出自 Frank's Blog

版权声明:


本文链接:Replaced mLACP and NV Cluster by EVPN + Anycast IRB on NCS5500/Fretta
版权声明:本文为原创文章,仅代表个人观点,版权归 Frank Zhao 所有,转载时请注明本文出处及文章链接
你可以留言,或者trackback 从你的网站

留言哦

blonde teen swallows load.xxx videos