Replaced mLACP and NV Cluster by EVPN + Anycast IRB on NCS5500/Fretta
25 1 月, 2021,由 frank撰写
Introduction
There are two old great features that can achieve Active/Active in multi-chassis:
- mLACP: ASR9k support, and by ICCP.
- NV Cluster: only ASR9k support, not need other protocol (e.g ICCP), but not support from 6.x.
So could we have the similar solution on NCS55xx? The answer is “Yes”, we can deploy EVPN + Anycast IRB to achieve the similar function. For this article, no reference to real EVPN environment, only use multi-home A/A EVPN function. And include testing when link failure.
Conclusion
- If you deploy EVPN + Any IRB, you must to know there are no dynamic IGP protocol between CE/mPE or Host/mPE, only Static or default GW. That due to we couldn’t deploy the same IGP process at two chassis. That should different with NV Cluster. As follow:
- Due to deploy EVPN that belong to BGP, so we need underlay protocol that can be achieved by LDP or Segment Routing. In this example, will deploy Segment Routing.
- Traffic(via EVPN) will not forward to the link between two PEs, so no need to deploy inter-link. Except customer has other L3 business in the same PEs.
Topology
Physical Topology
- Both NCS5502 and NCS5508 are 6.3.3.
- For R2/3/CE, bundle id 77, and enable LACP
- For R2/3, BVI/Bridge-group/Bridge-Domain/EVI are 77 too.
- For R2/3/4/5/6 address should xy.1.1.x|y. E.g R2 <-> R3, 23.1.1.2 and 23.1.1.3.
- For R2/3/4/5/6, Loopback number is lo77, address same as Router name, E.g R2’s lo77 is 22.22.22.22, R3 is 33.33.33.33.
Default Traffic Topology after set up EVPN
- IGP is ISIS and enables SR, Ti-LFA
- Only enable BGP/EVPN on R2 and R31, not enable BGP on R4/5/6
- Enable Bundle + LACP between H1/CE and PE R2/3
- Static route point to 122.122.1.0/24 + BVI at same PE R2/3, and redistribute to IGP
- Set Default GW or Static route point to 22.22.1.0/24 + Bundle-e at H1/CE
Set Up EVPN + IRB
Enable IGP/SR/TI-LFA on R2/3/4/5/6
interface x/x/x/x
ip add x.x.x.x 255.255.255.0
no shut
int lo77
ip add x.x.x.x 255.255.255.255
!
router isis yonzhao2
net 49.1921.6800.00xx.00
address-family ipv4 unicast
metric-style wide
segment-routing mpls
!
interface Loopback77
passive
circuit-type level-2-only
address-family ipv4 unicast
prefix-sid absolute 1700x
!
!
interface x/x/x/x
circuit-type level-2-only
point-to-point
address-family ipv4 unicast
fast-reroute per-prefix
fast-reroute per-prefix ti-lfa
metric 1
!
! Enable EVPN + IRB on PE R2/2
Only show R2’s example, R3 should same
lacp system mac 1.1.1 <<< you can defined based on bundle port too
!
interface Bundle-Ether77
l2transport
!
!
interface TenGigE0/0/0/1/0
bundle id 77 mode active
!
interface BVI77
host-routing
ipv4 address 123.1.1.2 255.255.255.252
mac-address 1.2.3
!
router bgp 65001
bgp router-id 22.22.22.22
address-family l2vpn evpn
!
neighbor 33.33.33.33
remote-as 65001
update-source Loopback77
address-family l2vpn evpn
!
!
!
cef adjacency route override rib <<< must have in EVPN
evpn
evi 77
advertise-mac
!
!
interface Bundle-Ether77
ethernet-segment
identifier type 0 11.11.11.11.11.11.11.11.11 <<< if need A/A, ESI must same at R2/3
bgp route-target 1111.1111.1111
!
!
!
l2vpn
bridge group 77
bridge-domain 77
interface Bundle-Ether77
!
routed interface BVI77
!
evi 77
!
!
!
!Set Static Route on R2/3 and redistribute
Only show R2’s example, R3 should same
route-policy yonzhao2
if destination in (122.122.1.0/24) then
pass
else
drop
endif
end-policy
!
router static
address-family ipv4 unicast
122.122.1.0/24 BVI77 123.1.1.1
!
!
router isis yonzhao2
address-family ipv4 unicast
redistribute static route-policy yonzhao2
!Set Static Route on H1/CE
router static
address-family ipv4 unicast
22.22.1.0/24 Bundle-Ether77 123.1.1.2
122.122.1.0/24 TenGigE0/0/0/5 123.123.0.2Check EVPN/CEF/TI-LFA Info
show evpn ethernet-segment esi 11.1111.1111.1111.1111 detail
How to “elected” in MH scenario? You can referenece my blog: Type4：Ethernet Segment Route
RP/0/RP0/CPU0:NCS-5502-A#show evpn ethernet-segment esi 11.1111.1111.1111.1111 detail
Tue Oct 9 10:38:23.709 UTC
Ethernet Segment Id Interface Nexthops
------------------------ ---------------------------------- --------------------
0011.1111.1111.1111.1111 BE77 22.22.22.22
33.33.33.33
ES to BGP Gates : Ready
ES to L2FIB Gates : Ready
Main port :
Interface name : Bundle-Ether77
Interface MAC : 008a.960c.b0da
IfHandle : 0x0800004c
State : Up
Redundancy : Not Defined
ESI type : 0
Value : 11.1111.1111.1111.1111
ES Import RT : 1111.1111.1111 (Local)
Source MAC : 0000.0000.0000 (N/A)
Topology :
Operational : MH, All-active
Configured : All-active (AApF) (default)
Primary Services : Auto-selection
Secondary Services: Auto-selection
Service Carving Results:
Forwarders : 1
Permanent : 0
Elected : 0
Not Elected : 1
MAC Flushing mode : STP-TCN
Peering timer : 3 sec [not running]
Recovery timer : 30 sec [not running]
Carving timer : 0 sec [not running]
Local SHG label : 64021
Remote SHG labels : 1
64008 : nexthop 33.33.33.33RP/0/RP1/CPU0:NCS5008_SJ_CX#show evpn ethernet-segment esi 11.1111.1111.1111.1111 detail
Wed Oct 10 08:04:08.716 PDT
Ethernet Segment Id Interface Nexthops
------------------------ ---------------------------------- --------------------
0011.1111.1111.1111.1111 BE77 22.22.22.22
33.33.33.33
ES to BGP Gates : Ready
ES to L2FIB Gates : Ready
Main port :
Interface name : Bundle-Ether77
Interface MAC : 0078.88f3.8c96
IfHandle : 0x088000f4
State : Up
Redundancy : Not Defined
ESI type : 0
Value : 11.1111.1111.1111.1111
ES Import RT : 1111.1111.1111 (Local)
Source MAC : 0000.0000.0000 (N/A)
Topology :
Operational : MH, All-active
Configured : All-active (AApF) (default)
Primary Services : Auto-selection
Secondary Services: Auto-selection
Service Carving Results:
Forwarders : 1
Permanent : 0
Elected : 1
Not Elected : 0
MAC Flushing mode : STP-TCN
Peering timer : 3 sec [not running]
Recovery timer : 30 sec [not running]
Carving timer : 0 sec [not running]
Local SHG label : 64008
Remote SHG labels : 1
64021 : nexthop 22.22.22.22show bgp l2vpn evpn neighbors 33.33.33.33 routes
As follow info, you can find there are 7 * EVPN route each local/remote, that include RT-1, RT-2, RT-3 and RT-4. Refer to how to ES:GLOBAL and EVPN RD, you can reference my blog: http://www.zhaocs.info/evpn-summary.html#EVPN_RD
RP/0/RP0/CPU0:NCS-5502-A#show bgp l2vpn evpn neighbors 33.33.33.33 routes
Tue Oct 9 10:51:06.321 UTC
BGP router identifier 22.22.22.22, local AS number 65001
BGP generic scan interval 60 secs
Non-stop routing is enabled
BGP table state: Active
Table ID: 0x0 RD version: 0
BGP main routing table version 34
BGP NSR Initial initsync version 17 (Reached)
BGP NSR/ISSU Sync-Group versions 0/0
BGP scan interval 60 secs
Status codes: s suppressed, d damped, h history, * valid, > best
i - internal, r RIB-failure, S stale, N Nexthop-discard
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 22.22.22.22:0 (default for vrf ES:GLOBAL)
*>i[4][0011.1111.1111.1111.1111][32][33.33.33.33]/128
33.33.33.33 100 0 i
Route Distinguisher: 22.22.22.22:77 (default for vrf 77)
* i[1][0011.1111.1111.1111.1111][0]/120
33.33.33.33 100 0 i
*>i[1][0011.1111.1111.1111.1111][4294967295]/120
33.33.33.33 100 0 i
* i[2][0][48][008a.960d.b818][0]/104 <<< 0/6's mac in H1/CE
33.33.33.33 100 0 i
* i[2][0][48][008a.960d.b8db][0]/104 <<< bundle-e 77's mac in H1/CE
33.33.33.33 100 0 i
* i[2][0][48][008a.960d.b8db][32][123.1.1.1]/136
33.33.33.33 100 0 i
*>i[3][0][32][33.33.33.33]/80
33.33.33.33 100 0 i
Route Distinguisher: 33.33.33.33:0
*>i[4][0011.1111.1111.1111.1111][32][33.33.33.33]/128
33.33.33.33 100 0 i
Route Distinguisher: 33.33.33.33:1
*>i[1][33.33.33.33:1][0011.1111.1111.1111.1111][4294967295]/184
33.33.33.33 100 0 i
Route Distinguisher: 33.33.33.33:77
*>i[1][0011.1111.1111.1111.1111][0]/120
33.33.33.33 100 0 i
*>i[2][0][48][008a.960d.b818][0]/104
33.33.33.33 100 0 i
*>i[2][0][48][008a.960d.b8db][0]/104
33.33.33.33 100 0 i
*>i[2][0][48][008a.960d.b8db][32][123.1.1.1]/136
33.33.33.33 100 0 i
*>i[3][0][32][33.33.33.33]/80
33.33.33.33 100 0 i
Processed 14 prefixes, 14 pathsshow bgp l2vpn evpn rd 22.22.22.22:77 [2][0][48]xxx
RP/0/RP0/CPU0:NCS-5502-A#sh bgp l2vpn evpn rd 22.22.22.22:77 [2][0][48][008a.960d.b8db][32][123.1.1.1]/136 detail
Tue Oct 9 11:13:51.113 UTC
BGP routing table entry for [2][0][48][008a.960d.b8db][32][123.1.1.1]/136, Route Distinguisher: 22.22.22.22:77
Versions:
Process bRIB/RIB SendTblVer
Speaker 34 34
Local Label: 64019 (no rewrite);
Flags: 0x00041001+0x00020000;
Last Modified: Oct 8 15:26:32.804 for 19:47:18
Paths: (2 available, best #1)
Advertised to peers (in unique update groups):
3.3.3.3 33.33.33.33
Path #1: Received by speaker 0
Flags: 0x400002000504000b, import: 0x00
Advertised to peers (in unique update groups):
3.3.3.3 33.33.33.33
Local
0.0.0.0 from 0.0.0.0 (22.22.22.22)
Origin IGP, localpref 100, valid, redistributed, best, group-best, import-candidate, rib-install
Received Path ID 0, Local Path ID 1, version 34
Extended community: SoO:33.33.33.33:77 RT:65001:77
EVPN ESI: 0011.1111.1111.1111.1111
Path #2: Received by speaker 0
Flags: 0x4000020004020005, import: 0x80
Not advertised to any peer
Local
33.33.33.33 (metric 1) from 33.33.33.33 (33.33.33.33)
Received Label 64007
Origin IGP, localpref 100, valid, internal, import-candidate, imported, rib-install
Received Path ID 0, Local Path ID 0, version 0
Extended community: SoO:33.33.33.33:77 RT:65001:77
EVPN ESI: 0011.1111.1111.1111.1111
Source AFI: L2VPN EVPN, Source VRF: default, Source Route Distinguisher: 33.33.33.33:77show evpn evi mac 008a.960d.b8db private | R3/PE
RP/0/RP0/CPU0:NCS5008_SJ_CX#sh evpn evi mac 008a.960d.b8db private
Wed Oct 10 14:48:35.944 PDT
EVI MAC address IP address Nexthop Label
---------- -------------- ---------------------------------------- --------------------------------------- --------
77 008a.960d.b8db :: 22.22.22.22 64019
Ethernet Tag : 0
Multi-paths Resolved : True
Local Static : No
Remote Static : No
Local Ethernet Segment : 0000.0000.0000.0000.0000
Remote Ethernet Segment : 0011.1111.1111.1111.1111
Local Sequence Number : 0
Remote Sequence Number : 0
Local Encapsulation : N/A
Remote Encapsulation : MPLS
ESI Port Key : 0
Source : Remote
Flush Requested : 0
Flush Received : 0
Multi-paths Local Label : 64006
SOO Nexthop : 22.22.22.22
BP XCID : 0x0
MAC State : Remote (w/ SOO)
MAC Producers : 0x0 (Best: 0x0)
Local Router MAC : 0000.0000.0000
L3 Label : 0
Object: EVPN MAC
Base info: version=0xdbdb0008, flags=0x481c0100, type=8, reserved=0
EVPN MAC event history [Num events: 16]
----------------------------------------------------------------------------
Time Event Flags Flags
==== ===== ===== =====
Oct 10 14:03:18.528 Encode NLRI 404c0110, 00000000 M -
Oct 10 14:03:18.528 Got BGP update 00010001, 00000001 - -
Oct 10 14:03:18.528 Modify 00000000, 00000000 - -
Oct 10 14:03:18.528 Advertise to BGP;rejected 00000010, 00000000 - -
Oct 10 14:03:18.528 FSM Event (event, state) 00000002, 00030003 - -
Oct 10 14:03:18.528 L2RIB Download 0000fa06, 01010000 - -
Oct 10 14:03:18.528 Encode NLRI 405c0110, 00000000 M -
Oct 10 14:45:54.944 Advertise to BGP;rejected 00000008, 00000000 - - <<< If MAC routes have been received by EVPN and are not being advertised
Oct 10 14:45:54.944 Advertise to BGP 483c0110, 00000000 - -
Oct 10 14:45:54.944 L2RIB Download 00000000, 01000100 - -
Oct 10 14:45:54.944 Encode NLRI 483c0110, 00000000 M -
Oct 10 14:45:54.944 Got BGP update 00010001, 00000001 - -
Oct 10 14:45:54.944 Modify Redundant 00000000, 00000000 - -
Oct 10 14:45:54.944 FSM Event (event, state) 00000002, 00030003 - -
Oct 10 14:45:54.944 L2RIB Download 00000000, 01000100 - -
Oct 10 14:45:54.944 Encode NLRI 483c0110, 00000000 M -
----------------------------------------------------------------------------
77 008a.960d.b8db 123.1.1.1 22.22.22.22 64019
Ethernet Tag : 0
Multi-paths Resolved : True
Local Static : No
Remote Static : No
Local Ethernet Segment : 0000.0000.0000.0000.0000
Remote Ethernet Segment : 0011.1111.1111.1111.1111
Local Sequence Number : 0
Remote Sequence Number : 0
Local Encapsulation : N/A
Remote Encapsulation : MPLS
ESI Port Key : 0
Source : Remote
Flush Requested : 0
Flush Received : 0
Multi-paths Local Label : 64006
SOO Nexthop : 22.22.22.22
BP XCID : 0x0
MAC State : Remote (w/ SOO)
MAC Producers : 0x0 (Best: 0x0)
Local Router MAC : 0000.0000.0000
L3 Label : 0
Object: EVPN MAC
Base info: version=0xdbdb0008, flags=0x481c0100, type=8, reserved=0
EVPN MAC event history [Num events: 16]
----------------------------------------------------------------------------
Time Event Flags Flags
==== ===== ===== =====
Oct 10 14:03:18.528 Encode NLRI 404c0110, 00000001 M -
Oct 10 14:03:18.528 Got BGP update 00010001, 00000001 - -
Oct 10 14:03:18.528 Modify 00000000, 00000000 - -
Oct 10 14:03:18.528 Advertise to BGP;rejected 00000010, 00000000 - -
Oct 10 14:03:18.528 FSM Event (event, state) 00000002, 00030003 - -
Oct 10 14:03:18.528 L2RIB Download 0000fa06, 01010000 - -
Oct 10 14:03:18.528 Encode NLRI 405c0110, 00000001 M -
Oct 10 14:45:54.944 Advertise to BGP;rejected 00000008, 00000000 - -
Oct 10 14:45:54.944 Advertise to BGP 483c0110, 00000000 - -
Oct 10 14:45:54.944 L2RIB Download 00000000, 01000001 - -
Oct 10 14:45:54.944 Encode NLRI 483c0110, 00000001 M -
Oct 10 14:45:54.944 Got BGP update 00010001, 00000001 - -
Oct 10 14:45:54.944 Modify Redundant 00000000, 00000000 - -
Oct 10 14:45:54.944 FSM Event (event, state) 00000002, 00030003 - -
Oct 10 14:45:54.944 L2RIB Download 00000000, 01000001 - -
Oct 10 14:45:54.944 Encode NLRI 483c0110, 00000001 M -
----------------------------------------------------------------------------show evpn evi mac 008a.960d.b8db private | R2/PE
RP/0/RP0/CPU0:NCS-5502-A#sh evpn evi mac 008a.960d.b8db private
Tue Oct 9 17:29:25.455 UTC
EVI MAC address IP address Nexthop Label
---------- -------------- ---------------------------------------- --------------------------------------- --------
77 008a.960d.b8db :: Bundle-Ether77 64019
Ethernet Tag : 0
Multi-paths Resolved : False
Local Static : No
Remote Static : No
Local Ethernet Segment : 0011.1111.1111.1111.1111
Remote Ethernet Segment : 0000.0000.0000.0000.0000
Local Sequence Number : 0
Remote Sequence Number : 0
Local Encapsulation : N/A
Remote Encapsulation : N/A
ESI Port Key : fa15
Source : Local
Flush Requested : 0
Flush Received : 0
Multi-paths Local Label : 0
SOO Nexthop : ::
BP XCID : 0xa0000002
MAC State : Local
MAC Producers : 0x1 (Best: 0x1)
Local Router MAC : 0000.0000.0000
L3 Label : 0
Object: EVPN MAC
Base info: version=0xdbdb0008, flags=0x8004100, type=8, reserved=0
EVPN MAC event history [Num events: 10]
----------------------------------------------------------------------------
Time Event Flags Flags
==== ===== ===== =====
Oct 8 11:37:09.888 Advertise to BGP 08204110, 00000000 - -
Oct 8 11:37:09.888 FSM Event (event, state) 00000000, 00010000 - -
Oct 8 11:37:09.888 Encode NLRI 08204110, 00000000 - -
Oct 8 11:37:09.888 Ignore BGP update 00000000, 00000000 - -
Oct 9 14:40:05.120 Got L2RIB update 08004100, 00000000 - -
Oct 9 14:40:05.120 Modify Redundant 00000000, 00000000 - -
Oct 9 14:40:05.120 Advertise to BGP 08204110, 00000000 - - <<< if bgp not down, mac route will not withdrawn
Oct 9 14:40:05.120 FSM Event (event, state) 00000000, 00010001 - -
Oct 9 14:40:05.120 Encode NLRI 08204110, 00000000 - -
Oct 9 17:20:49.152 Ignore BGP update 00000000, 00000000 M -
----------------------------------------------------------------------------
77 008a.960d.b8db 123.1.1.1 Bundle-Ether77 64019
Ethernet Tag : 0
Multi-paths Resolved : False
Local Static : No
Remote Static : No
Local Ethernet Segment : 0011.1111.1111.1111.1111
Remote Ethernet Segment : 0000.0000.0000.0000.0000
Local Sequence Number : 0
Remote Sequence Number : 0
Local Encapsulation : N/A
Remote Encapsulation : N/A
ESI Port Key : fa15
Source : Local
Flush Requested : 0
Flush Received : 0
Multi-paths Local Label : 0
SOO Nexthop : ::
BP XCID : 0xa0000002
MAC State : Local
MAC Producers : 0x1 (Best: 0x1)
Local Router MAC : 0000.0000.0000
L3 Label : 0
Object: EVPN MAC
Base info: version=0xdbdb0008, flags=0x8004100, type=8, reserved=0
EVPN MAC event history [Num events: 4]
----------------------------------------------------------------------------
Time Event Flags Flags
==== ===== ===== =====
Oct 9 14:40:05.120 Advertise to BGP 08204110, 00000000 - -
Oct 9 14:40:05.120 FSM Event (event, state) 00000000, 00010000 - -
Oct 9 14:40:05.120 Encode NLRI 08204110, 00000041 - -
Oct 9 17:20:49.152 Ignore BGP update 00000000, 00000000 M -
----------------------------------------------------------------------------Ti-LFA and CEF info of 33.33.33.33 on R2/PE
RP/0/RP0/CPU0:NCS-5502-A#sh mpls forwarding prefix 33.33.33.33/32
Tue Oct 9 13:31:26.222 UTC
Local Outgoing Prefix Outgoing Next Hop Bytes
Label Label or ID Interface Switched
------ ----------- ------------------ ------------ --------------- ------------
64006 Pop 33.33.33.33/32 Te0/0/0/1/3 23.1.1.3 4280
17003 33.33.33.33/32 Te0/0/0/1/1 24.1.1.4 0 (!)
RP/0/RP0/CPU0:NCS-5502-A#show isis fast-reroute summary
Tue Oct 9 13:41:17.285 UTC
IS-IS yonzhao2 IPv4 Unicast FRR summary
Critical High Medium Low Total
Priority Priority Priority Priority
Prefixes reachable in L2
All paths protected 0 0 4 10 14
Some paths protected 0 0 0 0 0
Unprotected 0 0 0 0 0
Protection coverage 0.00% 0.00% 100.00% 100.00% 100.00%
RP/0/RP0/CPU0:NCS-5502-A#sh cef 33.33.33.33/32 detail
Tue Oct 9 13:42:16.543 UTC
33.33.33.33/32, version 101, labeled SR, internal 0x1000001 0x85 (ptr 0x972c7f18) [1], 0x0 (0x974998a8), 0xa28 (0x98438b10)
Updated Aug 11 07:24:29.586
local adjacency 23.1.1.3
Prefix Len 32, traffic index 0, precedence n/a, priority 15
gateway array (0x9730bc48) reference count 3, flags 0x500068, source lsd (5), 2 backups
[3 type 4 flags 0x8401 (0x97a149b0) ext 0x0 (0x0)]
LW-LDI[type=1, refc=1, ptr=0x974998a8, sh-ldi=0x97a149b0]
gateway array update type-time 1 Aug 11 07:24:29.586
LDI Update time Oct 9 12:51:26.364
LW-LDI-TS Oct 9 12:51:26.364
via 23.1.1.3/32, TenGigE0/0/0/1/3, 14 dependencies, weight 0, class 0, protected [flags 0x400]
path-idx 0 bkup-idx 1 NHID 0x0 [0x9879aa50 0x9879a890]
next hop 23.1.1.3/32
local label 64006 labels imposed {ImplNull}
via 24.1.1.4/32, TenGigE0/0/0/1/1, 14 dependencies, weight 0, class 0, backup (Local-LFA) [flags 0x300]
path-idx 1 NHID 0x0 [0x97d7c530 0x0]
next hop 24.1.1.4/32
local adjacency
local label 64006 labels imposed {17003}
Load distribution: 0 (refcount 3)
Hash OK Interface Address
0 Y TenGigE0/0/0/1/3 23.1.1.3CEF info on R4 and R5
RP/0/RSP0/CPU0:ASR-9010-29A#sh cef 122.122.1.0
Wed Oct 10 20:35:47.999 UTC
122.122.1.0/24, version 18361, internal 0x1000001 0x0 (ptr 0x71df24a8) [1], 0x0 (0x71dc2a38), 0x0 (0x0)
Updated Oct 10 20:23:00.730
remote adjacency to TenGigE0/6/0/3
Prefix Len 24, traffic index 0, precedence n/a, priority 2
via 24.1.1.2/32, TenGigE0/6/0/3, 7 dependencies, weight 0, class 0, protected [flags 0x600]
path-idx 0 bkup-idx 1 NHID 0x0 [0x713cd2ec 0x0]
next hop 24.1.1.2/32
via 34.1.1.3/32, TenGigE0/6/0/4, 7 dependencies, weight 0, class 0, protected [flags 0x600]
path-idx 1 bkup-idx 0 NHID 0x0 [0x713ccb38 0x0]
next hop 34.1.1.3/32
RP/0/RP0/CPU0:ASR-9922-4A4#sh cef 122.122.1.0
Mon Oct 10 05:24:34.613 UTC
122.122.1.0/24, version 4969, internal 0x1000001 0x1 (ptr 0x7215de1c) [1], 0x0 (0x721184e0), 0x0 (0x0)
Updated Oct 10 05:11:36.424
remote adjacency to TenGigE0/2/0/5
Prefix Len 24, traffic index 0, precedence n/a, priority 2
via 25.1.1.2/32, TenGigE0/2/0/5, 6 dependencies, weight 0, class 0, protected [flags 0x600]
path-idx 0 bkup-idx 1 NHID 0x0 [0x7157cd7c 0x0]
next hop 25.1.1.2/32
via 35.1.1.3/32, TenGigE0/2/0/6, 6 dependencies, weight 0, class 0, protected [flags 0x600]
path-idx 1 bkup-idx 0 NHID 0x0 [0x7157d448 0x0]
next hop 35.1.1.3/32Testing and Verifying
Sent traffics between two IXIA
- Many to many, 10000 flows, Bi-Directional in IXIA, 500M traffics
- Traffics flow should same as above traffics topology
- Follow basic line of loss packets:
Shutdown physical link between H1/CE and R3/PE
After shutdown, traffics flow as follow. Due to AC down that cause BVI77 down, so no route deliver to R4/R5
router static
address-family ipv4 unicast
122.122.1.0/24 BVI77 123.1.1.1
Follow EVPN info:
RP/0/RP0/CPU0:NCS-5502-A#show evpn ethernet-segment
esi 11.1111.1111.1111.1111 detail
Tue Oct 9 14:55:30.087 UTC
Legend:
ES to BGP Gates : Ready
ES to L2FIB Gates : Ready
Main port :
Interface name : Bundle-Ether77
Interface MAC : 008a.960c.b0da
IfHandle : 0x0800004c
State : Up
Redundancy : Not Defined
ESI type : 0
Value : 11.1111.1111.1111.1111
ES Import RT : 1111.1111.1111 (Local)
Source MAC : 0000.0000.0000 (N/A)
Topology :
Operational : SH
Configured : All-active (AApF) (default)
Primary Services : Auto-selection
Secondary Services: Auto-selection
Service Carving Results:
Forwarders : 1
Permanent : 0
Elected : 1
Not Elected : 0
MAC Flushing mode : STP-TCN
Peering timer : 3 sec [not running]
Recovery timer : 30 sec [not running]
Carving timer : 0 sec [not running]
Local SHG label : 64021
Remote SHG labels : 0RP/0/RP1/CPU0:NCS5008_SJ_CX#show evpn ethernet-segment
esi 11.1111.1111.1111.1111 detail
Wed Oct 10 12:20:05.789 PDT
Legend:
ES to BGP Gates : M
ES to L2FIB Gates : Ready
Main port :
Interface name : Bundle-Ether77
Interface MAC : 0078.88f3.8c96
IfHandle : 0x088000f4
State : Down
Redundancy : Not Defined
ESI type : 0
Value : 11.1111.1111.1111.1111
ES Import RT : 1111.1111.1111 (Local)
Source MAC : 0000.0000.0000 (N/A)
Topology :
Operational : MH, All-active
Configured : All-active (AApF) (default)
Primary Services : Auto-selection
Secondary Services: Auto-selection
Service Carving Results:
Forwarders : 1
Permanent : 0
Elected : 0
Not Elected : 1
MAC Flushing mode : STP-TCN
Peering timer : 3 sec [not running]
Recovery timer : 30 sec [not running]
Carving timer : 0 sec [not running]
Local SHG label : 64008
Remote SHG labels : 1
64021 : nexthop 22.22.22.22Follow BGP in R2/PE
RP/0/RP0/CPU0:NCS-5502-A#show bgp l2vpn evpn neighbors 33.33.33.33 routes
Tue Oct 9 15:13:41.343 UTC
BGP router identifier 22.22.22.22, local AS number 65001
BGP generic scan interval 60 secs
Non-stop routing is enabled
BGP table state: Active
Table ID: 0x0 RD version: 0
BGP main routing table version 46
BGP NSR Initial initsync version 17 (Reached)
BGP NSR/ISSU Sync-Group versions 0/0
BGP scan interval 60 secs
Status codes: s suppressed, d damped, h history, * valid, > best
i - internal, r RIB-failure, S stale, N Nexthop-discard
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 22.22.22.22:77 (default for vrf 77)
* i[1][0011.1111.1111.1111.1111][0]/120
33.33.33.33 100 0 i
*>i[3][0][32][33.33.33.33]/80
33.33.33.33 100 0 i
Route Distinguisher: 33.33.33.33:77
*>i[1][0011.1111.1111.1111.1111][0]/120
33.33.33.33 100 0 i
*>i[3][0][32][33.33.33.33]/80
33.33.33.33 100 0 i
Processed 4 prefixes, 4 pathsBtw, we can find have some traffcis loss
Recovery and shutdown uplink between R3 and R4
After shutdown, traffics flow as follow. EVPN info not change.
Btw, we can find traffcis loss rate not change, due to have TI-LFA protect:
Reload R3/PE
We can find only little packets drops rate update:
Reference
版权声明：
本文链接：Replaced mLACP and NV Cluster by EVPN + Anycast IRB on NCS5500/Fretta
版权声明：本文为原创文章，仅代表个人观点，版权归 Frank Zhao 所有，转载时请注明本文出处及文章链接