OcNOS-DC : Virtual Extensible LAN Guide : Virtual eXtensible Local Area Network Configuration Guide : VXLAN Multi-homing Configuration
VXLAN Multi-homing Configuration
This chapter contains the configurations for VXLAN Multi-homing feature.
Overview
VXLAN EVPN Multi-homing features enables to connect a CE/Host node to two VTEPs with all-active redundancy mode.EVPN Multi-homing helps in VTEP to host failure and VTEP failure. If one VTEP goes down, other will forward the entire traffic.
Below are Multi-homing concepts:
• Ethernet Segment: Set of links which connect host/CE to two active-active multi-homed VTEP (only two VTEPs are supported) which appears as LACP link for host.
• Ethernet Segment Identifier: Ethernet Segment Identifier (ESI) which is an 10 octet-value, which can be configured in two ways, system mac is configured as esi in case of Dynamic Lag and 10-octet ESI format config is used on physical interface ES.
• Ethernet Segment Route (ES route): When a multi-homed CE is configured as an VXLAN access-port, Ethernet segment route is sent. The main purpose of this route is to discover other VTEPs which share the ES and to perform DF election.
• Ethernet A-D route per ESI: This route is used for Fast Convergence and Split Horizon.
• Ethernet A-D route per EVI: This route is used for load sharing between DF and NON-DF by the remote VTEPs
Topology
VxLAN-Multihoming
Note: Enable VXLAN MUTIHOMING before executing any configurations.
VXLAN-EVPN MH Configuration
ESI can be configured in below two ways
Ethernet Segment through Dynamic Lag interface
 
#configure terminal
Enter configure mode.
(config)#interface po1
Enter interface mode for po1
(config-if)#switchport
Make it L2 interface
(config-if)#evpn multi-homed system-mac 8899.4400.6745
Configure system mac as ESI value for Lag (po1) interface
(config-if)#exit
Exit interface mode.
(config)#commit
Commit the candidate configuration to the running configuration
OR
Ethernet Segment through Physical interface
 
#configure terminal
Enter configure mode.
(config)#interface xe41
Enter interface mode for xe41
(config-if)#switchport
Make it L2 interface
(config-if)# evpn multi-homed esi 00:01:02:03:04:05:06:07:08
Configure 9-octet ESI value for xe41 interface (in static config, out of 10-octet ESI value, first octet is reserved)
(config-if)#exit
Exit interface mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
VTEP1
(Multi-homed group1) – Part of both Multi-homed with po1 (MH1)
Generic Configuration
#configure terminal
Enter Configure mode.
(config)#evpn vxlan multihoming enable
Enable Multihoming, save configs and reboot the board for multihoming to be effective
(config)#qos enable
Enabling QoS
(config)#commit
Commit the candidate configuration to the running configuration
Interface and Loopback Configuration
(config)#interface po1
Enter Interface mode for po1 (MH1)
(config-if)#switchport
Make it L2 interface
(config-if)# evpn multi-homed system-mac 0000.0000.1111
Configure system MAC as ESI value for LAG (po1) interface
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe9
Enter Interface mode for xe9
(config-if)#channel-group 1 mode active
Make it member port of po1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe10
Enter Interface mode for xe10
(config-if)#channel-group 1 mode active
Make it member port of po1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface lo
Enter Interface mode for lo
(config-if)#ip address 1.1.1.1/32 secondary
Configure loopback ip address as 1.1.1.1 for VTEP1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe8
Enter Interface mode for xe8
(config-if)#ip address 10.10.10.1/24
Configure IP address as 10.10.10.1 on network side of Spine1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe31
Enter Interface mode for xe31
(config-if)#ip address 20.20.20.1/24
Configure IP address as 20.20.20.1 on network side of Spine2
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
OSPF Configuration
 
(config)#router ospf 100
Enter into router OSPF mode
(config-router)#ospf router-id 1.1.1.1
Configure router-id as 1.1.1.1 (lo ip address)
(config-router)#network 1.1.1.1/32 area 0.0.0.0
Add 1.1.1.1 (lo IP address) network into area 0
(config-router)#network 10.10.10.0/24 area 0.0.0.0
Add 10.10.10.0 (Spine1) network into area 0
(config-router)#network 20.20.20.0/24 area 0.0.0.0
Add 20.20.20.0 (Spine2) network into area 0
(config-router)#bfd all-interfaces
Enabling BFD on all OSPF interface for fast convergence
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
BGP Configuration
(config)#router bgp 500
Enter into Router BGP mode
(config-router)#bgp router-id 1.1.1.1
Configure router-id as 1.1.1.1 (lo IP address)
(config-router)#neighbor 2.2.2.2 remote-as 500
Specify a VTEP2 loopback IP address and remote-as defined
(config-router)#neighbor 2.2.2.2 update-source lo
Configure update as loopback for VTEP2
(config-router)#neighbor 2.2.2.2 advertisement-interval 0
Configure advertisement-interval as 0 for fast convergence for VTEP2
(config-router)#neighbor 3.3.3.3 remote-as 500
Specify a VTEP3 loopback IP address and remote-as defined
(config-router)#neighbor 3.3.3.3 update-source lo
Configure update as loopback for VTEP3
(config-router)#neighbor 3.3.3.3 advertisement-interval 0
Configure advertisement-interval as 0 for fast convergence for VTEP3
(config-router)#address-family ipv4 unicast
Enter into ipv4 unicast address family mode
(config-router-af)#network 1.1.1.1/32
Advertise loopback network into BGP for VTEP ID reachability
(config-router-af)#neighbor 2.2.2.2 activate
Activate 2.2.2.2 (VTEP2) into ipv4 unicast address family mode
(config-router-af)#neighbor 3.3.3.3 activate
Activate 3.3.3.3 (VTEP2) into ipv4 unicast address family mode
(config-router-af)#exit-address-family
Exit from ipv4 unicast address family mode
(config-router)#address-family l2vpn evpn
Enter into L2VPN EVPN address family mode
(config-router-af)#neighbor 2.2.2.2 activate
Activate 2.2.2.2 (VTEP2) into L2VPN evpn address family mode
(config-router-af)#neighbor 3.3.3.3 activate
Activate 3.3.3.3 (VTEP3) into L2VPN evpn address family mode
(config-router-af)#exit-address-family
Exit from L2VPN address family mode
(config-router)#exit
Exit from Router BGP mode and enter into config mode
(config)#commit
Commit the candidate configuration to the running configuration
 
VRF Configuration
(config)#mac vrf VRF1
Create mac routing/forwarding instance with VRF1 name and enter into VRF mode
(config-vrf)#rd 1.1.1.1:11
Assign RD value
(config-vrf)#route-target both 9.9.9.9:100
Assign route-target value for same for import and export. Should be same on all node for VRF1
(config-vrf)#exit
Exit from VRF mode
(config)#mac vrf VRF2
Create MAC routing/forwarding instance with VRF1 name and enter into VRF mode
(config-vrf)#rd 1.1.1.1:21
Assign RD value
(config-vrf)#route-target both 90.90.90.90:100
Assign route-target value for same for import and export
(config-vrf)#exit
Exit from VRF mode
(config)#commit
Commit the candidate configuration to the running configuration
 
VxLAN Configuration
(config)#nvo vxlan enable
Enable VxLAN
(config)#evpn esi hold-time 90
Configure ESI hold time to allow tunnel to come up at the time of VxLAN initialization before making the ESI up
(config)#nvo vxlan vtep-ip-global 1.1.1.1
Configure Source VTEP-IP-global configuration
(config)#nvo vxlan id 10 ingress-replication inner-vid-disabled
Configure VxLAN Network identifier with/without inner-VID- disabled configure and enter into VxLAN tenant mode
(config-nvo)#vxlan host-reachability-protocol evpn-bgp VRF1
Assign VRF for EVPN-BGP to carry EVPN route
(config-nvo)#vni-name VNI-RED
Configure VNI-name as VNI-RED
(config-nvo)#exit
Exit from VxLAN tenant mode and enter into configuration mode.
(config)#nvo vxlan id 20 ingress-replication inner-vid-disabled
Configure VxLAN Network identifier with/without inner-VID- disabled configure and enter into VxLAN tenant mode
(config-nvo)#vxlan host-reachability-protocol evpn-bgp VRF2
Assign VRF for EVPN-BGP to carry EVPN route
(config-nvo)#vni-name VNI-BLUE
Configure VNI-name as VNI-BLUE
(config-nvo)#exit
Exit from VxLAN tenant mode and enter into configuration mode.
(config)#nvo vxlan access-if port-vlan po1 1001
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-RED
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#nvo vxlan access-if port-vlan po1 1002
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-RED
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#nvo vxlan access-if port-vlan po1 3001
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-BLUE
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#commit
Commit the candidate configuration to the running configuration
(config)#exit
Exit from configuration mode
 
VTEP2
(Multi-homed group1) – Part of both Multi-homed with p01. And it has xe32 as single home access-if port (SH2)
Generic Configuration
#configure terminal
Enter Configure mode.
(config)#evpn vxlan multihoming enable
Enable Multihoming, save configs and reboot the board for multihoming to be effective
(config)#qos enable
Enabling QoS
(config)#commit
Commit the candidate configuration to the running configuration
Interface and Loopback Configuration
(config)#interface po1
Enter Interface mode for po1 (MH1)
(config-if)#switchport
Make it L2 interface
(config-if)# evpn multi-homed system-mac 0000.0000.1111
Configure system MAC as ESI value for LAG (po1) interface
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe3
Enter Interface mode for xe3
(config-if)#channel-group 1 mode active
Make it member port of po1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe4
Enter Interface mode for xe4
(config-if)#channel-group 1 mode active
Make it member port of po1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe32
Enter Interface mode for xe32 (SH2)
(config-if)#switchport
Make it L2 interface
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface lo
Enter Interface mode for lo
(config-if)#ip address 2.2.2.2/32 secondary
Configure loopback IP address as 2.2.2.2 for VTEP2
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe21
Enter Interface mode for xe21
(config-if)#ip address 30.30.30.1/24
Configure IP address as 30.30.30.1 on network side of Spine1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface ce53
Enter Interface mode for ce53
(config-if)#ip address 40.40.40.1/24
Configure IP address as 40.40.40.1 on network side of Spine2
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
OSPF Configuration
(config)#router ospf 100
Enter into router OSPF mode
(config-router)#ospf router-id 2.2.2.2
Configure router-id as 2.2.2.2 (lo IP address)
(config-router)#network 2.2.2.2/32 area 0.0.0.0
Add 2.2.2.2 (lo IP address) network into area 0
(config-router)#network 30.30.30.0/24 area 0.0.0.0
Add 30.30.30.0 (Spine1) network into area 0
(config-router)#network 40.40.40.0/24 area 0.0.0.0
Add 40.40.40.0 (Spine2) network into area 0
(config-router)#bfd all-interfaces
Enabling BFD on all OSPF interface for fast convergence
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
BGP Configuration
(config)#router bgp 500
Enter into Router BGP mode
(config-router)#bgp router-id 2.2.2.2
Configure router-id as 2.2.2.2 (lo IP address)
(config-router)#neighbor 1.1.1.1 remote-as 500
Specify a VTEP1 loopback IP address and remote-as defined
(config-router)#neighbor 1.1.1.1 update-source lo
Configure update as loopback for VTEP1
(config-router)#neighbor 1.1.1.1 advertisement-interval 0
Configure advertisement-interval as 0 for fast convergence for VTEP1
(config-router)#neighbor 3.3.3.3 remote-as 500
Specify a VTEP3 loopback IP address and remote-as defined
(config-router)#neighbor 3.3.3.3 update-source lo
Configure update as loopback for VTEP3
(config-router)#neighbor 3.3.3.3 advertisement-interval 0
Configure advertisement-interval as 0 for fast convergence for VTEP3
(config-router)#address-family ipv4 unicast
Enter into ipv4 unicast address family mode
(config-router-af)#network 2.2.2.2/32
Advertise loopback network into BGP for VTEP ID reachability
(config-router-af)#neighbor 1.1.1.1 activate
Activate 1.1.1.1 (VTEP2) into ipv4 unicast address family mode
(config-router-af)#neighbor 3.3.3.3 activate
Activate 3.3.3.3 (VTEP2) into ipv4 unicast address family mode
(config-router-af)#exit-address-family
Exit from ipv4 unicast address family mode
(config-router)#address-family l2vpn evpn
Enter into L2VPN EVPN address family mode
(config-router-af)#neighbor 1.1.1.1 activate
Activate 1.1.1.1(VTEP1) into L2VPN evpn address family mode
(config-router-af)#neighbor 3.3.3.3 activate
Activate 3.3.3.3(VTEP3) into L2VPN evpn address family mode
(config-router-af)#exit-address-family
Exit from L2VPN address family mode
(config-router)#exit
Exit from Router BGP mode and enter into config mode
(config)#commit
Commit the candidate configuration to the running configuration
 
VRF Configuration
(config)# mac vrf VRF1
Create mac routing/forwarding instance with VRF1 name and enter into VRF mode
(config-vrf)#rd 2.2.2.2:11
Assign RD value
(config-vrf)#route-target both 9.9.9.9:100
Assign route-target value for same for import and export. Should be same on all node for VRF1
(config-vrf)#exit
Exit from VRF mode
(config)#mac vrf VRF2
Create MAC routing/forwarding instance with VRF1 name and enter into VRF mode
(config-vrf)#rd 2.2.2.2:21
Assign RD value
(config-vrf)#route-target both 90.90.90.90:100
Assign route-target value for same for import and export
(config-vrf)#exit
Exit from VRF mode
(config)#commit
Commit the candidate configuration to the running configuration
VxLAN Configuration
(config)#nvo vxlan enable
Enable VxLAN
(config)#evpn esi hold-time 90
Configure ESI hold time to allow tunnel to come up at the time of VxLAN initialization before making the ESI up
(config)#nvo vxlan vtep-ip-global 2.2.2.2
Configure Source VTEP-IP-global configuration
(config)#nvo vxlan id 10 ingress-replication inner-vid-disabled
Configure VxLAN Network identifier with/without inner-VID- disabled configure and enter into VxLAN tenant mode
(config-nvo)#vxlan host-reachability-protocol evpn-bgp VRF1
Assign VRF for EVPN-BGP to carry EVPN route
(config-nvo)#vni-name VNI-RED
Configure VNI-name as VNI-RED
(config-nvo)#exit
Exit from VxLAN tenant mode and enter into configuration mode.
(config)#nvo vxlan id 20 ingress-replication inner-vid-disabled
Configure VxLAN Network identifier with/without inner-VID- disabled configure and enter into VxLAN tenant mode
(config-nvo)#vxlan host-reachability-protocol evpn-bgp VRF2
Assign VRF for EVPN-BGP to carry EVPN route
(config-nvo)#vni-name VNI-BLUE
Configure VNI-name as VNI-BLUE
(config-nvo)#exit
Exit from VxLAN tenant mode and enter into configuration mode.
(config)#nvo vxlan access-if port-vlan po1 1001
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-RED
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#nvo vxlan access-if port-vlan po1 1002
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-RED
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VXLAN access-interface mode and enter into configuration mode
(config)#nvo vxlan access-if port-vlan po1 3001
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-BLUE
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#nvo vxlan access-if port xe32
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-RED
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#commit
Commit the candidate configuration to the running configuration
(config)#exit
Exit from configuration mode
 
VTEP3
It has xe48 as Single home access-if port (SH2)
Generic Configuration
#configure terminal
Enter Configure mode.
(config)#evpn vxlan multihoming enable
Enable Multihoming, save configs and reboot the board for multihoming to be effective
(config)#qos enable
Enabling QoS
(config)#commit
Commit the candidate configuration to the running configuration
Interface and loopback configuration
(config)#interface xe48
Enter Interface mode for xe48 (SH3)
(config-if)#switchport
Make it L2 interface
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface lo
Enter Interface mode for lo
(config-if)#ip address 3.3.3.3/32 secondary
Configure loopback IP address as 3.3.3.3 for VTEP3
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe18
Enter Interface mode for xe18
(config-if)#ip address 50.50.50.1/24
Configure IP address as 50.50.50.1 on network side of Spine1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe19
Enter Interface mode for xe19
(config-if)#ip address 60.60.60.1/24
Configure IP address as 60.60.60.1 on network side of Spine2
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
OSPF Configuration
 
(config)#router ospf 100
Enter into router OSPF mode
(config-router)#ospf router-id 3.3.3.3
Configure router-ID as 3.3.3.3 (lo IP address)
(config-router)#network 3.3.3.3/32 area 0.0.0.0
Add 3.3.3.3 (lo IP address) network into area 0
(config-router)#network 50.50.50.0/24 area 0.0.0.0
Add 50.50.50.0 (Spine1) network into area 0
(config-router)#network 60.60.60.0/24 area 0.0.0.0
Add 60.60.60.0 (Spine2) network into area 0
(config-router)#bfd all-interfaces
Enabling BFD on all OSPF interface for fast convergence
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
BGP Configuration
(config)#router bgp 500
Enter into Router BGP mode
(config-router)#bgp router-id 3.3.3.3
Configure router-ID as 3.3.3.3 (lo ip address)
(config-router)#neighbor 1.1.1.1 remote-as 500
Specify a VTEP1 loopback IP address and remote-as defined
(config-router)#neighbor 1.1.1.1 update-source lo
Configure update as loopback for VTEP1
(config-router)#neighbor 1.1.1.1 advertisement-interval 0
Configure advertisement-interval as 0 for fast convergence for VTEP1
(config-router)#neighbor 2.2.2.2 remote-as 500
Specify a VTEP2 loopback IP address and remote-as defined
(config-router)#neighbor 2.2.2.2 update-source lo
Configure update as loopback for VTEP2
(config-router)#neighbor 2.2.2.2 advertisement-interval 0
Configure advertisement-interval as 0 for fast convergence for VTEP3
(config-router)#address-family ipv4 unicast
Enter into ipv4 unicast address family mode
(config-router-af)#network 3.3.3.3/32
Advertise loopback network into BGP for VTEP ID reachability
(config-router-af)#neighbor 1.1.1.1 activate
Activate 1.1.1.1 (VTEP2) into ipv4 unicast address family mode
(config-router-af)#neighbor 2.2.2.2 activate
Activate 2.2.2.2 (VTEP2) into ipv4 unicast address family mode
(config-router-af)#exit-address-family
Exit from ipv4 unicast address family mode
(config-router)#address-family l2vpn evpn
Enter into L2VPN EVPN address family mode
(config-router-af)#neighbor 1.1.1.1 activate
Activate 1.1.1.1 (VTEP1) into L2VPN evpn address family mode
(config-router-af)#neighbor 2.2.2.2 activate
Activate 2.2.2.2 (VTEP2) into L2VPN evpn address family mode
(config-router-af)#exit-address-family
Exit from L2VPN address family mode
(config-router)#exit
Exit from Router BGP mode and enter into config mode
(config)#commit
Commit the candidate configuration to the running configuration
 
VRF Configuration
(config)# mac vrf VRF1
Create MAC routing/forwarding instance with VRF1 name and enter into VRF mode
(config-vrf)#rd 3.3.3.3:11
Assign RD value
(config-vrf)#route-target both 9.9.9.9:100
Assign route-target value for same for import and export. Should be same on all node for VRF1
(config-vrf)#exit
Exit from VRF mode
(config)#mac vrf VRF2
Create MAC routing/forwarding instance with VRF2 name and enter into VRF mode
(config-vrf)#rd 3.3.3.3:21
Assign RD value
(config-vrf)#route-target both 90.90.90.90:100
Assign route-target value for same for import and export
(config-vrf)#exit
Exit from VRF
(config)#commit
Commit the candidate configuration to the running configuration
 
VxLAN Configuration
(config)#nvo vxlan enable
Enable VxLAN
(config)#nvo vxlan vtep-ip-global 3.3.3.3
Configure Source VTEP-IP-global configuration
(config)#nvo vxlan id 10 ingress-replication inner-vid-disabled
Configure VxLAN Network identifier with/without inner-VID- disabled configure and enter into VxLAN tenant mode
(config-nvo)#vxlan host-reachability-protocol evpn-bgp VRF1
Assign VRF for EVPN-BGP to carry EVPN route
(config-nvo)#vni-name VNI-RED
Configure VNI-name as VNI-RED
(config-nvo)#exit
Exit from VxLAN tenant mode and enter into configuration mode.
(config)#nvo vxlan id 20 ingress-replication inner-vid-disabled
Configure VxLAN Network identifier with/without inner-VID- disabled configure and enter into VxLAN tenant mode
(config-nvo)#vxlan host-reachability-protocol evpn-bgp VRF2
Assign VRF for EVPN-BGP to carry EVPN route
(config-nvo)#vni-name VNI-BLUE
Configure VNI-name as VNI-BLUE
(config-nvo)#exit
Exit from VxLAN tenant mode and enter into configuration mode.
(config)#nvo vxlan access-if port-vlan xe48 1001
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-RED
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#nvo vxlan access-if port-vlan xe48 1002
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-RED
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#nvo vxlan access-if port-vlan xe48 3001
Enable port-VLAN mapping i.e. access port to outer-VLAN (SVLAN) - Multihomed access port
(config-nvo-acc-if)#map vni-name VNI-BLUE
Map VxLAN Identified to access-port for VxLAN
(config-nvo-acc-if)#exit
Exit from VxLAN access-interface mode and enter into configuration mode
(config)#commit
Commit the candidate configuration to the running configuration
(config)#exit
Exit from configuration mode
 
Switch (CE2)
Multihomed to 2-VTEPs (VTEP1 and VTEP2)
#configure terminal
Enter Configure mode.
(config)#bridge 1 protocol ieee vlan-bridge
Configure IEEE VLAN bridge
(config)#vlan 1001-1002 bridge 1 state enable
Configure VLANs from 1001-1002 and associate with bridge 1
(config)#vlan 3001 bridge 1 state enable
Configure VLANs from 3001 and associate with bridge 1
(config)#interface xe22
Enter Interface mode for xe22
(config-if)#switchport
Make xe22 as L2 port by configuring switchport
(config-if)#bridge-group 1
Associate xe22 to bridge 1
(config-if)#switchport mode hybrid
Configure xe22 as hybrid port
(config-if)#switchport hybrid allowed vlan add 1001-1002,3001 egress-tagged enable
Allow 1001-1002 and 3001 configured VLANs on xe22
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface po1
Enter Interface mode for po1
(config-if)#switchport
Make po1 as L2 port by configuring switchport
(config-if)#bridge-group 1
Associate po1 to bridge 1
(config-if)#switchport mode hybrid
Configure po1 as hybrid port
(config-if)#switchport hybrid allowed vlan add 1001-1002,3001 egress-tagged enable
Allow 1001-1002 and 3001 configured VLANs on po1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe3
Enter Interface mode for xe3
(config-if)#channel-group 1 mode active
Make it member port of po1
(config)#interface xe4
Enter Interface mode for xe4
(config-if)#channel-group 1 mode active
Make it member port of po1
(config)#exit
Exit from configuration mode
(config)#interface xe9
Enter Interface mode for xe9
(config-if)#channel-group 1 mode active
Make it member port of po1
(config)#interface xe10
Enter Interface mode for xe10
(config-if)#channel-group 1 mode active
Make it member port of po1
(config)#exit
Exit from configuration mode
(config)#commit
Commit the candidate configuration to the running configuration
(config)#exit
Exit from configuration mode
Spine 1
Spine node where all VTEPs are connected
Generic Configuration
#configure terminal
Enter Configure mode.
(config)#qos enable
Enabling QoS
(config)#commit
Commit the candidate configuration to the running configuration
Interface and Loopback Configuration
#configure terminal
Enter Configure mode.
(config)#qos enable
Enabling QoS
(config)#interface lo
Enter Interface mode for lo
(config-if)#ip address 11.11.11.11/32 secondary
Configure loopback IP address as 11.11.11.11 for Spine1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe8
Enter Interface mode for xe8
(config-if)#ip address 10.10.10.2/24
Configure IP address as 10.10.10.2 on network side of VTEP1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe1
Enter Interface mode for xe1
(config-if)#ip address 30.30.30.2/24
Configure IP address as 30.30.30.2 on network side of VTEP2
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe18
Enter Interface mode for xe18
(config-if)#ip address 50.50.50.2/24
Configure IP address as 50.50.50.2 on network side of VTEP3
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
OSPF configuration
(config)#router ospf 100
Enter into router OSPF mode
(config-router)#ospf router-id 11.11.11.11
Configure router-ID as 11.11.11.11 (lo IP address)
(config-router)#network 11.11.11.11/32 area 0.0.0.0
Add 11.11.11.11 (lo IP address) network into area 0
(config-router)#network 10.10.10.0/24 area 0.0.0.0
Add 10.10.10.0 (VTEP1) network into area 0
(config-router)#network 30.30.30.0/24 area 0.0.0.0
Add 30.30.30.0 (VTEP2) network into area 0
(config-router)#network 50.50.50.0/24 area 0.0.0.0
Add 50.50.50.0 (VTEP3) network into area 0
(config-router)#bfd all-interfaces
Enabling BFD on all OSPF interface for fast convergence
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
Spine 2
Spine node where all VTEPs are connected
Generic configuration
#configure terminal
Enter Configure mode.
(config)#qos enable
Enabling QoS
(config)#commit
Commit the candidate configuration to the running configuration
Interface and loopback configuration
(config)#interface lo
Enter Interface mode for lo
(config-if)#ip address 22.22.22.22/32 secondary
Configure loopback IP address as 22.22.22.22 for Spine2
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe5
Enter Interface mode for xe5
(config-if)#ip address 20.20.20.2/24
Configure IP address as 20.20.20.2 on network side of VTEP1
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface ce0
Enter Interface mode for ce0
(config-if)#ip address 40.40.40.2/24
Configure IP address as 40.40.40.2 on network side of VTEP2
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#interface xe19
Enter Interface mode for xe19
(config-if)#ip address 60.60.60.2/24
Configure IP address as 60.60.60.2 on network side of VTEP3
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
OSPF configuration
(config)#router ospf 100
Enter into router OSPF mode
(config-router)#ospf router-id 22.22.22.22
Configure router-id as 11.11.11.11 (lo IP address)
(config-router)#network 22.22.22.22/32 area 0.0.0.0
Add 22.22.22.22 (lo IP address) network into area 0
(config-router)#network 20.20.20.0/24 area 0.0.0.0
Add 20.20.20.0 (VTEP1) network into area 0
(config-router)#network 40.40.40.0/24 area 0.0.0.0
Add 40.40.40.0 (VTEP2) network into area 0
(config-router)#network 60.60.60.0/24 area 0.0.0.0
Add 60.60.60.0 (VTEP3) network into area 0
(config-router)#bfd all-interfaces
Enabling BFD on all OSPF interface for fast convergence
(config-if)#exit
Exit Interface mode and return to Configure mode.
(config)#commit
Commit the candidate configuration to the running configuration
 
Validation
 
VTEP1
 
VTEP1#show nvo vxlan
VXLAN Information
=================
Codes: NW - Network Port
AC - Access Port
(u) - Untagged
 
VNID VNI-Name VNI-Type Type Interface ESI VLAN DF-Status Src-Addr Dst-Addr
_________________________________________________________________________________________________________________
10 VNI-RED L2 NW ---- ---- ---- ---- 1.1.1.1 3.3.3.3
10 VNI-RED L2 NW ---- ---- ---- ---- 1.1.1.1 2.2.2.2
10 VNI-RED -- AC po1 00:00:00:00:00:11:11:00:00:00 1001 NON-DF ---- ----
10 VNI-RED -- AC po1 00:00:00:00:00:11:11:00:00:00 1002 DF ---- ----
20 VNI-BLUE L2 NW ---- ---- ---- ---- 1.1.1.1 3.3.3.3
20 VNI-BLUE L2 NW ---- ---- ---- ---- 1.1.1.1 2.2.2.2
20 VNI-BLUE -- AC po1 00:00:00:00:00:11:11:00:00:00 3001 NON-DF ---- ----
 
Total number of entries are 7
 
VTEP1#show nvo vxlan access-if brief
 
Inner Admin Link
Interface Vlan vlan Ifindex Vnid status status
-----------------------------------------------------------
po1 1002 --- 500001 10 up up
po1 1001 --- 500000 10 up up
po1 3001 --- 500002 20 up up
 
Total number of entries are 3
 
VTEP1#show bgp l2vpn evpn summary
BGP router identifier 1.1.1.1, local AS number 500
BGP table version is 6
1 BGP AS-PATH entries
0 BGP community entries
 
Neighbor V AS MsgRcv MsgSen TblVer InQ OutQ Up/Down State/PfxRcd AD MACIP MCAST ESI PREFIX-ROUTE
2.2.2.2 4 500 161 163 5 0 0 01:05:15 6 3 0 2 1 0
3.3.3.3 4 500 157 161 5 0 0 01:05:07 2 0 0 2 0 0
 
Total number of neighbors 2
 
Total number of Established sessions 2
 
VTEP1#show nvo vxlan tunnel
VXLAN Network tunnel Entries
Source Destination Status Up/Down Update
============================================================================
1.1.1.1 3.3.3.3 Installed 00:31:11 00:31:11
1.1.1.1 2.2.2.2 Installed 01:05:25 00:31:11
 
Total number of entries are 2
 
VTEP1#show bgp l2vpn evpn multihoming es-route
 
RD[1.1.1.1:1] VRF[evpn-gvrf-1]:
ESI PE IP-Address Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 1.1.1.1 1.1.1.1 VXLAN
00:00:00:00:00:11:11:00:00:00 2.2.2.2 2.2.2.2 VXLAN
 
RD[2.2.2.2:1]
ESI PE IP-Address Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 2.2.2.2 2.2.2.2 VXLAN
 
VTEP1#show bgp l2vpn evpn multihoming ethernet-ad-per-es
 
RD[1.1.1.1:1] VRF[evpn-gvrf-1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 1.1.1.1 VXLAN
 
RD[1.1.1.1:11] VRF[VRF1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 2.2.2.2 VXLAN
 
RD[1.1.1.1:21] VRF[VRF2]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 2.2.2.2 VXLAN
 
RD[2.2.2.2:1]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 2.2.2.2 VXLAN
VTEP1#show bgp l2vpn evpn multihoming ethernet-ad-per-evi
 
RD[1.1.1.1:11] VRF[VRF1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 10 10 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 10 10 1.1.1.1 VXLAN
 
RD[1.1.1.1:21] VRF[VRF2]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 20 20 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 20 20 1.1.1.1 VXLAN
 
RD[2.2.2.2:11]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 10 10 2.2.2.2 VXLAN
 
RD[2.2.2.2:21]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 20 20 2.2.2.2 VXLAN
 
VTEP1#show bgp l2vpn evpn
BGP table version is 6, local router ID is 1.1.1.1
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal,
l - labeled, S Stale
Origin codes: i - IGP, e - EGP, ? - incomplete
 
[EVPN route type]:[ESI]:[VNID]:[relevent route informantion]
1 - Ethernet Auto-discovery Route
2 - MAC/IP Route
3 - Inclusive Multicast Route
4 - Ethernet Segment Route
5 - Prefix Route
 
Network Next Hop Metric LocPrf Weight Path Peer Encap
 
RD[1.1.1.1:1] VRF[evpn-gvrf-1]:
*> [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
1.1.1.1 0 100 32768 i ---------- VXLAN
*> [4]:[00:00:00:00:00:11:11:00:00:00]:[32,1.1.1.1]
1.1.1.1 0 100 32768 i ---------- VXLAN
* i [4]:[00:00:00:00:00:11:11:00:00:00]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
 
RD[1.1.1.1:11] VRF[VRF1]:
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[10]:[10]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*> 1.1.1.1 0 100 32768 i ---------- VXLAN
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*> [3]:[10]:[32,1.1.1.1]
1.1.1.1 0 100 32768 i ---------- VXLAN
* i [3]:[10]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
* i [3]:[10]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
RD[1.1.1.1:21] VRF[VRF2]:
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[20]:[20]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*> 1.1.1.1 0 100 32768 i ---------- VXLAN
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*> [3]:[20]:[32,1.1.1.1]
1.1.1.1 0 100 32768 i ---------- VXLAN
* i [3]:[20]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
* i [3]:[20]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
RD[2.2.2.2:1]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*>i [4]:[00:00:00:00:00:11:11:00:00:00]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
 
RD[2.2.2.2:11]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[10]:[10]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*>i [3]:[10]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
 
RD[2.2.2.2:21]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[20]:[20]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*>i [3]:[20]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
 
RD[3.3.3.3:11]
*>i [3]:[10]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
RD[3.3.3.3:21]
*>i [3]:[20]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
Total number of prefixes 21
 
VTEP2
VTEP2#show nvo vxlan
VXLAN Information
=================
Codes: NW - Network Port
AC - Access Port
(u) - Untagged
 
VNID VNI-Name VNI-Type Type Interface ESI VLAN DF-Status Src-Addr Dst-Addr
_________________________________________________________________________________________________________________
10 VNI-RED L2 NW ---- ---- ---- ---- 2.2.2.2 1.1.1.1
10 VNI-RED L2 NW ---- ---- ---- ---- 2.2.2.2 3.3.3.3
10 VNI-RED -- AC xe32 --- Single Homed Port --- ---- ---- ---- ----
10 VNI-RED -- AC po1 00:00:00:00:00:11:11:00:00:00 1001 DF ---- ----
10 VNI-RED -- AC po1 00:00:00:00:00:11:11:00:00:00 1002 NON-DF ---- ----
20 VNI-BLUE L2 NW ---- ---- ---- ---- 2.2.2.2 1.1.1.1
20 VNI-BLUE L2 NW ---- ---- ---- ---- 2.2.2.2 3.3.3.3
20 VNI-BLUE -- AC po1 00:00:00:00:00:11:11:00:00:00 3001 DF ---- ----
 
Total number of entries are 8
 
VTEP2#show nvo vxlan access-if
% Incomplete command.
 
VTEP2#show nvo vxlan access-if brief
 
Inner Admin Link
Interface Vlan vlan Ifindex Vnid status status
-----------------------------------------------------------
xe32 --- --- 500004 10 up up
po1 1002 --- 500001 10 up up
po1 1001 --- 500000 10 up up
po1 3001 --- 500002 20 up up
 
Total number of entries are 4
 
VTEP2#show bgp l2vpn evpn summary
BGP router identifier 2.2.2.2, local AS number 500
BGP table version is 4
1 BGP AS-PATH entries
0 BGP community entries
 
Neighbor V AS MsgRcv MsgSen TblVer InQ OutQ Up/Down State/PfxRcd AD MACIP MCAST ESI PREFIX-ROUTE
1.1.1.1 4 500 172 171 4 0 0 01:09:28 6 3 0 2 1 0
3.3.3.3 4 500 165 173 4 0 0 01:09:29 2 0 0 2 0 0
 
Total number of neighbors 2
 
Total number of Established sessions 2
 
VTEP2#show nvo vxlan tunnel
VXLAN Network tunnel Entries
Source Destination Status Up/Down Update
============================================================================
2.2.2.2 1.1.1.1 Installed 01:09:38 00:35:24
2.2.2.2 3.3.3.3 Installed 01:09:39 01:09:39
 
Total number of entries are 2
 
VTEP2#show bgp l2vpn evpn multihoming es-route
 
RD[1.1.1.1:1]
ESI PE IP-Address Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 1.1.1.1 1.1.1.1 VXLAN
 
RD[2.2.2.2:1] VRF[evpn-gvrf-1]:
ESI PE IP-Address Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 1.1.1.1 1.1.1.1 VXLAN
00:00:00:00:00:11:11:00:00:00 2.2.2.2 2.2.2.2 VXLAN
VTEP2#show bgp l2vpn evpn multihoming ethernet-ad-per-es
 
RD[1.1.1.1:1]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 1.1.1.1 VXLAN
 
RD[2.2.2.2:1] VRF[evpn-gvrf-1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 2.2.2.2 VXLAN
 
RD[2.2.2.2:11] VRF[VRF1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 1.1.1.1 VXLAN
 
RD[2.2.2.2:21] VRF[VRF2]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 1.1.1.1 VXLAN
 
VTEP2#show bgp l2vpn evpn multihoming ethernet-ad-per-evi
 
RD[1.1.1.1:11]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 10 10 1.1.1.1 VXLAN
 
RD[1.1.1.1:21]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 20 20 1.1.1.1 VXLAN
 
RD[2.2.2.2:11] VRF[VRF1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 10 10 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 10 10 1.1.1.1 VXLAN
 
RD[2.2.2.2:21] VRF[VRF2]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 20 20 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 20 20 1.1.1.1 VXLAN
 
VTEP2# show bgp l2vpn evpn
BGP table version is 4, local router ID is 2.2.2.2
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal,
l - labeled, S Stale
Origin codes: i - IGP, e - EGP, ? - incomplete
 
[EVPN route type]:[ESI]:[VNID]:[relevent route informantion]
1 - Ethernet Auto-discovery Route
2 - MAC/IP Route
3 - Inclusive Multicast Route
4 - Ethernet Segment Route
5 - Prefix Route
 
Network Next Hop Metric LocPrf Weight Path Peer Encap
 
RD[1.1.1.1:1]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*>i [4]:[00:00:00:00:00:11:11:00:00:00]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
 
RD[1.1.1.1:11]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[10]:[10]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*>i [3]:[10]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
 
RD[1.1.1.1:21]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[20]:[20]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*>i [3]:[20]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
 
RD[2.2.2.2:1] VRF[evpn-gvrf-1]:
*> [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
2.2.2.2 0 100 32768 i ---------- VXLAN
* i [4]:[00:00:00:00:00:11:11:00:00:00]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*> [4]:[00:00:00:00:00:11:11:00:00:00]:[32,2.2.2.2]
2.2.2.2 0 100 32768 i ---------- VXLAN
 
RD[2.2.2.2:11] VRF[VRF1]:
*> [1]:[00:00:00:00:00:11:11:00:00:00]:[10]:[10]
2.2.2.2 0 100 32768 i ---------- VXLAN
* i 1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [3]:[10]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*> [3]:[10]:[32,2.2.2.2]
2.2.2.2 0 100 32768 i ---------- VXLAN
* i [3]:[10]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
RD[2.2.2.2:21] VRF[VRF2]:
*> [1]:[00:00:00:00:00:11:11:00:00:00]:[20]:[20]
2.2.2.2 0 100 32768 i ---------- VXLAN
* i 1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [3]:[20]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*> [3]:[20]:[32,2.2.2.2]
2.2.2.2 0 100 32768 i ---------- VXLAN
* i [3]:[20]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
RD[3.3.3.3:11]
*>i [3]:[10]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
RD[3.3.3.3:21]
*>i [3]:[20]:[32,3.3.3.3]
3.3.3.3 0 100 0 i 3.3.3.3 VXLAN
 
Total number of prefixes 21
 
VTEP3
VTEP3# show nvo vxlan
VXLAN Information
=================
Codes: NW - Network Port
AC - Access Port
(u) - Untagged
 
VNID VNI-Name VNI-Type Type Interface ESI VLAN DF-Status Src-Addr Dst-Addr
_______________________________________________________________________________________________________________________________
10 VNI-RED L2 NW ---- ---- ---- ---- 3.3.3.3 2.2.2.2
10 VNI-RED L2 NW ---- ---- ---- ---- 3.3.3.3 1.1.1.1
10 VNI-RED -- AC xe48 --- Single Homed Port --- 1001 ---- ---- ----
10 VNI-RED -- AC xe48 --- Single Homed Port --- 1002 ---- ---- ----
20 VNI-BLUE L2 NW ---- ---- ---- ---- 3.3.3.3 2.2.2.2
20 VNI-BLUE L2 NW ---- ---- ---- ---- 3.3.3.3 1.1.1.1
20 VNI-BLUE -- AC xe48 --- Single Homed Port --- 3001 ---- ---- ----
 
Total number of entries are 7
 
VTEP3#show nvo vxlan access-if brief
 
Inner Admin Link
Interface Vlan vlan Ifindex Vnid status status
-----------------------------------------------------------
xe48 1002 --- 500001 10 up up
xe48 1001 --- 500000 10 up up
xe48 3001 --- 500002 20 up up
 
Total number of entries are 3
 
VTEP3#show bgp l2vpn evpn summary
BGP router identifier 3.3.3.3, local AS number 500
BGP table version is 4
1 BGP AS-PATH entries
0 BGP community entries
 
Neighbor V AS MsgRcv MsgSen TblVer InQ OutQ Up/Down State/PfxRcd AD MACIP MCAST ESI PREFIX-ROUTE
1.1.1.1 4 500 177 173 3 0 0 01:11:49 6 3 0 2 1 0
2.2.2.2 4 500 177 171 2 0 0 01:11:59 6 3 0 2 1 0
 
Total number of neighbors 2
 
Total number of Established sessions 2
 
VTEP3#show nvo vxlan tunnel
VXLAN Network tunnel Entries
Source Destination Status Up/Down Update
============================================================================
3.3.3.3 2.2.2.2 Installed 01:12:10 01:12:10
3.3.3.3 1.1.1.1 Installed 01:12:00 01:12:00
 
Total number of entries are 2
 
VTEP3#show bgp l2vpn evpn multihoming es-route
 
RD[1.1.1.1:1]
ESI PE IP-Address Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 1.1.1.1 1.1.1.1 VXLAN
 
RD[2.2.2.2:1]
ESI PE IP-Address Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 2.2.2.2 2.2.2.2 VXLAN
 
VTEP3#show bgp l2vpn evpn multihoming ethernet-ad-per-es
 
RD[1.1.1.1:1]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 1.1.1.1 VXLAN
 
RD[2.2.2.2:1]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 2.2.2.2 VXLAN
 
RD[3.3.3.3:11] VRF[VRF1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 4294967295 0 1.1.1.1 VXLAN
 
RD[3.3.3.3:21] VRF[VRF2]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 4294967295 0 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 4294967295 0 1.1.1.1 VXLAN
 
VTEP3#show bgp l2vpn evpn multihoming ethernet-ad-per-evi
 
RD[1.1.1.1:11]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 10 10 1.1.1.1 VXLAN
 
RD[1.1.1.1:21]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 20 20 1.1.1.1 VXLAN
 
RD[2.2.2.2:11]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 10 10 2.2.2.2 VXLAN
 
RD[2.2.2.2:21]
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 20 20 2.2.2.2 VXLAN
 
RD[3.3.3.3:11] VRF[VRF1]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 10 10 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 10 10 1.1.1.1 VXLAN
 
RD[3.3.3.3:21] VRF[VRF2]:
ESI Eth-Tag VNID/LABEL Nexthop IP Encap
00:00:00:00:00:11:11:00:00:00 20 20 2.2.2.2 VXLAN
00:00:00:00:00:11:11:00:00:00 20 20 1.1.1.1 VXLAN
 
VTEP3#show bgp l2vpn evpn
BGP table version is 4, local router ID is 3.3.3.3
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal,
l - labeled, S Stale
Origin codes: i - IGP, e - EGP, ? - incomplete
 
[EVPN route type]:[ESI]:[VNID]:[relevent route informantion]
1 - Ethernet Auto-discovery Route
2 - MAC/IP Route
3 - Inclusive Multicast Route
4 - Ethernet Segment Route
5 - Prefix Route
 
Network Next Hop Metric LocPrf Weight Path Peer Encap
 
RD[1.1.1.1:1]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*>i [4]:[00:00:00:00:00:11:11:00:00:00]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
 
RD[1.1.1.1:11]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[10]:[10]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*>i [3]:[10]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
 
RD[1.1.1.1:21]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[20]:[20]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
*>i [3]:[20]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
 
RD[2.2.2.2:1]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*>i [4]:[00:00:00:00:00:11:11:00:00:00]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
 
RD[2.2.2.2:11]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[10]:[10]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*>i [3]:[10]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
 
RD[2.2.2.2:21]
*>i [1]:[00:00:00:00:00:11:11:00:00:00]:[20]:[20]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*>i [3]:[20]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
 
RD[3.3.3.3:11] VRF[VRF1]:
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[10]:[10]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
* i 1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
* i 1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [3]:[10]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [3]:[10]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*> [3]:[10]:[32,3.3.3.3]
3.3.3.3 0 100 32768 i ---------- VXLAN
 
RD[3.3.3.3:21] VRF[VRF2]:
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[20]:[20]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
* i 1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [1]:[00:00:00:00:00:11:11:00:00:00]:[4294967295]:[0]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
* i 1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [3]:[20]:[32,1.1.1.1]
1.1.1.1 0 100 0 i 1.1.1.1 VXLAN
* i [3]:[20]:[32,2.2.2.2]
2.2.2.2 0 100 0 i 2.2.2.2 VXLAN
*> [3]:[20]:[32,3.3.3.3]
3.3.3.3 0 100 32768 i ---------- VXLAN
 
Total number of prefixes 22
 
Static MAC-IP advertise through Single Home and Multihomed VTEPs
Advertise static MAC IPv4 from MH1 and SH3.
MH1-VTEPs: VTEP1 & VTEP2- same MAC should be configured on both VTEPs under po access-port, configs should be symmetric between MH VTEPs
SH3-VTEP: VTEP3
 
VTEP1(MH1)
#configure terminal
Enter Configure mode.
(config)# nvo vxlan access-if port-vlan po1 1001
Enter into VxLAN MH po1 access-port with VLAN 1001
(config-nvo-acc-if)#mac 0000.1111.1001 ip 11.11.10.1
Configure static MAC IP
(config-nvo-acc-if)#exit
Exit from VxLAN access-port config mode
(config)#commit
Commit the candidate configuration to the running configuration
(config)#exit
Exit from configuration mode
 
VTEP2(MH1)
#configure terminal
Enter Configure mode.
(config)#nvo vxlan access-if port-vlan po1 1001
Enter into VxLAN MH po1 access-port with vlan 1001
(config-nvo-acc-if)# mac 0000.1111.1001 ip 11.11.10.1
Configure static MAC IP
(config-nvo-acc-if)#exit
Exit from VxLAN access-port config mode
(config)#commit
Commit the candidate configuration to the running configuration
(config)#exit
Exit from configuration mode
 
VTEP3(SH)
#configure terminal
Enter Configure mode.
(config)# nvo vxlan access-if port-vlan xe48 1001
Enter into single-homed access-port - xe48 with VLAN 1001
(config-nvo-acc-if)#mac 0000.3333.1001 ip 11.11.10.2
Configure static MAC IP
(config-nvo-acc-if)#exit
Exit from VxLAN access-port config mode
(config)#commit
Commit the candidate configuration to the running configuration
(config)#exit
Exit from configuration mode
 
Validation
Verify MAC-table in MH VTEPs and Single Home VTEP, MAC will be advertised through ESI value which is advertised from VTEP1 and VTEP2 and VTEP IP from SH VTEP VTEP3.
Verify ARP-cache table in all VTEPs, VTEP1 and VTEP2 will learn VTEP3 IP.
Any ARP request comes for 11.11.10.2, VTEP1/VTEP2 will do proxy-ARP.
 
VTEP1
VTEP1#show nvo vxlan mac-table
============================================================================================================================
VXLAN MAC Entries
============================================================================================================================
VNID Interface VlanId Inner-VlanId Mac-Addr VTEP-Ip/ESI Type Status AccessPortDesc
__________________________________________________________________________________________________________________________________________
 
10 po1 1001 ---- 0000.1111.1001 00:00:00:00:00:11:11:00:00:00 Static Local ------- -------
10 ---- ---- ---- 0000.3333.1001 3.3.3.3 Static Remote ------- -------
 
Total number of entries are : 2
 
VTEP1#show nvo vxlan arp-cache
VXLAN ARP-CACHE Information
===========================
VNID Ip-Addr Mac-Addr Type Age-Out Retries-Left
____________________________________________________________________________
10 11.11.10.1 0000.1111.1001 Static Local ----
10 11.11.10.2 0000.3333.1001 Static Remote ----
Total number of entries are 2
 
 
VTEP2
VTEP2#show nvo vxlan mac-table
============================================================================================================================
VXLAN MAC Entries
============================================================================================================================
VNID Interface VlanId Inner-VlanId Mac-Addr VTEP-Ip/ESI Type Status AccessPortDesc
____________________________________________________________________________________________________________________________
 
10 po1 1001 ---- 0000.1111.1001 00:00:00:00:00:11:11:00:00:00 Static Local ------- -------
10 ---- ---- ---- 0000.3333.1001 3.3.3.3 Static Remote ------- -------
 
Total number of entries are : 2
 
VTEP2#show nvo vxlan arp-cache
VXLAN ARP-CACHE Information
===========================
VNID Ip-Addr Mac-Addr Type Age-Out Retries-Left
____________________________________________________________________________
10 11.11.10.1 0000.1111.1001 Static Local ----
10 11.11.10.2 0000.3333.1001 Static Remote ----
Total number of entries are 2
 
VTEP3
VTEP3#show nvo vxlan mac-table
============================================================================================================================
VXLAN MAC Entries
============================================================================================================================
VNID Interface VlanId Inner-VlanId Mac-Addr VTEP-Ip/ESI Type Status AccessPortDesc
____________________________________________________________________________________________________________________________
 
10 ---- 1001 ---- 0000.1111.1001 00:00:00:00:00:11:11:00:00:00 Static Remote ------- -------
10 xe48 1001 ---- 0000.3333.1001 3.3.3.3 Static Local ------- -------
 
Total number of entries are : 2
 
VTEP3#show nvo vxlan arp-cache
VXLAN ARP-CACHE Information
===========================
VNID Ip-Addr Mac-Addr Type Age-Out Retries-Left
____________________________________________________________________________
10 11.11.10.1 0000.1111.1001 Static Remote ----
10 11.11.10.2 0000.3333.1001 Static Local ----
Total number of entries are 2
 
Dynamic MAC advertise through Single Home and Multihomed VTEPs
Advertise 2 MAC's through CE1 connected IXIA, dynamic MAC entries and verify MAC-table in all VTEPs.
One MAC will be dynamic local in VTEP1 and same will be remote in VTEP2 and other be dynamic local in VTEP2 and same will be remote in VTEP1.
Both MAC's will be in remote in VTEP3.
 
VTEP1
VTEP1#show nvo vxlan mac-table
============================================================================================================================
VXLAN MAC Entries
============================================================================================================================
VNID Interface VlanId Inner-VlanId Mac-Addr VTEP-Ip/ESI Type Status AccessPortDesc
____________________________________________________________________________________________________________________________
 
10 po1 1001 ---- 0000.1111.1002 00:00:00:00:00:11:11:00:00:00 Dynamic Local ------- -------
10 ---- 1002 ---- 0000.1111.1003 00:00:00:00:00:11:11:00:00:00 Dynamic Remote ------- -------
 
Total number of entries are : 2
 
VTEP1#show nvo vxlan arp-cache
VXLAN ARP-CACHE Information
===========================
VNID Ip-Addr Mac-Addr Type Age-Out Retries-Left
____________________________________________________________________________
10 21.21.21.1 0000.1111.1002 Dynamic Local ----
10 31.1.31.1 0000.1111.1003 Dynamic Remote ----
Total number of entries are 2
 
 
VTEP2
VTEP2#show nvo vxlan mac-table
============================================================================================================================
VXLAN MAC Entries
============================================================================================================================
VNID Interface VlanId Inner-VlanId Mac-Addr VTEP-Ip/ESI Type Status AccessPortDesc
____________________________________________________________________________________________________________________________
 
10 ---- 1001 ---- 0000.1111.1002 00:00:00:00:00:11:11:00:00:00 Dynamic Remote ------- -------
10 po1 1002 ---- 0000.1111.1003 00:00:00:00:00:11:11:00:00:00 Dynamic Local ------- -------
 
Total number of entries are : 2
 
VTEP2#show nvo vxla arp-cache
VXLAN ARP-CACHE Information
===========================
VNID Ip-Addr Mac-Addr Type Age-Out Retries-Left
____________________________________________________________________________
10 21.21.21.1 0000.1111.1002 Dynamic Remote ----
10 31.1.31.1 0000.1111.1003 Dynamic Local ----
Total number of entries are 2
 
 
VTEP3
VTEP3#show nvo vxlan mac-table
==========================================================================================================================================
VXLAN MAC Entries
==========================================================================================================================================
VNID Interface VlanId Inner-VlanId Mac-Addr VTEP-Ip/ESI Type Status AccessPortDesc
__________________________________________________________________________________________________________________________________________
 
10 ---- 1001 ---- 0000.1111.1002 00:00:00:00:00:11:11:00:00:00 Dynamic Remote ------- -------
10 ---- 1002 ---- 0000.1111.1003 00:00:00:00:00:11:11:00:00:00 Dynamic Remote ------- -------
 
Total number of entries are : 2
 
VTEP3#show nvo vxlan arp-cache
VXLAN ARP-CACHE Information
===========================
VNID Ip-Addr Mac-Addr Type Age-Out Retries-Left
____________________________________________________________________________
10 21.21.21.1 0000.1111.1002 Dynamic Remote ----
10 31.1.31.1 0000.1111.1003 Dynamic Remote ----
Total number of entries are 2
Note: When VTEP1 tunnel goes down, then traffic from VTEP3 will use VTEP2 for forwarding. But Traffic from Switch to VTEP1 will be lost in VTEP1 itself.

When DUT is rebooted, access-if will be in hold down state until ESI hold timer value expiry. After ESI hold timer expiry, access-if port will be up and started learning.

MAC Hold timer will not be applicable on ESI interface, because of mass-withdraw requirement.

A CE can connect to maximum two nodes for multihoming, more than two nodes in a multihoming group is not supported.

All configuration (shutdown, disable learning, disable arp/nd cache, disable arp/nd flood, map vnid, qos profiles, encapsulation) on a multihomed access port should be same on both VTEPs sharing the ESI for multihoming functionalities to work properly.

Multiple ESI values are supported on same VTEP.