OcNOS DC : Virtual Extensible Local Area Network Guide : VxLAN - EVPN with Integrated Routing and Bridging Deployment Mode : Multi Home VxLAN-EVPN IRB with OSPF or ISIS
Multi Home VxLAN-EVPN IRB with OSPF or ISIS
Overview
The support for Open Shortest Path First (OSPF) and Intermediate System to Intermediate System (ISIS) protocols on Virtual Extensible LAN (VxLAN) Integrated Routing (IRB) interface is enhanced with multihoming switches that provides the solution for connecting and managing virtual networks within a data center or network infrastructure.
This feature offers flexibility in configuring network topologies, and ensures compatibility and interoperability within diverse network environments.
Note: Configure mutually exclusive secondary IP subnets between each anycast-IRB and CE within the same L2VNI in multi-homing scenarios or when the same IRB anycast interface is configured on multiple nodes. This ensures unique identification of the routing protocol peer.
Feature Characteristics
The OSPF and ISIS support over the IRB Interface with multihoming feature has the following characteristics:
Connect the host node to two VTEPs with all-active redundancy mode. It helps forward all traffic from VTEP to the host when one VTEP goes down.
Benefits
The OSPF and ISIS support over the IRB Interface has the following benefits:
Uninterrupted service between host and VTEP.
Prerequisites
Router must be up and running.
Maintain synchronization with VRF changes by performing IRB shut/no shut actions when specific events occur within the IPVRF. These events may involve adding or removing Route Targets (RTs), updating Route Distinguishers (RDs), or modifying Layer 3 Virtual Network Identifiers (L3VNIs).
Topology for OSPF
The network topology includes various network elements such as routers, customer edge (CE) devices, Service Aggregator (SA) devices, and Provider Edge (PE) routers. The feature enables OSPF on the IRB interfaces, allowing for efficient routing and communication between network devices within the topology.
Multi Home VxLAN-EVPN IRB with OSPF or ISIS
Configuration
Perform the following configurations to set up different interfaces, routing protocols, and BGP parameters to enable VXLAN, IRB, and EVPN functionality with multihoming in the network.
Configure OSPF Router
Perform the following configurations to create multiple VxLAN interfaces and set up OSPF routing process on PE1 node.
PE1
PE1(config)#vlan database
Enter the VLAN configuration mode.
PE1(config-vlan)# vlan 200-201 bridge 1 state enable
Enable VLAN (200-201) on bridge 1. Specifying the enable state allows forwarding of frames on this VLAN-aware bridge.
PE1(config-vlan)#interface sa1
Enter sa1 interface mode.
PE1(config-if)# switchport
Configure port as L2.
PE1(config-if)# bridge-group 1
Associate the interface with bridge group 1.
PE1(config-if)# switchport mode trunk
Set the switching characteristics of this interface to trunk mode.
PE1(config-if)# switchport trunk allowed vlan add 200-201
Enable VLAN ID 200-201 on this port.
PE1(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the sa1 interface.
PE1(config-if)# exit
Exit from sa1 interface configuration mode.
PE1(config)#interface ce0
Enter ce0 interface mode.
PE1(config-if)# static-channel-group 1
Make it member port of sa1
PE1(config-if)#interface lo
Configures the loopback (lo) interface.
PE1(config-if)# ip address 1.1.1.1/32 secondary
Assigns a secondary the IP address 1.1.1.1/32 to the loopback interface.
PE1(config-if)# ipv6 address ::1/128
Assigns the IPv6 address ::1/128 to the loopback interface.
PE1(config-if)#interface vlan1.200
Enter interface VLAN1.200 configuration mode.
PE1(config-if)# ip address 101.11.11.1/24
Assigns the primary IP address.
PE1(config-if)# ip address 16.16.16.1/24 secondary
Assigns the secondary IP address.
PE1(config-if)# ip address 17.17.17.1/24 secondary
Assigns the secondary IP address.
PE1(config-if)# exit
Exit from VLAN interface configuration mode.
PE1(config)#interface xe2
Enter xe2 interface configuration mode.
PE1(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the xe2 interface.
PE1(config-if)#interface xe2.103
Enter VLAN ID 103 interface config mode.
PE1(config-if)# encapsulation dot1q 103
Setting Encapsulation to dot1q with VLAN ID 103.
PE1(config-if)# ip address 20.1.1.1/24
Assigns the primary IP address.
PE1(config-if)# exit
Exit from xe2 VLAN interface configuration mode.
PE1(config)#interface xe23
Enter xe23 interface configuration mode.
PE1(config-if)# static-channel-group 1
Configure static channel 1 member port
PE1(config)#router ospf 1
Enters the OSPF configuration mode for OSPF process 1.
PE1(config-router)# network 16.16.16.0/24 area 0.0.0.0
Advertises the network 16.16.16.0/24 into OSPF area 0.0.0.0.
PE1(config-router)# network 17.17.17.0/24 area 0.0.0.0
Advertises the network 17.17.17.0/24 into OSPF area 0.0.0.0.
PE1(config-router)# network 20.1.1.0/24 area 0.0.0.0
Advertises the network 20.1.1.0/24 into OSPF area 0.0.0.0.
Configure ISIS Router
Perform the following configurations to create multiple VxLAN interfaces and set up ISIS routing process on PE2 node.
PE2
 
PE2(config)#vlan database
Enter the VLAN configuration mode.
PE2(config-vlan)# vlan 100-101 bridge 1 state enable
Enable VLAN (100-101) on bridge 1. Specifying the enable state allows forwarding of frames on this VLAN-aware bridge
PE2(config-vlan)#interface po1
Enter po1 interface mode.
PE2(config-if)# switchport
Configure port as L2.
PE2(config-if)# bridge-group 1
Associate the interface with bridge group 1.
PE2(config-if)# switchport mode trunk
Set the switching characteristics of this interface to trunk mode.
PE2(config-if)# switchport trunk allowed vlan add 100-101
Enable VLAN ID 100-101 on this port.
PE2(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the po1 interface.
PE2(config-if)#interface lo
Configure loopback interface
PE2(config-if)# ip address 2.2.2.2/32 secondary
Assign the secondary ip address to lo
PE2(config-if)#interface vlan1.100
Enter interface VLAN1.100 configuration mode.
PE2(config-if)# ip address 11.11.11.1/24
Assign primary IP address
PE2(config-if)# ip address 12.1.1.1/24 secondary
Assign secondary IP address towards MH node.
PE2(config-if)# ip address 13.1.1.1/24 secondary
Assign secondary address towards MH node
PE2(config-if)# ip router isis 1
Configure the isis
PE2(config-if)# exit
Exit from VLAN interface configuration mode.
PE2(config)#interface xe11
Enter xe11 interface configuration mode.
PE2(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the xe11 interface.
PE2(config-if)#interface xe11.105
Configure subinterface xe11.105.
PE2(config-if)# encapsulation dot1q 105
Setting Encapsulation to dot1q with VLAN ID 105.
PE2(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the xe11 interface.
PE2(config-if)# ip address 10.1.1.1/24
Assign an IP address
PE2(config-if)# ip router isis 1
Configure interface as ISIS router
PE2(config-if)# exit
Exit from xe11 interface configuration mode.
PE2(config)#interface xe24
Enter xe24 interface configuration mode.
PE2(config-if)# channel-group 1 mode active
Configure the member port for po1 interface
PE2(config-if)# exit
Exit from xe24 interface configuration mode.
PE2(config-if)#interface xe26
Enter xe26 interface configuration mode.
PE2(config-if)# channel-group 1 mode active
Configure the member port for po1 interface
PE2(config)#router isis 1
Configure the ISIS router.
PE2(config-router)# is-type level-1-2
Configure level1-2 ISIS mode.
PE2(config-router)# metric-style wide
Configure metric style as wide.
PE2(config-router)# dynamic-hostname
Configure the hostname to be advertised for an ISIS 1 instance.
PE2(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE2(config-router)# net 49.0000.0000.0001.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE2(config-router)# redistribute connected
Redistribute the connected routes.
Configure VxLAN IRB with Multihoming for OSPF and ISIS Router
Perform the following configurations to create VxLAN IRB interfaces with multihoming for OSPF and ISIS routing process on PE7 and PE8 node.
PE7
 
PE7(config)#nvo vxlan enable
Enable VxLAN.
PE7(config)#nvo vxlan irb
Enable VxLAN IRB
PE7(config)#evpn esi hold-time 60
Configure hold time for the tunnels to come up during VxLAN initialization before making the esi up.
PE7(config)#evpn vxlan multihoming enable
Enable VxLAN multihome
PE7(config)#ip vrf management
Enter into VRF configuration mode.
PE7(config-vrf)#ip vrf L3VRF3
Create a VRF routing information base called L3VRF3 for OSPF router.
PE7(config-vrf)# rd 7100:11
Specify a route distinguisher for the VRF.
PE7(config-vrf)# route-target both 100:100
Add import and export route-target extended communities to the VRF.
PE7(config-vrf)# l3vni 1000
Configure the L3 Virtual Network Identifier for an IP VRF.
PE7(config-vrf)#ip vrf L3VRF4
Create a VRF routing information base called L3VRF4 for ISIS router.
PE7(config-vrf)# rd 7400:11
Specify a route distinguisher for the VRF.
PE7(config-vrf)# route-target both 101:101
Add import and export route-target extended communities to the VRF.
PE7(config-vrf)# l3vni 2000
Configure the L3 Virtual Network Identifier for an IP VRF.
PE7(config-vrf)#mac vrf L2VRF1
Create a L2 MAC VRF to use in EVPN routes.
PE7(config-vrf)# rd 7.7.7.7:11
Specify a route distinguisher for the MAC VRF.
PE7(config-vrf)# route-target both 7.7.7.7:100
Add import and export route-target extended communities to the VRF.
PE7(config-vrf)#mac vrf L2VRF2
Create a L2 MAC VRF to use in EVPN routes.
PE7(config-vrf)# rd 7.7.7.7:12
Specify a route distinguisher for the VRF.
PE7(config-vrf)# route-target both 7.7.7.7:101
Add import and export route-target extended communities to the VRF
PE7(config-vrf)#exit
Exit the VRF configuration mode.
PE7(config)#evpn irb-forwarding anycast-gateway-mac 0000.0000.1111
Configure common Anycast MAC address for all the IRB interfaces.
PE7(config)#interface irb701
Enter into IRB interface configuration mode to configure IRB interfaces for OSPF router.
PE7(config-irb-if)# ip vrf forwarding L3VRF3
Associate IRB interface with L3VRF3.
PE7(config-irb-if)# evpn irb-if-forwarding anycast-gateway-mac
Map the global anycast IRB MAC address with L3VRF3.
PE7(config-irb-if)# ip address 17.12.13.1/24 anycast
Configure an Anycast IP address.
PE7(config-irb-if)# ip address 16.16.16.2/24 secondary
Configure a secondary IP address.
PE7(config-irb-if)#exit
Exit from the IRB interface.
PE7(config-irb-if)#interface irb801
Enter into IRB interface configuration mode to configure IRB interfaces for ISIS router.
PE7(config-irb-if)# ip vrf forwarding L3VRF4
Associate IRB interface with L3VRF4.
PE7(config-irb-if)# evpn irb-if-forwarding anycast-gateway-mac
Map the global anycast IRB MAC address with L3VRF4.
PE7(config-irb-if)# ip address 12.13.14.2/24 anycast
Configure an Anycast IP address.
PE7(config-irb-if)# ip address 13.1.1.2/24 secondary
Configure a secondary IP address.
PE7(config-irb-if)# ip router isis 2
Configure ISIS router on IRB interface.
PE7(config-irb-if)#exit
Exit from the IRB interface.
PE7(config)#nvo vxlan vtep-ip-global 7.7.7.7
Configure the source VTEP IP address of the VxLAN tunnel.
PE7(config)#nvo vxlan id 701 ingress-replication inner-vid-disabled
Add a tenant L2 VNID to the VxLAN. Specify
ingress-replication to use head end replication for forwarding BUM traffic
inner-vid-disabled to not carry VID out of network port.
PE7(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF1
Associate the L2VRF1reachable protocol to Ethernet-VPN over BGP
PE7(config-nvo)# evpn irb701
Configure default gateway behavior for IRB interface irb701.
PE7(config-nvo)# vni-name VNI-701
Configure VNI name.
PE7(config-nvo)#exit
Exit from NVO mode.
PE7(config-nvo)#nvo vxlan id 801 ingress-replication inner-vid-disabled
Add a tenant L2 VNID to the VxLAN. Specify
ingress-replication to use head end replication for forwarding BUM traffic
inner-vid-disabled to not carry VID out of network port
PE7(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF2
Associate the L2VRF2reachable protocol to Ethernet-VPN over BGP
PE7(config-nvo)# evpn irb801
Configure default gateway behavior for IRB interface irb801.
PE7(config-nvo)# vni-name VNI-101
Configure VNI name.
PE7(config-nvo)#qos enable
Enable QoS.
PE7(config-nvo)#exit
Exit from NVO mode.
PE7(config)#interface po1
Configure po1 interface.
PE7(config-if)# switchport
Configure port as L2.
PE7(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the po1 interface.
PE7(config-if)# evpn multi-homed system-mac 0000.0000.7782
Configure system MAC as ESI value for po1 interface. VTEP1 and VTEP2 should have same ESI value.
PE7(config-if)#interface sa1
Configure sa1 interface.
PE7(config-if)# switchport
Configure port as L2.
PE7(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the po1 interface.
PE7(config-if)# evpn multi-homed esi 00:01:02:03:04:05:06:07:08
Configure 9-octet ESI value for sa1 interface.
PE7(config-if-es)#interface sa2
Configure sa2 interface.
PE7(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the sa2 interface.
PE7(config-if)# ip address 80.1.1.1/24
Configure IP address.
PE7(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE7(config-if)# ip router isis 1
Configure ISIS router on sa2 interface.
PE7(config-if)#exit
Exit from the sa2 interface.
PE7(config)#interface sa3
Configure sa3 interface.
PE7(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the sa3 interface.
PE7(config-if)# ip address 22.1.1.1/24
Configure IP address.
PE7(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE7(config-if)#interface ce50
Configure ce50 interface.
PE7(config-if)# static-channel-group 1
Configure member port for sa3
PE7(config-if)#exit
Exit from ce50 interface configuration mode.
PE7(config)#interface lo
Configure loopback interface.
PE7(config-if)# ip address 7.7.7.7/32 secondary
Configure secondary IP address
PE7(config-if)#exit
Exit from the lo interface.
PE7(config)#interface xe1
Configure xe1 interface.
PE7(config-if)# channel-group 1 mode active
Configure member port of po1 interface.
PE7(config-if)#interface xe39
Configure xe39 interface.
PE7(config-if)# static-channel-group 3
Configure member port of sa3 interface.
PE7(config-if)#interface xe40
Configure xe40 interface.
PE7(config-if)# static-channel-group 2
Configure member port of sa2 interface.
PE7(config-if)#exit
Exit from the xe40 interface.
PE7(config)#router ospf 1
Configure OSPF router.
PE7(config-router)# ospf router-id 7.7.7.7
Configure router id for OSPF.
PE7(config-router)# network 7.7.7.7/32 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 7.7.7.7/32
PE7(config-router)# network 22.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on interface with IP address that match the network address 22.1.1.0/24 .
PE7(config-router)#router ospf 2 L3VRF3
Configure OSPF on IRB L3VRF3.
PE7(config-router)# redistribute bgp
Redistribute BGP routes.
PE7(config-router)# network 16.16.16.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 16.16.16.0/24.
PE7(config-router)#router isis 1
Configure ISIS router.
PE7(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE7(config-router)# metric-style wide
Configure metric-style as wide.
PE7(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE7(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE7(config-router)# net 49.0000.0007.0001.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE7(config-router)# redistribute connected
Redistribute connected routes.
PE7(config-router)#router isis 2 L3VRF4
Configure ISIS on IRB L3VRF4.
PE7(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE7(config-router)# metric-style wide
Configure metric-style as wide.
PE7(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE7(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE7(config-router)# net 49.0000.0000.0475.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE7(config-router)# redistribute bgp
Redistribute connected routes.
PE7(config-router)#router bgp 700
Start the eBGP router.
PE7(config-router)# bgp router-id 7.7.7.7
Configure BGP router id.
PE7(config-router)# no bgp inbound-route-filter
Disable the VPN/BGP inbound route-target filter.
PE7(config-router)# neighbor 5.5.5.5 remote-as 500
Configure BGP peering relationship with a customer edge router.
PE7(config-router)# neighbor 6.6.6.6 remote-as 600
Configure BGP peering relationship with a customer edge router.
PE7(config-router)# neighbor 6.6.6.6 advertisement-interval 0
Configure a minimum advertisement interval between the sending of BGP routing updates.
PE7(config-router)# address-family l2vpn evpn
Enter to the L2 VPN address family mode to configure the address-family specific parameters.
PE7(config-router-af)# neighbor 5.5.5.5 activate
Enable the exchange of specific address family routes with a neighboring router 5.5.5.5.
PE7(config-router-af)# neighbor 6.6.6.6 activate
Enable the exchange of specific address family routes with a neighboring router 6.6.6.6.
PE7(config-router-af)# exit-address-family
Exit from address family mode.
PE7(config-router)# address-family ipv4 vrf L3VRF3
Enter to the IRB IPv4 VRF address family mode to configure the address-family specific parameters.
PE7(config-router-af)# network 16.16.16.0/24
Enable OSPF routing on IRB interface with IP address that match the network address 16.16.16.0/24.
PE7(config-router-af)# redistribute ospf
Redistribute OSPF routes.
PE7(config-router-af)# exit-address-family
Exit from address family mode.
PE7(config-router)# address-family ipv4 vrf L3VRF4
Enter to the IRB IPv4 VRF address family mode to configure the address-family specific parameters.
PE7(config-router-af)# network 12.1.1.0/24
Enable OSPF routing on IRB interface with IP address that match the network address 12.1.1.0/24.
PE7(config-router-af)# redistribute isis
Redistribute ISIS routes.
PE7(config-router-af)# exit-address-family
Exit address family mode.
PE7(config)#nvo vxlan access-if port-vlan po1 100
Map the VLAN port for ISIS switch on po1 interface to identify the VxLAN traffic and to enter NVO access interface mode.
PE7(config-nvo-acc-if)# map vnid 801
Map the l2vnid to an access-port.
PE7(config-nvo-acc-if)#nvo vxlan access-if port-vlan sa1 200
Configure access-if port for OSPF switch.
PE7(config-nvo-acc-if)# map vnid 701
Map the l2vnid to an access-port.
PE8
 
PE8(config)#nvo vxlan enable
Enable VxLAN
PE8(config)#nvo vxlan irb
Enable VxLAN IRB
PE8(config)#evpn esi hold-time 60
Configure hold time for the tunnels to come up during VxLAN initialization before making the esi up.
PE8(config)#evpn vxlan multihoming enable
Enable VxLAN multihome
PE8(config)#ip vrf managemen
Enter into VRF configuration mode.
PE8(config-vrf)#ip vrf L3VRF3
Create a VRF routing information base called L3VRF3 for OSPF router.
PE8(config-vrf)# rd 8100:11
Specify a route distinguisher for the VRF.
PE8(config-vrf)# route-target both 100:100
Add import and export route-target extended communities to the VRF.
PE8(config-vrf)# l3vni 1000
Configure the L3 Virtual Network Identifier for an IP VRF.
PE8(config-vrf)#ip vrf L3VRF4
Create a VRF routing information base called L3VRF4 for ISIS router.
PE8(config-vrf)# rd 8400:11
Specify a route distinguisher for the VRF.
PE8(config-vrf)# route-target both 101:101
Add import and export route-target extended communities to the VRF.
PE8(config-vrf)# l3vni 2000
Configure the L3 Virtual Network Identifier for an IP VRF.
PE8(config-vrf)#mac vrf L2VRF1
Create a L2 MAC VRF to use in EVPN routes.
PE8(config-vrf)# rd 8.8.8.8:11
Specify a route distinguisher for the MAC VRF.
PE8(config-vrf)# route-target both 7.7.7.7:100
Add import and export route-target extended communities to the VRF.
PE8(config-vrf)#mac vrf L2VRF2
Create a L2 MAC VRF to use in EVPN routes.
PE8(config-vrf)# rd 8.8.8.8:12
Specify a route distinguisher for the VRF.
PE8(config-vrf)# route-target both 7.7.7.7:101
Add import and export route-target extended communities to the VRF.
PE7(config-vrf)#exit
Exit the VRF configuration mode.
PE8(config)#evpn irb-forwarding anycast-gateway-mac 0000.0000.1111
Configure common Anycast MAC address for all the IRB interfaces.
PE8(config-if)#interface irb701
Enter into IRB interface configuration mode to configure IRB interfaces for OSPF router.
PE8(config-irb-if)# ip vrf forwarding L3VRF3
Associate IRB interface with L3VRF3.
PE8(config-irb-if)# evpn irb-if-forwarding anycast-gateway-mac
Map the global anycast IRB MAC address with L3VRF3.
PE8(config-irb-if)# ip address 17.12.13.1/24 anycast
Configure an Anycast IP address.
PE8(config-irb-if)# ip address 17.17.17.2/24 secondary
Configure a secondary IP address.
PE7(config-irb-if)#exit Exit from the IRB interface.
PE8(config-irb-if)#interface irb801
Enter into IRB interface configuration mode to configure IRB interfaces for ISIS router.
PE8(config-irb-if)# ip vrf forwarding L3VRF4
Associate IRB interface with L3VRF4.
PE8(config-irb-if)# evpn irb-if-forwarding anycast-gateway-mac
Map the global anycast IRB MAC address with L3VRF4.
PE8(config-irb-if)# ip address 12.13.14.2/24 anycast
Configure an Anycast IP address.
PE8(config-irb-if)# ip address 12.1.1.2/24 secondary
Configure an Anycast IP address.
PE8(config-irb-if)# ip router isis 2
Configure ISIS router on IRB interface.
PE7(config-irb-if)#exit
Exit from the IRB interface.
PE8(config)#nvo vxlan vtep-ip-global 8.8.8.8
Configure the source VTEP IP address of the VxLAN tunnel.
PE8(config)#nvo vxlan id 701 ingress-replication inner-vid-disabled
Add a tenant L2 VNID to the VxLAN. Specify
ingress-replication to use head end replication for forwarding BUM traffic
inner-vid-disabled to not carry VID out of network port
PE8(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF1
Associate the L2VRF1reachable protocol to Ethernet-VPN over BGP
PE8(config-nvo)# evpn irb701
Configure default gateway behavior for IRB interface irb701.
PE8(config-nvo)# vni-name VNI-701
Configure VNI name.
PE7(config-nvo)#exit
Exit from NVO mode.
PE8(config-nvo)#nvo vxlan id 801 ingress-replication inner-vid-disabled
Add a tenant L2 VNID to the VxLAN. Specify
ingress-replication to use head end replication for forwarding BUM traffic
inner-vid-disabled to not carry VID out of network port
PE8(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF2
Associate the L2VRF2reachable protocol to Ethernet-VPN over BGP
PE8(config-nvo)# evpn irb801
Configure default gateway behavior for IRB interface irb801.
PE8(config-nvo)# vni-name VNI-101
Configure VNI name.
PE8(config-nvo)#qos enable
Enable QoS.
PE8(config-nvo)#exit
Exit from NVO mode.
PE8(config-vlan)#interface po1
Configure po1 interface.
PE8(config-if)# switchport
Configure port as L2.
PE8(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the po1 interface.
PE8(config-if)# evpn multi-homed system-mac 0000.0000.7782
Configure system MAC as ESI value for po1 interface. VTEP1 and VTEP2 should have same ESI value.
PE8(config-if-es)#interface sa1
Configure sa1 interface.
PE8(config-if)# switchport
Configure port as L2.
PE8(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the po1 interface.
PE8(config-if)# evpn multi-homed esi 00:01:02:03:04:05:06:07:08
Configure 9-octet ESI value for sa1 interface.
PE8(config-irb-if)#interface lo
Configure loopback interface
PE8(config-if)# ip address 8.8.8.8/32 secondary
Configure secondary IP address
 
PE8(config-if)#exit
Exit from the lo interface.
PE8(config)#interface xe1
Configure xe1 interface.
PE8(config-if)# static-channel-group 1
Configure member port of sa3 interface.
PE8(config-if)#interface xe2
Configure xe2 interface.
PE8(config-if)# ip address 90.1.1.1/24
Configure IP address
PE8(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE8(config-if)# ip router isis 1
Configure ISIS router on IRB interface.
PE8(config-if)#exit
Exit from the lo interface.
PE8(config)#interface xe12
Configure xe1 interface.
PE8(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the po1 interface.
PE8(config-if)# ip address 21.1.1.1/24
Configure IP address
PE8(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE8(config-if)#exit
Exit from the lo interface.
PE8(config-if)#interface xe26
Configure xe26 interface.
PE8(config-if)# channel-group 1 mode active
Configure member port of xe26 interface.
PE8(config)#router ospf 1
Configure OSPF router.
PE8(config-router)# ospf router-id 8.8.8.8
Configure router id for OSPF.
PE8(config-router)# network 8.8.8.8/32 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 8.8.8.8/32.
PE8(config-router)# network 21.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 21.1.1.0/24.
PE8(config-router)#router ospf 2 L3VRF3
Configure OSPF on IRB L3VRF3.
PE8(config-router)# redistribute bgp
Redistribute BGP routes.
PE8(config-router)# network 17.17.17.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 17.17.17.0/24
PE8(config-router)#router isis 1
Configure ISIS router.
PE8(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE8(config-router)# metric-style wide
Configure metric-style as wide.
PE8(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE8(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE8(config-router)# net 49.0000.0008.0001.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE8(config-router)# redistribute connected
Redistribute connected routes.
PE8(config-router)#router isis 2 L3VRF4
Configure ISIS on IRB L3VRF4.
PE8(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE8(config-router)# metric-style wide
Configure metric-style as wide.
PE8(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE8(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE8(config-router)# net 49.0000.0000.0485.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE8(config-router)# redistribute bgp
Redistribute connected routes.
PE8(config-router)#router bgp 800
Start the eBGP router.
PE8(config-router)# bgp router-id 8.8.8.8
Configure BGP router id.
PE8(config-router)# no bgp inbound-route-filter
Disable the VPN/BGP inbound route-target filter.
PE8(config-router)# neighbor 5.5.5.5 remote-as 500
Configure BGP peering relationship with a customer edge router.
PE8(config-router)# neighbor 6.6.6.6 remote-as 600
Configure BGP peering relationship with a customer edge router.
PE8(config-router)# neighbor 6.6.6.6 update-source lo
Configure a minimum advertisement interval between the sending of BGP routing updates.
PE8(config-router)# address-family l2vpn evpn
Enter to the L2 VPN address family mode to configure the address-family specific parameters.
PE8(config-router-af)# neighbor 5.5.5.5 activate
Enable the exchange of specific address family routes with a neighboring router 5.5.5.5.
PE8(config-router-af)# neighbor 6.6.6.6 activate
Enable the exchange of specific address family routes with a neighboring router 6.6.6.6.
PE8(config-router-af)# exit-address-family
Exit from address family mode.
PE8(config-router)# address-family ipv4 vrf L3VRF3
Enter to the IRB IPv4 VRF address family mode to configure the address-family specific parameters.
PE8(config-router-af)# network 16.16.16.0/24
Enable OSPF routing on IRB interface with IP address that match the network address 16.16.16.0/24.
PE8(config-router-af)# redistribute ospf
Redistribute OSPF routes.
PE8(config-router-af)# exit-address-family
Exit from address family mode.
PE8(config-router)# address-family ipv4 vrf L3VRF4
Enter to the IRB IPv4 VRF address family mode to configure the address-family specific parameters.
PE8(config-router-af)# network 12.1.1.0/24
Enable OSPF routing on IRB interface with IP address that match the network address 12.1.1.0/24.
PE8(config-router-af)# redistribute isis
Redistribute ISIS routes.
PE8(config-router-af)# exit-address-family
Exit address family mode.
PE8(config-router)# exit
Exit from router mode configuration.
PE8(config)#nvo vxlan access-if port-vlan po1 100
Map the VLAN port for ISIS switch on po1 interface to identify the VxLAN traffic and to enter NVO access interface mode.
PE8(config-nvo-acc-if)# map vnid 801
Map the l2vnid to an access-port.
PE8(config-nvo-acc-if)#nvo vxlan access-if port-vlan sa1 200
Configure access-if port for OSPF switch.
PE8(config-nvo-acc-if)# map vnid 701
Map the l2vnid to an access-port.
PE8(config-nvo-acc-if)#end
End global configuration.
 
Configure Spine Node with OSPF Router
Perform the following configurations to make the node as spine with routing protocol as OSPF.
PE5
 
PE5(config-if)#interface sa3
Configure sa3 interface.
PE5(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the sa3 interface.
PE5(config-if)# ip address 22.1.1.2/24
Configure IP address
PE5(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE5(config-if)#interface lo
Configure loopback interface
PE5(config-if)# ip address 5.5.5.5/32 secondary
Configure secondary IP address.
PE7(config-if)#exit
Exit from the lo interface.
PE5(config-if)#interface xe8
Configure xe8 interface.
PE5(config-if)# static-channel-group 3
Configure member port of sa3 interface.
PE5(config-if)#interface xe12
Configure xe12 interface.
PE5(config-if)# ip address 21.1.1.2/24
Configure IP address
PE5(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE5(config-if)#interface xe14
Configure xe14 interface.
PE5(config-if)# ip address 23.1.1.2/24
Configure IP address
PE5(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE5(config-if)#interface xe25
Configure xe25 interface.
PE5(config-if)# ip address 24.1.1.2/24
Configure IP address
PE5(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE5(config)#router ospf 1
Configure OSPF router.
PE5(config-router)# network 5.5.5.5/32 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 5.5.5.5/32.
PE5(config-router)# network 21.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 21.1.1.0/24.
PE5(config-router)# network 22.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 22.1.1.0/24.
PE5(config-router)# network 23.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 23.1.1.0/24.
PE5(config-router)# network 24.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 24.1.1.0/24.
PE5(config-router)#router bgp 500
Start the eBGP router 500.
PE5(config-router)# bgp router-id 5.5.5.5
Configure BGP router id 5.5.5.5.
PE5(config-router)# no bgp inbound-route-filter
Disable the VPN/BGP inbound route-target filter.
PE5(config-router)# neighbor 3.3.3.3 remote-as 300
Configure BGP 3.3.3.3 peering relationship with a customer edge router.
PE5(config-router)# neighbor 4.4.4.4 remote-as 400
Configure BGP 4.4.4.4 peering relationship with a customer edge router.
PE5(config-router)# neighbor 7.7.7.7 remote-as 700
Configure BGP 7.7.7.7 peering relationship with a customer edge router.
PE5(config-router)# neighbor 8.8.8.8 remote-as 800
Configure BGP 8.8.8.8 peering relationship with a customer edge router.
PE5(config-router)# neighbor 3.3.3.3 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 3.3.3.3 to establish the TCP connections.
PE5(config-router)# neighbor 4.4.4.4 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 4.4.4.4 to establish the TCP connections.
PE5(config-router)# neighbor 7.7.7.7 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 7.7.7.7 to establish the TCP connections.
PE5(config-router)# neighbor 8.8.8.8 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 8.8.8.8 to establish the TCP connections.
PE5(config-router)# address-family l2vpn evpn
Enter to the L2 VPN address family mode to configure the address-family specific parameters.
PE5(config-router-af)# neighbor 3.3.3.3 activate
Enable the exchange of specific address family routes with a neighboring router 3.3.3.3.
PE5(config-router-af)# neighbor 4.4.4.4 activate
Enable the exchange of specific address family routes with a neighboring router 4.4.4.4.
PE5(config-router-af)# neighbor 7.7.7.7 activate
Enable the exchange of specific address family routes with a neighboring router 7.7.7.7.
PE5(config-router-af)# neighbor 8.8.8.8 activate
Enable the exchange of specific address family routes with a neighboring router 8.8.8.8.
PE5(config-router-af)# exit-address-family
Exit address family configuration mode.
PE5(config-router)# exit
Exit router configuration mode.
PE5(config)#end
Exit global configuration mode.
Configure Spine Node with ISIS Router
Perform the following configurations to make the node as spine with routing protocol as ISIS.
PE6
 
PE6(config-if)#interface sa2
Configure sa2 interface.
PE6(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the sa2 interface.
PE6(config-if)# ip address 80.1.1.2/24
Configure IP address.
PE6(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE6(config-if)# ip router isis 1
Configure ISIS router on sa2 interface.
PE6(config-if)#interface ce2
Configure ce2 interface.
PE6(config-if)# ip address 101.1.1.1/24
Configure IP address
PE6(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE6(config-if)# ip router isis 1
Configure ISIS router on sa2 interface.
PE6(config-if)#interface lo
Configure loopback interface
PE6(config-if)# ip address 6.6.6.6/32 secondary
Configure secondary IP address.
PE6(config-if)# ip router isis 1
Configure ISIS router on sa2 interface.
PE6(config-if)#interface xe5
Configure xe5 interface.
PE6(config-if)# ip address 102.1.1.1/24
Configure IP address
PE6(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE6(config-if)# ip router isis 1
Configure ISIS router on xe5 interface.
PE6(config-if)#interface xe9
Configure xe9 interface.
PE6(config-if)# static-channel-group 2
Configure member port of sa2 interface.
PE6(config-if)#interface xe24
Configure xe24 interface.
PE6(config-if)# ip address 90.1.1.2/24
Configure IP address
PE6(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE6(config-if)# ip router isis 1
Configure ISIS router on xe24 interface.
PE6(config)#router isis 1
Configure ISIS router on xe24 interface.
PE6(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE6(config-router)# metric-style wide
Configure metric-style as wide.
PE6(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE6(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE6(config-router)# net 49.0000.0006.0001.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE6(config-router)#router bgp 600
Start the eBGP router.
PE6(config-router)# bgp router-id 6.6.6.6
Configure BGP router id.
PE6(config-router)# no bgp inbound-route-filter
Disable the VPN/BGP inbound route-target filter.
PE6(config-router)# neighbor 3.3.3.3 remote-as 300
Configure BGP peering relationship with a customer edge router.
PE6(config-router)# neighbor 4.4.4.4 remote-as 400
Configure BGP peering relationship with a customer edge router.
PE6(config-router)# neighbor 7.7.7.7 remote-as 700
Configure BGP peering relationship with a customer edge router.
PE6(config-router)# neighbor 8.8.8.8 remote-as 800
Configure BGP peering relationship with a customer edge router.
PE6(config-router)# neighbor 3.3.3.3 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 3.3.3.3 to establish the TCP connections
PE6(config-router)# neighbor 4.4.4.4 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 4.4.4.4 to establish the TCP connections
PE6(config-router)# neighbor 7.7.7.7 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 7.7.7.7 to establish the TCP connections
PE6(config-router)# neighbor 8.8.8.8 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 8.8.8.8 to establish the TCP connections
PE6(config-router)# address-family l2vpn evpn
Enter to the L2 VPN address family mode to configure the address-family specific parameters.
PE6(config-router-af)# neighbor 3.3.3.3 activate
Enable the exchange of specific address family routes with a neighboring router 3.3.3.3.
PE6(config-router-af)# neighbor 4.4.4.4 activate
Enable the exchange of specific address family routes with a neighboring router 4.4.4.4.
PE6(config-router-af)# neighbor 7.7.7.7 activate
Enable the exchange of specific address family routes with a neighboring router 7.7.7.7.
PE6(config-router-af)# neighbor 8.8.8.8 activate
Enable the exchange of specific address family routes with a neighboring router 8.8.8.8.
PE6(config-router-af)# exit-address-family
Exit address family configuration mode.
PE6(config-router)# exit
Exit router configuration mode.
PE6(config)#end
Exit global configuration mode.
 
Configure VxLAN IRB with Single Homing OSPF and ISIS Router
Perform the following configurations to create VxLAN IRB interfaces with singlehoming for OSPF and ISIS routing process on PE3 and PE4 nodes.
PE3
 
PE3(config)#nvo vxlan enable
Enable VxLAN.
PE3(config)#nvo vxlan irb
Enable VxLAN IRB
PE3(config)#ip vrf management
Enter into VRF configuration mode.
PE3(config-vrf)#ip vrf L3VRF1
Create a VRF routing information base called L3VRF3 for OSPF router.
PE3(config-vrf)# rd 56000:11
Specify a route distinguisher for the VRF.
PE3(config-vrf)# route-target both 100:100
Add import and export route-target extended communities to the VRF.
PE3(config-vrf)# l3vni 1000
Configure the L3 Virtual Network Identifier for an IP VRF.
PE3(config-vrf)#mac vrf L2VRF1
Create a L2 MAC VRF to use in EVPN routes.
PE3(config-vrf)# rd 4.4.4.4:11
Specify a route distinguisher for the MAC VRF.
PE3(config-vrf)# route-target both 9.9.9.9:100
Add import and export route-target extended communities to the VRF.
PE3(config-if)#interface irb1001
Enter into IRB interface configuration mode to configure IRB interfaces for OSPF router.
PE3(config-irb-if)# ip vrf forwarding L3VRF1
Associate IRB interface with L3VRF3.
PE3(config-irb-if)# ip address 40.1.1.1/24
Configure an Anycast IP address.
PE3(config-irb-if)# ip ospf cost 1
Specify the cost of the link-state metric in a router-LSA.
PE3(config-vrf)#nvo vxlan vtep-ip-global 3.3.3.3
Configure the source VTEP IP address of the VxLAN tunnel.
PE3(config)#nvo vxlan id 102 ingress-replication
Add a tenant L2 VNID to the VxLAN. Specify
ingress-replication to use head end replication for forwarding BUM traffic
inner-vid-disabled to not carry VID out of network port
PE3(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF1
Associate the L2VRF1 reachable protocol to Ethernet-VPN over BGP
PE3(config-nvo)# evpn irb1001
Configure default gateway behavior for IRB interface irb1001.
PE3(config-nvo)# vni-name VNI-102
Configure VNI name.
PE3(config-nvo)#nvo vxlan id 2002 ingress-replication
Add a tenant L2 VNID to the VxLAN. Specify
ingress-replication to use head end replication for forwarding BUM traffic
inner-vid-disabled to not carry VID out of network port
PE3(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF1
Associate the L2VRF1 reachable protocol to Ethernet-VPN over BGP
PE3(config-nvo)# evpn irb2002
Configure default gateway behavior for IRB interface irb72002.
PE3(config-nvo)#qos enable
Enable QoS.
PE3(config)#interface sa4
Configure sa4 interface.
PE3(config-if)# switchport
Configure port as L2.
PE3(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the po1 interface.
PE3(config)#nvo vxlan access-if port-vlan sa4 100
Map the VLAN port for ISIS switch on sa4 interface to identify the VxLAN traffic and to enter NVO access interface mode.
PE3(config-acc-if-evpn)#map vpn-id 102
Map the l2vnid to an access-port.
PE3(config-if)#interface ce3
Configure ce3 interface.
PE3(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the ce3 interface.
PE3(config-if)# ip address 101.1.1.2/24
Configure IP address.
PE3(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE3(config-if)# ip router isis 1
Configure ISIS router on ce3 interface.
PE3(config-irb-if)#interface lo
Configure loopback interface
PE3(config-if)# ip address 3.3.3.3/32 secondary
Configure secondary IP address
PE3(config-if)# ip router isis 1
Configure ISIS router on ce3 interface.
PE3(config-if)#interface xe10
Configure xe10 interface.
PE3(config-if)# static-channel-group 4
Configure member port of ce3 interface.
PE3(config-if)#interface xe14
Configure xe14 interface.
PE3(config-if)# speed 10g
Set the link speed of the xe14 interface.
PE3(config-if)# ip address 23.1.1.1/24
Configure IP address.
PE3(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE3(config)#router ospf 1
Configure OSPF router.
PE3(config-router)# ospf router-id 3.3.3.3
Configure router id for OSPF.
PE3(config-router)# network 3.3.3.3/32 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 3.3.3.3/32.
PE3(config-router)# network 23.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 23.1.1.0/24.
PE3(config-router)# network 101.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 101.1.1.0/24.
PE3(config-router)#router ospf 2 L3VRF1
Configure OSPF on IRB L3VRF1.
PE3(config-router)# redistribute bgp
Redistribute BGP into OSPF.
PE3(config-router)# network 40.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 40.1.1.0/24.
PE3(config-router)#router isis 1
Configure ISIS router on xe24 interface.
PE3(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE3(config-router)# metric-style wide
Configure metric-style as wide.
PE3(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE3(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE3(config-router)# net 49.0000.0003.0001.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE3(config-router)# redistribute connected
Redistribute connected routes.
PE3(config-router)#router bgp 300
Start the eBGP router.
PE3(config-router)# bgp router-id 3.3.3.3
Configure BGP router id.
PE3(config-router)# no bgp inbound-route-filter
Disable the VPN/BGP inbound route-target filter.
PE3(config-router)# neighbor 5.5.5.5 remote-as 500
Configure BGP peering relationship with a customer edge router.
PE3(config-router)# neighbor 6.6.6.6 remote-as 600
Configure BGP peering relationship with a customer edge router.
PE3(config-router)# neighbor 5.5.5.5 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 5.5.5.5 to establish the TCP connections
PE3(config-router)# neighbor 6.6.6.6 advertisement-interval 0
Configure a minimum advertisement interval between the sending of BGP routing updates.
PE3(config-router)# address-family l2vpn evpn
Enter to the L2 VPN address family mode to configure the address-family specific parameters.
PE3(config-router-af)# neighbor 5.5.5.5 activate
Enable the exchange of specific address family routes with a neighboring router 5.5.5.5.
PE3(config-router-af)# neighbor 6.6.6.6 activate
Enable the exchange of specific address family routes with a neighboring router 6.6.6.6.
PE3(config-router-af)# exit-address-family
Exit address family configuration mode.
PE3(config-router)# address-family ipv4 vrf L3VRF1
Enter to the IRB IPv4 VRF address family mode to configure the address-family specific parameters.
PE3(config-router-af)# redistribute connected
Redistribute connected routes.
PE3(config-router-af)# redistribute ospf
Redistribute OSPF routes.
PE3(config-router-af)# exit-address-family
Exit address family configuration mode.
PE3(config-router)# exit
Exit router configuration mode.
PE3(config)#end
Exit global configuration mode.
 
PE4
 
PE4(config)#nvo vxlan enable
Enable VxLAN.
PE4(config)#nvo vxlan irb
Enable VxLAN IRB
PE4(config)#ip vrf management
Enter into VRF configuration mode.
PE4(config-vrf)#ip vrf L3VRF2
reate a VRF routing information base called L3VRF2 for OSPF router.
PE4(config-vrf)# rd 63000:11
Specify a route distinguisher for the VRF.
PE4(config-vrf)# route-target both 101:101
dd import and export route-target extended communities to the VRF.
PE4(config-vrf)# l3vni 2000
Configure the L3 Virtual Network Identifier for an IP VRF.
PE4(config-vrf)#mac vrf L2VRF2
Create a L2 MAC VRF to use in EVPN routes.
PE4(config-vrf)# rd 3.3.3.3:11
Specify a route distinguisher for the MAC VRF.
PE4(config-vrf)# route-target both 10.10.10.10:100
Add import and export route-target extended communities to the VRF.
PE4(config-if)#interface irb2001
Enter into IRB interface configuration mode to configure IRB interfaces for OSPF router.
PE4(config-irb-if)# ip vrf forwarding L3VRF2
Associate IRB interface with L3VRF3.
PE4(config-irb-if)# ip address 50.50.50.1/24
Configure an Anycast IP address.
PE4(config-irb-if)# ip router isis 2
Configure ISIS router on IRB interface.
PE4(config-vrf)#nvo vxlan vtep-ip-global 4.4.4.4
Configure the source VTEP IP address of the VxLAN tunnel.
PE4(config)#nvo vxlan id 201 ingress-replication
Add a tenant L2 VNID to the VxLAN. Specify ingress-replication to use head end replication for forwarding BUM traffic
PE4(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF2
Associate the L2VRF1 reachable protocol to Ethernet-VPN over BGP
PE4(config-nvo)# evpn irb2001
Configure default gateway behavior for IRB interface irb2001.
PE4(config-nvo)# vni-name VNI-201
Configure VNI name.
PE4(config-nvo)#nvo vxlan id 3002 ingress-replication
Add a tenant L2 VNID to the VxLAN. Specify ingress-replication to use head end replication for forwarding BUM traffic.
PE4(config-nvo)# vxlan host-reachability-protocol evpn-bgp L2VRF2
Associate the L2VRF2 reachable protocol to Ethernet-VPN over BGP.
PE4(config-nvo)# evpn irb3002
Configure default gateway behavior for IRB interface irb3002.
PE4(config-nvo)#nvo vxlan id 3003 ingress-replication
Add a tenant L2 VNID to the VxLAN. Specify ingress-replication to use head end replication for forwarding BUM traffic.
PE4(config-nvo)#qos enable
Enable QoS.
PE4(config-irb-if)#interface lo
Configure loopback interface
PE4(config-if)# ip address 4.4.4.4/32 secondary
Configure secondary IP address
PE4(config-if)# ip router isis 1
Configure ISIS router on lo interface.
PE4(config-if)#interface xe5
Configure xe5 interface.
PE4(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the xe5 interface.
PE4(config-if)# ip address 102.1.1.2/24
Configure IP address.
PE4(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE4(config-if)# ip router isis 1
Configure ISIS router on ce3 interface.
PE4(config-if)#interface xe25
Configure xe25 interface.
PE4(config-if)# ip address 24.1.1.1/24
Configure IP address.
PE4(config-if)# mtu 9000
Configure the Maximum Transmission Unit (MTU).
PE4(config-if)#interface xe26
Configure xe26 interface.
PE4(config-if)# switchport
Configure port as L2.
PE4(config-if)# load-interval 30
Configures the load-interval for monitoring traffic on the xe26 interface.
PE4(config)#nvo vxlan access-if port-vlan xe26 200
Map the VLAN port for ISIS switch on xe26 interface to identify the VxLAN traffic and to enter NVO access interface mode.
PE4(config-acc-if-evpn)# map vpn-id 201
Map the l2vnid to an access-port.
PE4(config-if)# exit
Exit the interface configuration mode.
PE4(config)#router ospf 1
Configure OSPF router.
PE4(config-router)# network 4.4.4.4/32 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 4.4.4.4/32.
PE4(config-router)# network 24.1.1.0/24 area 0.0.0.0
Enable OSPF routing with area ID 0.0.0.0 on IRB interface with IP address that match the network address 24.1.1.0/24.
PE4(config-router)#router isis 1
Configure ISIS router on xe24 interface.
PE4(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE4(config-router)# metric-style wide
Configure metric-style as wide.
PE4(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE4(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE4(config-router)# net 49.0000.0004.0001.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE4(config-router)# redistribute connected
Redistribute connected routes.
PE4(config-router)#!
 
PE4(config-router)#router isis 2 L3VRF2
Configure ISIS on IRB L3VRF2.
PE4(config-router)# is-type level-1-2
Configure IS type as level 1 and level 2.
PE4(config-router)# metric-style wide
Configure metric-style as wide.
PE4(config-router)# dynamic-hostname
Configure the hostname to advertise for the ISIS router.
PE4(config-router)# bfd all-interfaces
Enable the Bidirectional Forwarding Detection (BFD) feature on all the interfaces enabled with this ISIS instance.
PE4(config-router)# net 49.0000.0000.0441.00
Set a Network Entity Title for this instance, specifying the area address and the system ID.
PE4(config-router)#router bgp 400
Start the eBGP router.
PE4(config-router)# bgp router-id 4.4.4.4
Configure BGP router id.
PE4(config-router)# no bgp inbound-route-filter
Disable the VPN/BGP inbound route-target filter.
PE4(config-router)# neighbor 5.5.5.5 remote-as 500
Configure BGP peering relationship with a customer edge router.
PE4(config-router)# neighbor 6.6.6.6 remote-as 600
Configure BGP peering relationship with a customer edge router.
PE4(config-router)# neighbor 5.5.5.5 update-source lo
Specifies that loopback interface (lo) is the source for the BGP 5.5.5.5 to establish the TCP connections
PE4(config-router)# neighbor 6.6.6.6 advertisement-interval 0
Configure a minimum advertisement interval between the sending of BGP routing updates.
PE4(config-router)# address-family l2vpn evpn
Enter to the L2 VPN address family mode to configure the address-family specific parameters.
PE4(config-router-af)# neighbor 5.5.5.5 activate
Enable the exchange of specific address family routes with a neighboring router 5.5.5.5.
PE4(config-router-af)# neighbor 6.6.6.6 activate
Enable the exchange of specific address family routes with a neighboring router 6.6.6.6.
PE4(config-router-af)# exit-address-family
Exit address family configuration mode.
PE4(config-router)# address-family ipv4 vrf L3VRF2
Enter to the IRB IPv4 VRF address family mode to configure the address-family specific parameters.
PE4(config-router-af)# redistribute connected
Redistribute connected routes.
PE4(config-router-af)# exit-address-family
Exit address family configuration mode.
PE4(config-router)# exit
Exit router configuration mode.
PE4(config)#end
Exit global configuration mode.
 
 
 
 
 
Validation
PE1#show ip ospf neighbor
 
Total number of full neighbors: 2
OSPF process 1 VRF(default):
Neighbor ID Pri State Dead Time Address Interface Instance ID
17.12.13.1 1 Full/DR 00:00:35 16.16.16.2 vlan1.200 0
17.17.17.2 1 Full/DR 00:00:31 17.17.17.2 vlan1.200 0
 
PE1#show ip route vrf all
Codes: K - kernel, C - connected, S - static, R - RIP, B - BGP
O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2
i - IS-IS, L1 - IS-IS level-1, L2 - IS-IS level-2,
ia - IS-IS inter area, E - EVPN,
v - vrf leaked
* - candidate default
 
IP Route Table for VRF "default"
C 1.1.1.1/32 is directly connected, lo, 00:23:27
O E2 3.3.3.3/32 [110/1] via 16.16.16.2, vlan1.200, 00:18:02
[110/1] via 17.17.17.2, vlan1.200
O E2 7.7.7.7/32 [110/1] via 17.17.17.2, vlan1.200, 00:18:45
O E2 8.8.8.8/32 [110/1] via 16.16.16.2, vlan1.200, 00:19:14
C 16.16.16.0/24 is directly connected, vlan1.200, 00:21:24
C 17.17.1.0/24 is directly connected, vlan1.200, 00:21:24
C 17.17.17.0/24 is directly connected, vlan1.200, 00:21:24
C 20.1.1.0/24 is directly connected, xe2.103, 00:22:31
O E2 40.1.1.0/24 [110/1] via 16.16.16.2, vlan1.200, 00:18:02
[110/1] via 17.17.17.2, vlan1.200
C 101.11.11.0/24 is directly connected, vlan1.200, 00:21:24
C 127.0.0.0/8 is directly connected, lo, 00:23:27
 
IP Route Table for VRF "management"
C 10.12.98.0/24 is directly connected, eth0, 00:23:27
C 127.0.0.0/8 is directly connected, lo.management, 00:23:27
 
Gateway of last resort is not set
PE1#
PE1#ping 40.1.1.1
Press CTRL+C to exit
PING 40.1.1.1 (40.1.1.1) 56(84) bytes of data.
64 bytes from 40.1.1.1: icmp_seq=1 ttl=63 time=0.678 ms
64 bytes from 40.1.1.1: icmp_seq=2 ttl=63 time=0.568 ms
64 bytes from 40.1.1.1: icmp_seq=3 ttl=63 time=0.567 ms
64 bytes from 40.1.1.1: icmp_seq=4 ttl=63 time=0.657 ms
 
--- 40.1.1.1 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 59ms
rtt min/avg/max/mdev = 0.567/0.617/0.678/0.056 ms
PE1#
 
 
PE2#show clns neighbors
 
Total number of L1 adjacencies: 4
Total number of L2 adjacencies: 4
Total number of adjacencies: 8
Tag 1: VRF : default
System Id Interface SNPA State Holdtime Type Protocol
PE7 vlan1.100 0000.0000.1111 Up 21 L1 IS-IS
Up 21 L2 IS-IS
PE8 vlan1.100 0000.0000.1111 Up 20 L1 IS-IS
Up 20 L2 IS-IS
PE7 vlan1.101 0000.0000.1111 Up 21 L1 IS-IS
Up 21 L2 IS-IS
PE8 vlan1.101 0000.0000.1111 Up 20 L1 IS-IS
Up 20 L2 IS-IS
 
PE2#show ip route vrf all
Codes: K - kernel, C - connected, S - static, R - RIP, B - BGP
O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2
i - IS-IS, L1 - IS-IS level-1, L2 - IS-IS level-2,
ia - IS-IS inter area, E - EVPN,
v - vrf leaked
* - candidate default
 
IP Route Table for VRF "default"
C 2.2.2.2/32 is directly connected, lo, 00:25:56
i L2 4.4.4.4/32 [115/10] via 13.1.1.2, vlan1.100, 00:22:51
[115/10] via 12.1.1.2, vlan1.100
i L2 7.7.7.7/32 [115/10] via 12.1.1.2, vlan1.100, 00:24:20
i L2 8.8.8.8/32 [115/10] via 13.1.1.2, vlan1.100, 00:24:03
C 10.1.1.0/24 is directly connected, xe11.105, 00:25:23
C 11.11.11.0/24 is directly connected, vlan1.100, 00:25:22
C 12.1.1.0/24 is directly connected, vlan1.100, 00:25:22
i L1 12.13.14.0/24 [115/20] via 13.1.1.2, vlan1.100, 00:24:20
[115/20] via 12.1.1.2, vlan1.100
C 13.1.1.0/24 is directly connected, vlan1.100, 00:25:22
i L2 50.50.50.0/24 [115/10] via 13.1.1.2, vlan1.100, 00:22:51
[115/10] via 12.1.1.2, vlan1.100
C 127.0.0.0/8 is directly connected, lo, 00:25:56
 
IP Route Table for VRF "management"
C 10.12.98.0/24 is directly connected, eth0, 00:25:56
C 127.0.0.0/8 is directly connected, lo.management, 00:25:56
 
Gateway of last resort is not set
PE2#ping 50.50.50.1
Press CTRL+C to exit
PING 50.50.50.1 (50.50.50.1) 56(84) bytes of data.
64 bytes from 50.50.50.1: icmp_seq=1 ttl=63 time=0.491 ms
64 bytes from 50.50.50.1: icmp_seq=2 ttl=63 time=0.411 ms
64 bytes from 50.50.50.1: icmp_seq=3 ttl=63 time=0.628 ms
64 bytes from 50.50.50.1: icmp_seq=4 ttl=63 time=0.661 ms
 
--- 50.50.50.1 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 65ms
rtt min/avg/max/mdev = 0.411/0.547/0.661/0.105 ms
PE2#
 
 
PE7#show clns neighbors
 
Total number of L1 adjacencies: 1
Total number of L2 adjacencies: 1
Total number of adjacencies: 2
Tag 1: VRF : default
System Id Interface SNPA State Holdtime Type Protocol
PE6 sa2 e8c5.7a19.c3c8 Up 5 L1 IS-IS
Up 5 L2 IS-IS
 
Total number of L1 adjacencies: 2
Total number of L2 adjacencies: 2
Total number of adjacencies: 4
Tag 2: VRF : L3VRF4
System Id Interface SNPA State Holdtime Type Protocol
PE2 irb801 e8c5.7a76.581d Up 5 L1 IS-IS
Up 5 L2 IS-IS
PE2 irb802 e8c5.7a76.581d Up 5 L1 IS-IS
Up 5 L2 IS-IS
 
PE7#show ip ospf neighbor
 
Total number of full neighbors: 1
OSPF process 1 VRF(default):
Neighbor ID Pri State Dead Time Address Interface Instance ID
5.5.5.5 1 Full/Backup 00:00:34 22.1.1.2 sa3 0
 
Total number of full neighbors: 1
OSPF process 2 VRF(L3VRF3):
Neighbor ID Pri State Dead Time Address Interface Instance ID
1.1.1.1 1 Full/Backup 00:00:34 16.16.16.1 irb701 0
 
 
 
 
PE7#show ip route 2023 Nov 27 13:04:32.790 : PE7 : HSL : NOTIF : [IF_PKT_ERRORS_4]: Fragment packets received on xe43 (1 packets)
 
vrf all
Codes: K - kernel, C - connected, S - static, R - RIP, B - BGP
O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2
i - IS-IS, L1 - IS-IS level-1, L2 - IS-IS level-2,
ia - IS-IS inter area, E - EVPN,
v - vrf leaked
* - candidate default
 
IP Route Table for VRF "default"
O 3.3.3.3/32 [110/3] via 22.1.1.2, sa3, 00:23:42
O 4.4.4.4/32 [110/3] via 22.1.1.2, sa3, 00:23:27
O 5.5.5.5/32 [110/2] via 22.1.1.2, sa3, 00:26:13
i L1 6.6.6.6/32 [115/20] via 80.1.1.2, sa2, 00:25:44
C 7.7.7.7/32 is directly connected, lo, 00:29:00
O 8.8.8.8/32 [110/3] via 22.1.1.2, sa3, 00:26:09
O 21.1.1.0/24 [110/2] via 22.1.1.2, sa3, 00:26:13
C 22.1.1.0/24 is directly connected, sa3, 00:27:04
O 23.1.1.0/24 [110/2] via 22.1.1.2, sa3, 00:24:37
O 24.1.1.0/24 [110/2] via 22.1.1.2, sa3, 00:24:20
C 80.1.1.0/24 is directly connected, sa2, 00:25:59
i L1 90.1.1.0/24 [115/20] via 80.1.1.2, sa2, 00:25:44
O 101.1.1.0/24 [110/3] via 22.1.1.2, sa3, 00:23:42
i L1 102.1.1.0/24 [115/20] via 80.1.1.2, sa2, 00:23:31
C 127.0.0.0/8 is directly connected, lo, 00:29:00
 
IP Route Table for VRF "management"
C 10.12.93.0/24 is directly connected, eth0, 00:29:00
C 127.0.0.0/8 is directly connected, lo.management, 00:29:00
 
IP Route Table for VRF "L3VRF3"
B 3.3.3.3/32 [0/0] is directly connected, tunvxlan2, 00:23:42
B 8.8.8.8/32 [0/0] is directly connected, tunvxlan2, 00:25:09
C 16.16.16.0/24 is directly connected, irb701, 00:29:00
C 17.12.13.0/24 is directly connected, irb701, 00:29:00
O 17.17.17.0/24 [110/2] via 16.16.16.1, irb701, 00:26:33
O 20.1.1.0/24 [110/2] via 16.16.16.1, irb701, 00:26:33
B 40.1.1.0/24 [20/0] via 3.3.3.3 (recursive is directly connected, tunvxlan2), 00:23:56
C 127.0.0.0/8 is directly connected, lo.L3VRF3, 00:29:00
 
IP Route Table for VRF "L3VRF4"
i L2 2.2.2.2/32 [115/10] via 13.1.1.1, irb801, 00:25:22
B 4.4.4.4/32 [0/0] is directly connected, tunvxlan3, 00:23:27
B 8.8.8.8/32 [0/0] is directly connected, tunvxlan3, 00:25:09
i L1 10.1.1.0/24 [115/20] via 13.1.1.1, irb801, 00:25:24
i L1 11.11.11.0/24 [115/20] via 13.1.1.1, irb801, 00:25:24
i L1 12.1.1.0/24 [115/20] via 13.1.1.1, irb801, 00:25:24
C 12.13.14.0/24 is directly connected, irb801, 00:29:00
C 13.1.1.0/24 is directly connected, irb801, 00:29:00
B 50.50.50.0/24 [20/0] via 4.4.4.4 (recursive is directly connected, tunvxlan3), 00:23:56
C 127.0.0.0/8 is directly connected, lo.L3VRF4, 00:29:00
IP Route Table for VRF "L2VRF1"
IP Route Table for VRF "L2VRF2"
IP Route Table for VRF "evpn-gvrf-1"
 
Gateway of last resort is not set
 
PE7# show nvo vxlan tunnel
VXLAN Network tunnel Entries
Source Destination Status Up/Down Update
========================================================================
7.7.7.7 8.8.8.8 Installed 00:25:36 00:25:36
7.7.7.7 4.4.4.4 Installed 00:23:53 00:23:53
7.7.7.7 3.3.3.3 Installed 00:24:08 00:24:08
 
Total number of entries are 3
PE7#show nvo vxlan l3vni-map
L3VNI L2VNI IRB-interface
===================================
2000 801 irb801
2000 8001 irb802
1000 701 irb701
1000 7001 irb702
 
PE7#show 2023 Nov 27 13:05:12.791 : PE7 : HSL : NOTIF : [IF_PKT_ERRORS_4]: Fragment packets received on xe43 (1 packets)
 
nvo vxlan
VXLAN Information
=================
Codes: NW - Network Port
AC - Access Port
(u) - Untagged
 
VNID VNI-Name VNI-Type Type Interface ESI VLAN DF-Status Src-Addr Dst-Addr
_______________________________________________________________________________________________________________________________
701 VNI-701 L2 NW ---- ---- ---- ---- 7.7.7.7 8.8.8.8
701 VNI-701 -- AC sa1 00:00:01:02:03:04:05:06:07:08 200 DF ---- ----
801 VNI-101 L2 NW ---- ---- ---- ---- 7.7.7.7 8.8.8.8
801 VNI-101 -- AC po1 00:00:00:00:00:77:82:00:00:00 100 DF ---- ----
1000 ---- L3 NW ---- ---- ---- ---- 7.7.7.7 8.8.8.8
1000 ---- L3 NW ---- ---- ---- ---- 7.7.7.7 3.3.3.3
2000 ---- L3 NW ---- ---- ---- ---- 7.7.7.7 8.8.8.8
2000 ---- L3 NW ---- ---- ---- ---- 7.7.7.7 4.4.4.4
7001 ---- L2 NW ---- ---- ---- ---- 7.7.7.7 8.8.8.8
7001 ---- -- AC sa1 00:00:01:02:03:04:05:06:07:08 201 NON-DF ---- ----
8001 ---- L2 NW ---- ---- ---- ---- 7.7.7.7 8.8.8.8
8001 ---- -- AC po1 00:00:00:00:00:77:82:00:00:00 101 NON-DF ---- ----
 
Total number of entries are 12
PE7#
 
PE7#show bgp l2vpn evpn prefix-route
 
RD[8100:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 17.17.17.0 0.0.0.0 1000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 17.17.17.0 0.0.0.0 1000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 30:: :: 1000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 30:: :: 1000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 7102:: :: 1000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 7102:: :: 1000 8.8.8.8 VXLAN 1444:8f53:3e9e
 
RD[8400:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 10.1.1.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 10.1.1.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 11.11.11.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 11.11.11.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 12.1.1.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 12.1.1.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 12.13.14.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 12.13.14.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 13.1.1.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 24 13.1.1.0 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 32 2.2.2.2 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 32 2.2.2.2 0.0.0.0 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 2:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 2:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 40:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 40:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 50:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 50:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 8002:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 8002:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 8102:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
0 0 64 8102:: :: 2000 8.8.8.8 VXLAN 1444:8f53:3e9e
 
RD[56000:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 40.1.1.0 0.0.0.0 1000 3.3.3.3 VXLAN e49d:73b1:c301
0 0 24 40.1.1.0 0.0.0.0 1000 3.3.3.3 VXLAN e49d:73b1:c301
0 0 64 2002:: :: 1000 3.3.3.3 VXLAN e49d:73b1:c301
0 0 64 2002:: :: 1000 3.3.3.3 VXLAN e49d:73b1:c301
 
RD[63000:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 50.50.50.0 0.0.0.0 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
0 0 24 50.50.50.0 0.0.0.0 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
0 0 64 3002:: :: 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
0 0 64 3002:: :: 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
PE7#PE8#show clns neighbors
 
Total number of L1 adjacencies: 1
Total number of L2 adjacencies: 1
Total number of adjacencies: 2
Tag 1: VRF : default
System Id Interface SNPA State Holdtime Type Protocol
PE6 xe2 e8c5.7a19.c3c1 Up 7 L1 IS-IS
Up 7 L2 IS-IS
 
Total number of L1 adjacencies: 2
Total number of L2 adjacencies: 2
Total number of adjacencies: 4
Tag 2: VRF : L3VRF4
System Id Interface SNPA State Holdtime Type Protocol
PE2 irb801 e8c5.7a76.581d Up 7 L1 IS-IS
Up 7 L2 IS-IS
PE2 irb802 e8c5.7a76.581d Up 7 L1 IS-IS
Up 7 L2 IS-IS
PE8#show ip ospf neighbor
 
Total number of full neighbors: 1
OSPF process 1 VRF(default):
Neighbor ID Pri State Dead Time Address Interface Instance ID
5.5.5.5 1 Full/Backup 00:00:31 21.1.1.2 xe12 0
 
Total number of full neighbors: 1
OSPF process 2 VRF(L3VRF3):
Neighbor ID Pri State Dead Time Address Interface Instance ID
1.1.1.1 1 Full/Backup 00:00:35 17.17.17.1 irb701 0
PE8#terminal width 511
 
PE8#show ip route vrf all
Codes: K - kernel, C - connected, S - static, R - RIP, B - BGP
O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2
i - IS-IS, L1 - IS-IS level-1, L2 - IS-IS level-2,
ia - IS-IS inter area, E - EVPN,
v - vrf leaked
* - candidate default
 
IP Route Table for VRF "default"
O 3.3.3.3/32 [110/3] via 21.1.1.2, xe12, 00:26:22
O 4.4.4.4/32 [110/3] via 21.1.1.2, xe12, 00:26:07
O 5.5.5.5/32 [110/2] via 21.1.1.2, xe12, 00:28:59
i L1 6.6.6.6/32 [115/20] via 90.1.1.2, xe2, 00:28:23
O 7.7.7.7/32 [110/3] via 21.1.1.2, xe12, 00:28:52
C 8.8.8.8/32 is directly connected, lo, 00:31:21
C 21.1.1.0/24 is directly connected, xe12, 00:29:44
O 22.1.1.0/24 [110/2] via 21.1.1.2, xe12, 00:28:59
O 23.1.1.0/24 [110/2] via 21.1.1.2, xe12, 00:27:17
O 24.1.1.0/24 [110/2] via 21.1.1.2, xe12, 00:27:00
i L1 80.1.1.0/24 [115/20] via 90.1.1.2, xe2, 00:28:23
C 90.1.1.0/24 is directly connected, xe2, 00:28:39
O 101.1.1.0/24 [110/3] via 21.1.1.2, xe12, 00:26:22
i L1 102.1.1.0/24 [115/20] via 90.1.1.2, xe2, 00:26:11
C 127.0.0.0/8 is directly connected, lo, 00:31:21
 
IP Route Table for VRF "management"
C 10.12.93.0/24 is directly connected, eth0, 00:31:21
C 127.0.0.0/8 is directly connected, lo.management, 00:31:21
 
IP Route Table for VRF "L3VRF3"
B 3.3.3.3/32 [0/0] is directly connected, tunvxlan2, 00:26:22
B 7.7.7.7/32 [0/0] is directly connected, tunvxlan2, 00:28:17
B 16.16.16.0/24 [20/0] via 7.7.7.7 (recursive is directly connected, tunvxlan2), 00:28:17
C 17.12.13.0/24 is directly connected, irb701, 00:31:21
C 17.17.17.0/24 is directly connected, irb701, 00:31:21
B 20.1.1.0/24 [20/0] via 7.7.7.7 (recursive is directly connected, tunvxlan2), 00:28:17
B 40.1.1.0/24 [20/0] via 3.3.3.3 (recursive is directly connected, tunvxlan2), 00:26:37
C 127.0.0.0/8 is directly connected, lo.L3VRF3, 00:31:21
 
IP Route Table for VRF "L3VRF4"
i L2 2.2.2.2/32 [115/10] via 12.1.1.1, irb801, 00:28:44
B 4.4.4.4/32 [0/0] is directly connected, tunvxlan3, 00:26:07
B 7.7.7.7/32 [0/0] is directly connected, tunvxlan3, 00:28:17
i L1 10.1.1.0/24 [115/20] via 12.1.1.1, irb801, 00:28:44
i L1 11.11.11.0/24 [115/20] via 12.1.1.1, irb801, 00:28:44
C 12.1.1.0/24 is directly connected, irb801, 00:31:21
C 12.13.14.0/24 is directly connected, irb801, 00:31:21
i L1 13.1.1.0/24 [115/20] via 12.1.1.1, irb801, 00:28:44
B 50.50.50.0/24 [20/0] via 4.4.4.4 (recursive is directly connected, tunvxlan3), 00:26:37
C 127.0.0.0/8 is directly connected, lo.L3VRF4, 00:31:21
IP Route Table for VRF "L2VRF1"
IP Route Table for VRF "L2VRF2"
IP Route Table for VRF "evpn-gvrf-1"
 
Gateway of last resort is not set
PE8#show nvo vxlan tunnel
VXLAN Network tunnel Entries
Source Destination Status Up/Down Update
========================================================================
8.8.8.8 7.7.7.7 Installed 00:28:24 00:28:24
8.8.8.8 3.3.3.3 Installed 00:26:28 00:26:28
8.8.8.8 4.4.4.4 Installed 00:26:13 00:26:13
 
Total number of entries are 3
PE8#show nvo vxlan
VXLAN Information
=================
Codes: NW - Network Port
AC - Access Port
(u) - Untagged
 
VNID VNI-Name VNI-Type Type Interface ESI VLAN DF-Status Src-Addr Dst-Addr
_______________________________________________________________________________________________________________________________
701 VNI-701 L2 NW ---- ---- ---- ---- 8.8.8.8 7.7.7.7
701 VNI-701 -- AC sa1 00:00:01:02:03:04:05:06:07:08 200 NON-DF ---- ----
801 VNI-101 L2 NW ---- ---- ---- ---- 8.8.8.8 7.7.7.7
801 VNI-101 -- AC po1 00:00:00:00:00:77:82:00:00:00 100 NON-DF ---- ----
1000 ---- L3 NW ---- ---- ---- ---- 8.8.8.8 7.7.7.7
1000 ---- L3 NW ---- ---- ---- ---- 8.8.8.8 3.3.3.3
2000 ---- L3 NW ---- ---- ---- ---- 8.8.8.8 7.7.7.7
2000 ---- L3 NW ---- ---- ---- ---- 8.8.8.8 4.4.4.4
7001 ---- L2 NW ---- ---- ---- ---- 8.8.8.8 7.7.7.7
7001 ---- -- AC sa1 00:00:01:02:03:04:05:06:07:08 201 DF ---- ----
8001 ---- L2 NW ---- ---- ---- ---- 8.8.8.8 7.7.7.7
8001 ---- -- AC po1 00:00:00:00:00:77:82:00:00:00 101 DF ---- ----
 
Total number of entries are 12
 
PE8#show bgp l2vpn evpn prefix-route
 
RD[7100:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 16.16.16.0 0.0.0.0 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 16.16.16.0 0.0.0.0 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 17.17.17.0 0.0.0.0 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 17.17.17.0 0.0.0.0 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 20.1.1.0 0.0.0.0 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 20.1.1.0 0.0.0.0 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 30:: :: 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 30:: :: 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 7002:: :: 1000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 7002:: :: 1000 7.7.7.7 VXLAN e001:a666:056d
 
RD[7400:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 10.1.1.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 10.1.1.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 11.11.11.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 11.11.11.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 12.1.1.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 12.1.1.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 12.13.14.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 12.13.14.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 13.1.1.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 24 13.1.1.0 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 32 2.2.2.2 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 32 2.2.2.2 0.0.0.0 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 2:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 2:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 40:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 40:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 50:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 50:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 8002:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 8002:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 8102:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
0 0 64 8102:: :: 2000 7.7.7.7 VXLAN e001:a666:056d
 
RD[56000:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 40.1.1.0 0.0.0.0 1000 3.3.3.3 VXLAN e49d:73b1:c301
0 0 24 40.1.1.0 0.0.0.0 1000 3.3.3.3 VXLAN e49d:73b1:c301
0 0 64 2002:: :: 1000 3.3.3.3 VXLAN e49d:73b1:c301
0 0 64 2002:: :: 1000 3.3.3.3 VXLAN e49d:73b1:c301
 
RD[63000:11]
ESI Eth-Tag Prefix-Length IP-Address GW-IPAddress L3VNID/LABEL Nexthop Encap Router-Mac
0 0 24 50.50.50.0 0.0.0.0 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
0 0 24 50.50.50.0 0.0.0.0 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
0 0 64 3002:: :: 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
0 0 64 3002:: :: 2000 4.4.4.4 VXLAN e8c5:7aa8:7cb3
PE8#
 
 
PE3#show ip ospf neighbor
 
Total number of full neighbors: 1
OSPF process 1 VRF(default):
Neighbor ID Pri State Dead Time Address Interface Instance ID
5.5.5.5 1 Full/DR 00:00:29 23.1.1.2 xe14 0
 
Total number of full neighbors: 1
OSPF process 2 VRF(L3VRF1):
Neighbor ID Pri State Dead Time Address Interface Instance ID
192.0.0.2 0 Full/DROther 00:00:35 40.1.1.2 irb1001 0
 
PE3#show ip route vrf all
Codes: K - kernel, C - connected, S - static, R - RIP, B - BGP
O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2
i - IS-IS, L1 - IS-IS level-1, L2 - IS-IS level-2,
ia - IS-IS inter area, E - EVPN,
v - vrf leaked
* - candidate default
 
IP Route Table for VRF "default"
C 3.3.3.3/32 is directly connected, lo, 00:37:01
O 4.4.4.4/32 [110/3] via 23.1.1.2, xe14, 00:35:25
O 5.5.5.5/32 [110/2] via 23.1.1.2, xe14, 00:35:44
i L1 6.6.6.6/32 [115/20] via 101.1.1.1, ce3, 00:36:20
O 7.7.7.7/32 [110/3] via 23.1.1.2, xe14, 00:35:44
O 8.8.8.8/32 [110/3] via 23.1.1.2, xe14, 00:35:44
O 21.1.1.0/24 [110/2] via 23.1.1.2, xe14, 00:35:44
O 22.1.1.0/24 [110/2] via 23.1.1.2, xe14, 00:35:44
C 23.1.1.0/24 is directly connected, xe14, 00:36:36
O 24.1.1.0/24 [110/2] via 23.1.1.2, xe14, 00:35:44
i L1 80.1.1.0/24 [115/20] via 101.1.1.1, ce3, 00:36:20
i L1 90.1.1.0/24 [115/20] via 101.1.1.1, ce3, 00:36:20
C 101.1.1.0/24 is directly connected, ce3, 00:36:35
i L1 102.1.1.0/24 [115/20] via 101.1.1.1, ce3, 00:35:30
C 127.0.0.0/8 is directly connected, lo, 00:37:01
 
IP Route Table for VRF "management"
C 10.12.98.0/24 is directly connected, eth0, 00:37:01
C 127.0.0.0/8 is directly connected, lo.management, 00:37:01
 
IP Route Table for VRF "L3VRF1"
B 7.7.7.7/32 [0/0] is directly connected, tunvxlan2, 00:35:44
B 8.8.8.8/32 [0/0] is directly connected, tunvxlan2, 00:35:44
B 16.16.16.0/24 [20/0] via 7.7.7.7 (recursive is directly connected,
tunvxlan2), 00:36:15
B 17.17.17.0/24 [20/0] via 7.7.7.7 (recursive is directly connected,
tunvxlan2), 00:36:15
B 20.1.1.0/24 [20/0] via 7.7.7.7 (recursive is directly connected, tu
nvxlan2), 00:36:15
C 40.1.1.0/24 is directly connected, irb1001, 00:37:01
O 55.0.0.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.1.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.2.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.3.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.4.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.5.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.6.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.7.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.8.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
O 55.0.9.0/24 [110/2] via 40.1.1.2, irb1001, 00:01:38
C 127.0.0.0/8 is directly connected, lo.L3VRF1, 00:37:01
 
IP Route Table for VRF "L2VRF1"
 
Gateway of last resort is not set
PE3#show nvo vxlan tunnel
VXLAN Network tunnel Entries
Source Destination Status Up/Down Update
========================================================================
3.3.3.3 7.7.7.7 Installed 00:35:56 00:35:56
3.3.3.3 8.8.8.8 Installed 00:35:56 00:35:56
 
Total number of entries are 2
PE3#
 
PE4#show clns neighbors
 
Total number of L1 adjacencies: 1
Total number of L2 adjacencies: 1
Total number of adjacencies: 2
Tag 1: VRF : default
System Id Interface SNPA State Holdtime Type Protocol
PE6 xe5 e8c5.7a19.c3ae Up 21 L1 IS-IS
Up 21 L2 IS-IS
Total number of L1 adjacencies: 0
Total number of L2 adjacencies: 1
Total number of adjacencies: 1
Tag 2: VRF : L3VRF2
System Id Interface SNPA State Holdtime Type Protocol
Spirent-1 irb2001 0010.9400.0007 Up 26 L2 IS-IS
 
Total number of L1 adjacencies: 0
Total number of L2 adjacencies: 1
Total number of adjacencies: 1
Tag 3: VRF : L3VRF2
System Id Interface SNPA State Holdtime Type Protocol
0010.9400.0009 irb3002 0010.9400.0009 Up 25 L2 IS-IS
PE4#show ip route vrf all
Codes: K - kernel, C - connected, S - static, R - RIP, B - BGP
O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2
i - IS-IS, L1 - IS-IS level-1, L2 - IS-IS level-2,
ia - IS-IS inter area, E - EVPN,
v - vrf leaked
* - candidate default
 
IP Route Table for VRF "default"
O 3.3.3.3/32 [110/3] via 24.1.1.2, xe25, 00:36:12
C 4.4.4.4/32 is directly connected, lo, 00:37:52
O 5.5.5.5/32 [110/2] via 24.1.1.2, xe25, 00:36:12
i L1 6.6.6.6/32 [115/20] via 102.1.1.1, xe5, 00:36:48
O 7.7.7.7/32 [110/3] via 24.1.1.2, xe25, 00:36:12
O 8.8.8.8/32 [110/3] via 24.1.1.2, xe25, 00:36:12
O 21.1.1.0/24 [110/2] via 24.1.1.2, xe25, 00:36:12
O 22.1.1.0/24 [110/2] via 24.1.1.2, xe25, 00:36:12
O 23.1.1.0/24 [110/2] via 24.1.1.2, xe25, 00:36:12
C 24.1.1.0/24 is directly connected, xe25, 00:37:04
i L1 80.1.1.0/24 [115/20] via 102.1.1.1, xe5, 00:36:48
i L1 90.1.1.0/24 [115/20] via 102.1.1.1, xe5, 00:36:48
O 101.1.1.0/24 [110/3] via 24.1.1.2, xe25, 00:36:12
C 102.1.1.0/24 is directly connected, xe5, 00:37:04
C 127.0.0.0/8 is directly connected, lo, 00:37:52
IP Route Table for VRF "management"
C 10.12.98.0/24 is directly connected, eth0, 00:37:52
C 127.0.0.0/8 is directly connected, lo.management, 00:37:52
IP Route Table for VRF "L3VRF2"
Gateway of last resort is 7.7.7.7 to network 0.0.0.0
 
B* 0.0.0.0/0 [20/0] via 7.7.7.7 (recursive is directly connected, tunv
xlan2), 00:01:50
B 2.2.2.2/32 [20/0] via 7.7.7.7 (recursive is directly connected, tun
vxlan2), 00:36:41
B 7.7.7.7/32 [0/0] is directly connected, tunvxlan2, 00:36:12
B 8.8.8.8/32 [0/0] is directly connected, tunvxlan2, 00:36:12
B 10.1.1.0/24 [20/0] via 7.7.7.7 (recursive is directly connected, tu
nvxlan2), 00:36:41
B 11.11.11.0/24 [20/0] via 7.7.7.7 (recursive is directly connected,
tunvxlan2), 00:36:41
B 12.1.1.0/24 [20/0] via 7.7.7.7 (recursive is directly connected, tu
nvxlan2), 00:36:41
B 12.13.14.0/24 [20/0] via 7.7.7.7 (recursive is directly connected,
tunvxlan2), 00:36:41
B 13.1.1.0/24 [20/0] via 7.7.7.7 (recursive is directly connected, tu
nvxlan2), 00:36:41
C 50.50.50.0/24 is directly connected, irb2001, 00:37:52
C 127.0.0.0/8 is directly connected, lo.L3VRF2, 00:37:52
IP Route Table for VRF "L2VRF2"
 
Gateway of last resort is not set
PE4# show nvo vxlan tunnel
VXLAN Network tunnel Entries
Source Destination Status Up/Down Update
========================================================================
4.4.4.4 7.7.7.7 Installed 00:36:18 00:36:18
4.4.4.4 8.8.8.8 Installed 00:36:18 00:36:18
 
Total number of entries are 2
PE4#
 
Abbreviations
The following are some key abbreviations and their meanings relevant to this document:
Acronym
Description
ECMP
Equal-Cost Multipath
EVPN
Ethernet Virtual Private Netwrok
VxLAN
Virtual Extensible LAN
SR
Segment Routing
IRB
Integrated Routing
OSPF
Open Shortest Path First
ISIS
Intermediate System to Intermediate System
Glossary
The following provides definitions for key terms used throughout this document.
Multi Home VxLAN
This refers to a Virtual Extensible LAN (VxLAN) deployment where a Multi data center or network site is connected to a Multi external network (usually the internet) for connectivity.
IRB
A networking feature that enables the integration of Layer 3 IP routing and Layer 2 MAC address bridging within the same interface, simplifying network management and resource utilization.
OSPF
A dynamic and efficient link-state routing protocol used to determine the best path for data packets in an IP network. It is characterized by rapid convergence and adaptability, making it suitable for large and dynamic networks.
ISIS
A routing protocol designed for scalability and stability in computer networks, commonly used in large Service Provider networks. It provides a robust framework for routing information exchange.
Layer 3 Routing
Network routing operations at the Network Layer (Layer 3) of the OSI model, focusing on routing IP packets between different subnets or networks.
Layer 2 Bridging
Network bridging operations at the Data Link Layer (Layer 2) of the OSI model, handling the forwarding of data frames based on MAC addresses within the same network segment.
EVPN
Ethernet VPN, a technology that provides advanced and efficient methods for Layer 2 and Layer 3 services in Ethernet networks, often used in data centers and service provider environments.