Link Aggregation Configuration
This chapter contains a complete sample Link Aggregation Group configuration.
LACP is based on the 802.3ad IEEE specification. It allows bundling of several physical interfaces to form a single logical channel providing enhanced performance and redundancy. The aggregated interface is viewed as a single link to each switch. The spanning tree views it as one interface and not as two or three interfaces. When there is a failure in one physical interface, the other interfaces stay up and there is no disruption. Traffic can be load balanced within an LACP trunk group in a controlled manner using the hashing algorithm.The maximum number of physical Ethernet links in a single logical channel depends upon the hardware support.
Note:
• Physical interfaces will inherit the properties of LAG port once it is attached to be part of LAG, irrespective of the configuration present on the physical interface.
• In case of Dynamic and Static LAG, it is possible to move member ports from one LAG to another LAG.
• Configure LAG port as a switch or router port, before adding member ports into it.
• LAG configuration is not allowed on inactive subsidiary ports. Configuring LAG on subsidiary ports before executing port breakout commands on control ports causes issues.
• Remove any LAG configuration from subsidiary ports before issuing the no port breakout command.
• Switchport configuration is not allowed on inactive subsidiary ports. Applying switchport configuration on subsidiary ports before executing the port breakout command causes issues.
• Do not execute the no port breakout command on subsidiary ports configured with switchport.
Topology
In Figure 6-7, 3 links are configured between the two switches S1 and S2. These three links are assigned the same administrative key (1) so that they aggregate to form a single channel 1. They are viewed by the STP as one interface.
LACP Topology
Dynamic LAG Configuration
SW1
SW1#configure terminal | Enter configure mode. |
SW1(config)# bridge 1 protocol mstp | Configure bridge 1 as MSTP bridge |
SW1(config)#vlan database | Enter vlan database mode. |
SW1(config-vlan)#vlan 2-10 bridge 1 state enable | Configure a VLAN and add it to the bridge. |
SW1(config-vlan)#exit | Exit vlan configuration mode. |
SW1(config)#lacp system-priority 20000 | Set the system priority of this switch. This priority is used for determining the system that is responsible for resolving conflicts in the choice of aggregation groups. A lower numerical value has a higher priority. |
SW1(config)#interface po10 | Enter into port channel interface po10. |
SW1(config-if)#switchport | Configure po10 as a layer 2 port. |
SW1(config-if)#bridge-group 1 | Associate bridge to an interface. |
SW1(config-if)#switchport mode trunk | Configure port as a trunk. |
SW1(config-if)#switchport trunk allowed vlan all | Allow all the VLANs on the po10 interface. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#interface eth1 | Enter interface mode. |
SW1(config-if)#channel-group 10 mode active | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#interface eth2 | Enter interface mode. |
SW1(config-if)#channel-group 10 mode active | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#interface eth3 | Enter interface mode. |
SW1(config-if)#channel-group 10 mode active | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW1(config-if)#commit | Commit the transaction. |
SW1(config-if)#exit | Exit interface mode. |
S2
SW2#configure terminal | Enter configure mode. |
SW2(config)# bridge 1 protocol mstp | Configure bridge 1 as MSTP bridge |
SW2(config)#vlan database | Enter vlan database mode. |
SW2(config-vlan)#vlan 2-10 bridge 1 state enable | Configure a VLAN and add it to the bridge. |
SW2(config-vlan)#exit | Exit vlan configuration mode. |
SW1(config)#interface po10 | Enter into port channel interface sa10. |
SW2(config-if)#switchport | Configure po10 as a layer 2 port. |
SW2(config-if)#bridge-group 1 | Associate bridge to an interface. |
SW2(config-if)#switchport mode trunk | Configure port as a trunk. |
SW2(config-if)#switchport trunk allowed vlan all | Allow all the VLANs on the po10 interface. |
SW2(config-if)#exit | Exit interface mode. |
SW2(config)#interface eth2 | Enter interface mode. |
SW2(config-if)#channel-group 10 mode active | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW2(config-if)#exit | Exit interface mode. |
SW2(config)#interface eth3 | Enter interface mode. |
SW2(config-if)#channel-group 10 mode active | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW2(config-if)#exit | Exit interface mode. |
SW2(config)#interface eth4 | Enter interface mode. |
SW2(config-if)#channel-group 10 mode active | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW2(config-if)#commit | Commit the transaction. |
SW2(config-if)#exit | Exit interface mode. |
Validation
show etherchannel detail, show etherchannel summary, show running-config interface po10, show running-config interface eth1
#show etherchannel detail
% Aggregator po10 7
% Aggregator Type: Layer2
% Mac address: 08:00:27:50:6a:9b
% Admin Key: 0010 - Oper Key 0010
% Actor LAG ID- 0x4e20,08-00-27-ab-ea-38,0x000a
% Receive link count: 3 - Transmit link count: 3
% Individual: 0 - Ready: 1
% Partner LAG ID- 0x4e20,08-00-27-f8-3c-30,0x000a
% Link: eth1 (3) sync: 1
% Link: eth2 (4) sync: 1
% Link: eth3 (5) sync: 1
% Collector max delay: 5
#show etherchannel summary
% Aggregator po10 7
% Aggregator Type: Layer2
% Admin Key: 0010 - Oper Key 0010
% Aggregator Type: Layer2
% Link: eth1 (3) sync: 1
% Link: eth2 (4) sync: 1
% Link: eth3 (5) sync: 1
#show running-config interface po10
!
interface po10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
#show running-config interface eth1
!
interface eth1
channel-group 10 mode active
Static LAG Configuration
SW1
SW1#configure terminal | Enter configure mode. |
SW1(config)# bridge 1 protocol mstp | Configure bridge 1 as MSTP bridge |
SW1(config)#vlan database | Enter vlan database mode. |
SW1(config-vlan)#vlan 2-10 bridge 1 state enable | Configure a VLAN and add it to the bridge. |
SW1(config-vlan)#exit | Exit vlan configuration mode. |
SW1(config)#interface sa10 | Enter into port channel interface sa10. |
SW1(config-if)#switchport | Configure sa10 as a layer 2 port. |
SW1(config-if)#bridge-group 1 | Associate bridge to an interface. |
SW1(config-if)#switchport mode trunk | Configure port as a trunk. |
SW1(config-if)#switchport trunk allowed vlan all | Allow all the VLANs on the po10 interface. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#interface eth1 | Enter interface mode. |
SW1(config-if)#static-channel-group 10 | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#interface eth2 | Enter interface mode. |
SW1(config-if)#static-channel-group 10 | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#interface eth3 | Enter interface mode. |
SW1(config-if)#static-channel-group 10 | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW1(config-if)#commit | Commit the transaction. |
SW1(config-if)#exit | Exit interface mode. |
SW2
SW2#configure terminal | Enter configure mode. |
SW2(config)# bridge 1 protocol mstp | Configure bridge 1 as MSTP bridge |
SW2(config)#vlan database | Enter vlan database mode. |
SW2(config-vlan)#vlan 2-10 bridge 1 state enable | Configure a VLAN and add it to the bridge. |
SW2(config-vlan)#exit | Exit vlan configuration mode. |
SW2(config)#interface sa10 | Enter into port channel interface sa10. |
SW2(config-if)#switchport | Configure sa10 as a layer 2 port. |
SW2(config-if)#bridge-group 1 | Associate bridge to an interface. |
SW2(config-if)#switchport mode trunk | Configure port as a trunk. |
SW2(config-if)#switchport trunk allowed vlan all | Allow all the VLANs on the po10 interface. |
SW2(config-if)#exit | Exit interface mode. |
SW2(config)#interface eth2 | Enter interface mode. |
SW2(config-if)#static-channel-group 10 | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW2(config-if)#exit | Exit interface mode. |
SW2(config)#interface eth3 | Enter interface mode. |
SW2(config-if)#static-channel-group 10 | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW2(config-if)#exit | Exit interface mode. |
SW2(config)#interface eth4 | Enter interface mode. |
SW2(config-if)#static-channel-group 10 | Add this interface to channel group 10 and enable link aggregation so that it can be selected for aggregation by the local system. |
SW2(config-if)#exit | Exit interface mode. |
SW1(config)#commit | Commit the transaction. |
Validation
#show static-channel-group
% Static Aggregator: sa10
% Member status:
eth1 up
eth2 up
eth3 up
#show running-config interface sa10
!
interface sa10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
#show running-config interface eth1
!
interface eth1
static-channel-group 10
Static LAG Minimum Link Configuration
Configure the minimum number of ports that must be linked up and bundled in the LACP port channel. We can configure the minimum links range from 2 to 32. If the number of ports aggregated to the port channel is less than the minimum number of links configured, then the port channel enters the Protocol Down because of the minimum link state.
Note: Minimum links should be configured the same on both sides for optimal performance.
Topology
LAG Minimum Link
SW11
#configure terminal | Enter configure mode. |
(config)#interface sa10 | Creating interface static-lag sa10 |
(config-if)#port-channel min-links 4 | Configuring port channel minimum links as 4(range is 2-32) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW1
#show static-channel-group 10
% Static Aggregator: sa10
% Minimum-Links 4
% Member status:
xe4/1 up
xe4/2 up
xe4/3 up
xe4/4 up
#show running-config interface sa10
!
interface sa10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel min-links 4
SW2
#configure terminal | Enter configure mode. |
(config)#interface sa10 | Creating interface port-channel sa10 |
(config-if)#port-channel min-links 4 | Configuring port channel minimum links as 4 (range is 2-32) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW2
#show running-config interface sa10
!
interface sa10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel min-links 4
!
#show static-channel-group 10
% Static Aggregator: sa10
% Minimum-Links 4
% Member status:
Xe50/1 up
Xe50/2 up
Xe50/3 up
Xe50/4 up
Note:When a sa goes down due to the minimum links configured (number of minimum links is greater than the links aggregated to the sa).
SW1:
=====
#OcNOS#sh int brief sa10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
sa10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
SW2:
=====
OcNOS#show int brief sa10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
sa10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
Static-LAG Minimum Bandwidth Configuration
Configure the minimum bandwidth allowed for ports that must be linked up and bundled in the LACP port channel. We can configure the minimum bandwidth range from BANDWIDTH <1-999>k|m for 1 to 999 kilo bits or mega bits <1-1000>g for 1 to 1000 giga bits. If the Total bandwidth of ports aggregated to the port channel is less than the minimum Bandwidth value configured, then the port channel enters the Protocol Down because of the minimum Bandwidth state.
Note: Minimum Bandwidth should be configured the same on both sides for optimal performance.
Topology
LAG Minimum Bandwidth
SW1
#configure terminal | Enter configure mode. |
(config)#interface sa10 | Creating interface static-lag sa10 |
(config-if)#port-channel min-bandwidth 40g | Configuring port channel minimum bandwidth as 40g (range from BANDWIDTH <1-999>k|m for 1 to 999 kilo bits or mega bits <1-1000>g for 1 to 1000 giga bits.) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW1
#show static-channel-group 10
% Static Aggregator: sa10
% Minimum- 4
% Member status:
xe4/1 up
xe4/2 up
xe4/3 up
xe4/4 up
#show running-config interface sa10
!
interface sa10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel load-balance src-dst-mac
port-channel min-links 40g
SW2
#configure terminal | Enter configure mode. |
(config)#interface sa10 | Creating interface port-channel sa10 |
(config-if)#port-channel min-bandwidth 40g | Configuring port channel minimum bandwidth as 40g (range from BANDWIDTH <1-999>k|m for 1 to 999 kilo bits or mega bits <1-1000>g for 1 to 1000 giga bits.) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW2
#show running-config interface sa10
!
interface sa10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel min-bandwidth 40g
!
#show static-channel-group 10
% Static Aggregator: sa10
% Minimum-bandwidth 40g
% Member status:
Xe50/1 up
Xe50/2 up
Xe50/3 up
Xe50/4 up
Note: When sa goes down due to [Total Bandwidth of sa] <[ Minimum Bandwidth value Configured]
SW1:
=====
#OcNOS #show int brief sa10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
sa10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
SW2:
=====
OcNOS#show int brief sa10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
sa10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
!
Dynamic-LAG Minimum Link Configuration
Configure the minimum number of ports that must be linked up and bundled in the LACP port channel. We can configure the minimum links range from 2 to 32. If the number of ports aggregated to the port channel is less than the minimum number of links configured, then the port channel enters the Protocol Down because of the minimum link state.
Note: Minimum links should be configured the same on both sides for optimal performance.
Topology
LAG Minimum Link
SW1
#configure terminal | Enter configure mode. |
(config)#interface po10 | Creating interface port-channel po10 |
(config-if)#port-channel min-links 4 | Configuring port channel minimum links as 4 (range is 2-32) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW1
#show running-config interface po10
interface po10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel min-links 4
!
!
#show etherchannel
------------------------------------
% Lacp Aggregator: po10
% Min-links : 4
% Member:
xe4/1
xe4/2
xe4/3
xe4/4
------------------------------------
#show etherchannel summary
% Aggregator po10 100010
% Aggregator Type: Layer2
% Admin Key: 0010 - Oper Key 0010
% Link: xe4/4 (10072) sync: 1
% Link: xe4/1 (10069) sync: 1
% Link: xe4/2 (10070) sync: 1
% Link: xe4/3 (10071) sync: 1
--------------------------------------
SW2
#configure terminal | Enter configure mode. |
(config)#interface po10 | Creating interface port-channel po10 |
(config-if)#port-channel min-links 4 | Configuring port channel minimum links as 4 (range is 2-32) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW2
#show running-config interface po10
!
interface po10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel min-links 4
!
#show etherchannel
% Lacp Aggregator: po10
% Min-links: 4
% Member:
xe50/1
xe50/2
xe50/3
xe50/4
#show etherchannel summary
% Aggregator po10 100010
% Aggregator Type: Layer2
% Admin Key: 0010 - Oper Key 0010
% Link: xe50/4 (10072) sync: 1
% Link: xe50/1 (10069) sync: 1
% Link: xe50/2 (10070) sync: 1
% Link: xe50/3 (10071) sync: 1
Note: When a PO goes down due to the minimum links configured (number of minimum links is greater than the links aggregated to the PO).
SW1:
====
#OcNOS#show int brief po10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
po10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
OcNOS#show etherchannel
% Lacp Aggregator: po10
% Min-links: 4
% Protocol Down (Min L/B): True
% Member:
xe4/1
xe4/2
xe4/3
xe4/4
SW2:
====
OcNOS#show etherchannel
% Lacp Aggregator: po10
% Min-links: 4
% Protocol Down (Min L/B): True
% Member:
Xe50/1
Xe50/2
Xe50/3
xe50/4
OcNOS#show int brief po10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
po10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
Dynamic LAG Minimum Bandwidth Configuration
Configure the minimum bandwidth allowed for ports that must be linked up and bundled in the LACP port channel. We can configure the minimum bandwidth range from BANDWIDTH <1-999>k|m for 1 to 999 kilo bits or mega bits <1-1000>g for 1 to 1000 giga bits. If the Total bandwidth of ports aggregated to the port channel is less than the minimum Bandwidth value configured, then the port channel enters the Protocol Down because of the minimum Bandwidth state.
Note: Minimum Bandwidth should be configured the same on both sides for optimal performance.
Topology
LAG Minimum Bandwidth
SW1
#configure terminal | Enter configure mode. |
(config)#interface po10 | Creating interface port-channel po10 |
(config-if)#port-channel min-bandwidth 40g | Configuring port channel minimum bandwidth as 40g (range from BANDWIDTH <1-999>k|m for 1 to 999 kilo bits or mega bits <1-1000>g for 1 to 1000 giga bits.) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW1
#show running-config interface po10
interface po10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel min-bandwidth 40g
!
!
#show etherchannel
------------------------------------
% Lacp Aggregator: po10
% Min-Bandwidth : 40g
% Member:
xe4/1
xe4/2
xe4/3
xe4/4
------------------------------------
#show etherchannel summary
% Aggregator po10 100010
% Aggregator Type: Layer2
% Admin Key: 0010 - Oper Key 0010
% Link: xe4/4 (10072) sync: 1
% Link: xe4/1 (10069) sync: 1
% Link: xe4/2 (10070) sync: 1
% Link: xe4/3 (10071) sync: 1
--------------------------------------
SW2
#configure terminal | Enter configure mode. |
(config)#interface po10 | Creating interface port-channel po10 |
(config-if)#port-channel min-bandwidth 40g | Configuring port channel minimum bandwidth as 40g (range from BANDWIDTH <1-999>k|m for 1 to 999 kilo bits or mega bits <1-1000>g for 1 to 1000 giga bits.) |
(config-if)#commit | Commit the transaction. |
(config-if)#exit | Exit the configure mode |
Validation
SW2
#show running-config interface po10
!
interface po10
switchport
bridge-group 1
switchport mode trunk
switchport trunk allowed vlan all
port-channel min-bandwidth 40g
!
#show etherchannel
% Lacp Aggregator: po10
% Min-Bandwidth : 40g
% Member:
xe50/1
xe50/2
xe50/3
xe50/4
#show etherchannel summary
% Aggregator po10 100010
% Aggregator Type: Layer2
% Admin Key: 0010 - Oper Key 0010
% Link: xe50/4 (10072) sync: 1
% Link: xe50/1 (10069) sync: 1
% Link: xe50/2 (10070) sync: 1
% Link: xe50/3 (10071) sync: 1
Note: When a PO goes down due to the [Total bandwidth] < [minimum bandwidth configured ]
SW1:
=====
#OcNOS#show int brief po10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
po10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
OcNOS#show etherchannel
% Lacp Aggregator: po10
% Min-Bandwidth : 40g
% Protocol Down (Min L/B): True
% Member:
xe4/1
xe4/2
xe4/3
xe4/4
SW2:
=====
OcNOS#show etherchannel
% Lacp Aggregator: po10
% Min-Bandwidth : 40g
% Protocol Down (Min L/B): True
% Member:
Xe50/1
Xe50/2
Xe50/3
xe50/4
OcNOS#show int brief po10
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
po10 AGG 1 trunk down PD(Min L/B) 0
OcNOS#
LACP Minimum-Link, Minimum-Bandwidth
Configurations on dynamic, static Channel-Groups
with MLAG.
Configurations on dynamic, static Channel-Groups
with MLAG.
Overview
OcNOS allows the configuration of minimum number of the LAG members per LAG group. Both these configurations are meaningful in case the LAG is used for incremental-BW mode. The minimum configuration controls the minimum number of members /bandwidth that must be operationally up / bandwidth available to declare their LAG as operationally UP.
When static/dynamic LAG interface configured with minimum links / minimum bandwidth, the following conditions are to be met:
• Ports which are admin and operational up are considered for min-link.
• The specified minimum number of links should be up.
• Min-link and min-bandwidth cannot co-exist.
• When ports are down due to min-link/min-bandwidth, in show interface brief command output, port down with the corresponding reason code for the failure due to min-link/min-bandwidth.
Minimum Active Members/Bandwidth
The user can specify the minimum number of members that must be operationally up to declare their LAG as operationally UP. Note that this parameter applies to static/dynamic LAG.
port-channel min-links <2 - 32>
The minimum active member configuration will be allowed to be modified to be greater than the current number of active members. In such configuration, the LAG operational status will become operationally down.
The user can specify the minimum bandwidth, based on the configured value and the ports that satisfy the conditions LAG will be operationally UP. This parameter is applied for static/dynamic LAG.
port-channel min-bandwidth BANDWIDTH
BANDWIDTH <1-999>k|m for 1 to 999 kilo bits or mega bits <1-1000>g for 1 to 1000 giga bits.
When condition fails, the operational state changes to DOWN.
Note: Do not configure minimum-link, Minimum Bandwidth both on TORS and switches at the same time to avoid flaps of MLAG.
Topology
MC - LAG Topology
Configuration
TOR1:
#configure terminal | Enter configure mode. |
(config)# bridge 1 protocol rstp vlan-bridge | Configure bridge type |
(config)# vlan database | Enter vlan database mode |
(config-vlan)# vlan 600,601,502 bridge 1 state enable | Configure a vlans and add it to the bridge. |
(config-if)#exit | Exit vlan configuration mode. |
(config)#interface mlag1 | Enter Interface mode |
(config-if)# switchport | Make mlag as layer2 port |
(config-if)# bridge-group 1 | Attach interface to bridge |
(config-if)# switchport mode trunk | Configure trunk port |
(config-if)# switchport trunk allowed vlan add 600,601,502 | Add interface to vlans |
(config-if)# spanning-tree edgeport | Configure port as edge port to avoid loops |
(config-if)# spanning-tree bpdu-filter enable | Enable bpdu filter to avoid loops |
(config-if)#mtu 9216 | Configure mtu. |
(config-if)#exit | Return to privilege mode |
(config)#interface mlag3 | Enter Interface mode |
(config-if)# switchport | Make mlag as layer2 port |
(config-if)# bridge-group 1 | Attach interface to bridge |
(config-if)# switchport mode trunk | Configure trunk port |
(config-if)# switchport trunk allowed vlan add 600,502 | Add interface to vlans |
(config-if)# spanning-tree edgeport | Configure port as edge port to avoid loops |
(config-if)# spanning-tree bpdu-filter enable | Enable bpdu filter to avoid loops |
(config-if)#mtu 9216 | Configure mtu. |
(config-if)#exit | Return to privilege mode |
(config)#commit | Commit the candidate configuration to the running Configuration. |
(config)#interface po100 | Enter Interface mode |
(config-if)# switchport | Make po as layer2 port |
(config-if)#exit | Exit interface mode. |
(config)#interface sa1 | Enter Interface mode |
(config-if)# switchport | Make sa1 as layer2 port |
(config-if)# port-channel load-balance src-dst-mac | Enable load balance |
(config-if)#exit | Return to privilege mode |
(config)#interface sa3 | Enter Interface mode |
(config-if)# switchport | Make sa3 as layer2 port |
(config-if)# port-channel load-balance src-dst-mac | Enable load balance |
(config-if)#exit | Return to privilege mode |
(config)#interface ce2/4 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa1 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/1 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/2 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/3 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/4 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce4/1 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce4/2 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce4/3 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#commit | Commit the candidate configuration to the running Configuration. |
(config)#mcec domain configuration | Enter Multichasis Etherchannel domain configuration mode. |
(config-mcec-domain)# domain-address 1111.2222.3333 | Configure the domain address. |
(config-mcec-domain)# domain-system-number 1 | Configure the domain system number |
(config-mcec-domain)# intra-domain-link po100 | Specify the intra domain link for MLAG communication |
(config-mcec-domain)#exit | Return to privilege mode |
(config)#int mlag1 | Enter Interface mode |
(config-if)#mode active-standby | Configure mlag mode for mlag1 |
(config-if)#switchover type revertive 10 | Configure revertive timer |
(config-if)#exit | Return to privilege mode |
(config)#interface sa1 | Enter Interface mode |
(config-if)#mlag 1 | Map sa1 to mlag1 |
(config-if)#exit | Return to privilege mode |
(config)#int mlag3 | Enter Interface mode |
(config-if)#mode active-standby | Configure mlag mode for mlag3 |
(config-if)#switchover type revertive 10 | Configure revertive timer |
(config-if)#exit | Return to privilege mode |
(config)#interface sa3 | Enter Interface mode |
(config-if)#mlag 3 | Map sa3 to mlag3 |
(config-if)#exit | Return to privilege mode |
(config-if)# interface sa1 | Enter sa interface mode |
(config-if)#port-channel min-links 3 | Configure min-link value on sa interface |
(config)#interface sa3 | Enter sa Interface mode |
(config-if)#port-channel min-bandwidth 30g | Configure min-bandwidth value on sa/po interface |
(config-if)#commit | Commit the candidate configuration to the running Configuration. |
(config-if)#exit | Exit interface mode. |
TOR2
#configure terminal | Enter configure mode. |
(config)#bridge 1 protocol rstp vlan-bridge | Configure bridge type |
(config)# vlan database | Enter vlan database |
(config-vlan)# vlan 600,601,502 bridge 1 state enable | Configure vlans |
(config-vlan)#exit | Exit vlan configure mode. |
(config)#interface mlag1 | Enter Interface mode |
(config-if)# switchport | Make mlag as layer2 port |
(config-if)# bridge-group 1 | Attach interface to bridge |
(config-if)# switchport mode trunk | Configure trunk port |
(config-if)# switchport trunk allowed vlan add 600,601,502 | Add interface to vlans |
(config-if)# spanning-tree edgeport | Configure port as edge port to avoid loops |
(config-if)# spanning-tree bpdu-filter enable | Enable bpdu filter to avoid loops |
(config-if)#mtu 9216 | Configure mtu. |
(config-if)#exit | Return to privilege mode |
(config)#interface mlag3 | Enter Interface mode |
(config-if)# switchport | Make mlag as layer2 port |
(config-if)# bridge-group 1 | Attach interface to bridge |
(config-if)# switchport mode trunk | Configure trunk port |
(config-if)# switchport trunk allowed vlan add 600,502 | Add interface to vlans |
(config-if)# spanning-tree edgeport | Configure port as edge port to avoid loops |
(config-if)# spanning-tree bpdu-filter enable | Enable bpdu filter to avoid loops |
(config-if)#mtu 9216 | Configure mtu. |
(config-if)#exit | Return to privilege mode |
(config)#commit | Commit the candidate configuration to the running Configuration. |
(config)#interface po100 | Enter Interface mode |
(config-if)# switchport | Make po(IDL) as layer2 port |
(config-if)#exit | Return to privilege mode |
(config)#interface sa1 | Enter Interface mode |
(config-if)# switchport | Make sa1 as layer2 port |
(config-if)# port-channel load-balance src-dst-mac | Enable load balance |
(config-if)#exit | Return to privilege mode |
(config)#interface sa3 | Enter Interface mode |
(config-if)# switchport | Make sa3 as layer2 port |
(config-if)# port-channel load-balance src-dst-mac | Enable load balance |
(config-if)#exit | Return to privilege mode |
(config)#interface ce1/1 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce1/2 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce1/3 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/1 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/2 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/3 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce3/4 | Enter Interface mode |
(config-if)# channel-group 100 mode active | Add interface to po100 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce5/1 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa1 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce5/2 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa1 |
(config-if)#exit | Return to privilege mode |
(config)#interface ce5/3 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa1 |
(config-if)#exit | Return to privilege mode |
(config)#commit | Commit the candidate configuration to the running Configuration. |
(config)#mcec domain configuration | Enter Multichasis Etherchannel domain configuration mode. |
(config-mcec-domain)# domain-address 1111.2222.3333 | Configure the domain address. |
(config-mcec-domain)# domain-system-number 2 | Configure the domain system number |
(config-mcec-domain)# intra-domain-link po100 | Specify the intra domain link for MLAG communication |
(config-mcec-domain)#exit | Return to privilege mode |
(config)#int mlag1 | Enter Interface mode |
(config-if)#mode active-standby | Configure mlag mode for mlag1 |
(config-if)#switchover type revertive 10 | Configure revertive timer |
(config-if)#exit | Return to privilege mode |
(config)#interface sa1 | Enter Interface mode |
(config-if)#mlag 1 | Map sa1 to mlag1 |
(config-if)#exit | Return to privilege mode |
(config)#int mlag3 | Enter Interface mode |
(config-if)#mode active-standby | Configure mlag mode for mlag3 |
(config-if)#switchover type revertive 10 | Configure revertive timer |
(config-if)#exit | Return to privilege mode |
(config)#interface sa3 | Enter Interface mode |
(config-if)#mlag 3 | Map sa3 to mlag3 |
(config-if)#exit | Return to privilege mode |
(config-if)#interface sa1 | Enter sa interface mode |
(config-if)#port-channel min-links 3 | Configure min-link value on sa interface |
(config)#interface sa3 | Enter sa Interface mode |
(config-if)#port-channel min-bandwidth 30g | Configure min-bandwidth value on sa interface. |
(config-if)#commit | Commit the candidate configuration to the running Configuration. |
(config-if)#exit | Exit interface mode. |
SW1
#configure terminal | Enter Configure mode. |
(config)#bridge 1 protocol rstp vlan-bridge | Configure bridge type |
(config)#vlan database | Create vlan database |
(config-vlan)#vlan 600,601,502,101,100,300,401,402 bridge 1 state enable | Create Vlans |
(config-vlan)#exit | Exit vlan configuration mode. |
(config)#interface xe1 | Enter Interface mode |
(config-if)# switchport | Make xe1 as layer2 port |
(config-if)# bridge-group 1 | Associate the interface with bridge group 1. |
(config-if)# switchport mode trunk | Set the switching characteristics of this interface to trunk mode. |
(config-if)# switchport trunk allowed vlan all | Enable all VLAN identifiers on this interface. |
(config-if)#spanning-tree edgeport | Configure port as edgeport |
(config-if)#spanning-tree bpdu-filter enable | Enable spanning tree bpdu filter |
(config-if)# mtu 9216 | Configure mtu |
(config-if)#exit | Return to privilege mode |
(config)#interface sa1 | Enter Interface mode |
(config-if)# switchport | Make xe1 as layer2 port |
(config-if)# bridge-group 1 | Associate the interface with bridge group 1. |
(config-if)# switchport mode trunk | Set the switching characteristics of this interface to trunk mode. |
(config-if)# switchport trunk allowed vlan add 100,101,300,401,402,502 | Enable all VLAN identifiers on this interface. |
(config-if)# port-channel load-balance src-dst-mac | Enable load balance |
(config-if)#spanning-tree edgeport | Configure port as edgeport |
(config-if)#spanning-tree bpdu-filter enable | Enable spanning tree bpdu filter |
(config-if)# mtu 9216 | Configure mtu |
(config-if)#exit | Return to privilege mode |
(config)#interface xe2 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa1 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe3 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa1 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe4 | Enter Interface mode |
(config-if)#static-channel-group 1 | Add interface to sa1 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe6 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe7 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe8 | Enter Interface mode |
(config-if)# static-channel-group 1 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#commit | Commit the candidate configuration to the running Configuration. |
SW2
(config)#bridge 1 protocol rstp vlan-bridge | Configure bridge type |
(config)#vlan database | Create vlan database |
(config-vlan)#vlan 600,601,502,101,100, 300,401,402 bridge 1 state enable | Create vlans |
(config-vlan)#exit | Exit vlan configuration mode |
(config)#interface xe5/1 | Enter Interface mode |
(config-if)# switchport | Make xe1 as layer2 port |
(config-if)# bridge-group 1 | Associate the interface with bridge group 1. |
(config-if)# switchport mode trunk | Set the switching characteristics of this interface to trunk mode. |
(config-if)# switchport trunk allowed vlan all | Enable all VLAN identifiers on this interface. |
(config-if)#spanning-tree edgeport | Configure port as edge port |
(config-if)#spanning-tree bpdu-filter enable | Enable spanning tree bpdu filter |
(config-if)# mtu 9216 | Configure mtu |
(config-if)#exit | Return to privilege mode |
(config)#interface sa3 | Enter Interface mode |
(config-if)# switchport | Make xe1 as layer2 port |
(config-if)# bridge-group 1 | Associate the interface with bridge group 1. |
(config-if)# switchport mode trunk | Set the switching characteristics of this interface to trunk mode. |
(config-if)# switchport trunk allowed vlan add 100,101,401,402,600,502 | Enable all VLAN identifiers on this interface. |
(config-if)# port-channel load-balance src-dst-mac | Enable load balance |
(config-if)#spanning-tree edgeport | Configure port as edge port |
(config-if)#spanning-tree bpdu-filter enable | Enable spanning tree bpdu filter |
(config-if)# mtu 9216 | Configure mtu |
(config-if)#exit | Return to privilege mode |
(config)#interface xe3/1 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe3/2 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe3/3 | Enter Interface mode |
(config-if)#static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe1/1 | Enter Interface mode |
(config-if)#static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe1/2 | Enter Interface mode |
(config-if)# static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Return to privilege mode |
(config)#interface xe1/3 | Enter Interface mode |
(config-if)#static-channel-group 3 | Add interface to sa3 |
(config-if)#exit | Exit interface mode. |
(config)#commit | Commit the candidate configuration to the running Configuration. |
This configuration is applicable for the dynamic LAG with MLAG topology except dynamic LAG interface creations, which needs to be referred from the dynamic LAG configurations given above.
Validation Commands
sh int brief sa [id], sh int brief po [id], sh mlag-domain summary, sh static-channel-group <sa id>, <sh etherchannel>, sh running-config interface sa [id], <sh etherchannel summary>.
When sa or po goes down due to min-link or min-bandwidth not satisfied, below validations to be done:
TOR
====
#show int brief sa1
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
sa1 AGG 1 trunk down PD(Min L/B) 0
#
#sh int brief po100
Codes: ETH - Ethernet, LB - Loopback, AGG - Aggregate, MLAG - MLAG Aggregate
FR - Frame Relay, TUN -Tunnel, PBB - PBB Logical Port, VP - Virtual Port
CVP - Channelised Virtual Port, METH - Management Ethernet, UNK- Unknown
ED - ErrDisabled, PD - Protocol Down, AD - Admin Down,
IA - InActive
PD(Min L/B) - Protocol Down Min-Links/Bandwidth
DV - DDM Violation, NA - Not Applicable
NOM - No operational members, PVID - Port Vlan-id
Ctl - Control Port (Br-Breakout/Bu-Bundle)
HD - ESI Hold Timer Down
--------------------------------------------------------------------------------
Port-channel Type PVID Mode Status Reason Speed
Interface
--------------------------------------------------------------------------------
po100 AGG 1 trunk down PD(Min L/B) 0
#
#sh etherchannel
% Lacp Aggregator: po100
% Min-Bandwidth : 40g
% Protocol Down (Min L/B) : True
% Member:
ce3/1
ce3/2
ce3/3
ce3/4
------------------------------------
% Lacp Aggregator: sa1
% Min-links : 3
% Protocol Down (Min L/B): True
% Member:
ce2/2
ce2/3
ce2/4
------------------------------------
% Lacp Aggregator: sa3
% Member:
ce4/1
ce4/2
ce4/3
#
#show running-config interface sa1
!
interface sa1
switchport
port-channel min-links 3
mlag 1
!
#show static-channel-group 1
Static Aggregator: sa1
Minimum-Links 3
Member Status
ce2/2 down
ce2/3 down
ce2/4 down
#
#show etherchannel summary
Aggregator po100 100100
Aggregator Type: Layer2
Admin Key: 0100 - Oper Key 0100
Link: ce3/1 (5057) sync: 0
Link: ce3/2 (5058) sync: 0
Link: ce3/3 (5059) sync: 0
Link: ce3/4 (5060) sync: 0
--------------------------------------
LACP Force-Up
In an aggregated environment, there are some parameters that are set for member ports in lag. Whenever the parameters are set and conditions are satisfied, the port channel will be in SYNC. If force-up mode is enabled for the member port, the port channel will always be in SYNC even if the parameters are not set i.e. the traffic will not be affected and the port channel will never go down.
LACP force-up with Dynamic LAG
Topology
LACP force-up with Dynamic LAG
PE1
#configure terminal | Enter configure mode. |
(config)#hostname PE1 | Configure host name |
(config)#bridge 1 protocol rstp vlan-bridge | Create a RSTP VLAN bridge on customer side |
(config)#vlan database | Enter vlan database. |
(config-vlan)#vlan 2-100 bridge 1 state enable | Configure VLAN for the bridge |
(config-vlan)#exit | Exit vlan configuration mode. |
(config)#interface ge46 | Enter interface mode |
(config-if)#switchport | Make interface as Switchport |
(config-if)#bridge-group 1 | Associate the interface to bridge |
(config-if)#switchport mode hybrid | Configure the mode as hybrid |
(config-if)#switchport hybrid allowed vlan all | Configure allowed VLAN all on the interface |
(config-if)#load-interval 30 | Configure load period in multiple of 30 seconds |
(config-if)#exit | Exit interface mode. |
(config)#interface po1 | Enter the interface mode |
(config-if)#switchport | Make the interface as switch port |
(config-if)#bridge-group 1 | Associate the interface to bridge |
(config-if)#switchport mode hybrid | Configure the mode as hybrid |
(config-if)#switchport hybrid allowed vlan all | Configure allowed vlan all for the hybrid mode |
(config-if)#load-interval 30 | Configure load period in multiple of 30 seconds |
(config-if)#exit | Exit interface mode. |
(config)#interface ge44 | Enter interface mode |
(config-if)#channel-group 1 mode active | Adding interface to channel-group 1 |
(config-if)#exit | Exit interface mode. |
(config)#interface ge45 | Enter interface mode |
(config-if)#channel-group 1 mode active | Adding interface to channel-group 1 |
(config-if)#commit | Commit the candidate configuration to the running Configuration. |
(config-if)#exit | Exit interface mode. |
PE2
#configure terminal | Enter configure mode. |
(config)#hostname PE2 | Configure host name |
(config)#bridge 1 protocol provider-rstp edge | Create provider rstp edge bridge |
(config)#vlan database | Enter vlan database mode |
(config-vlan)#vlan 2-100 type customer bridge 1 state enable | Configure customer VLAN for the bridge |
(config-vlan)#vlan 100 type service point-point bridge 1 state enable | Configure service VLAN for the bridge |
(config)#exit | Exit vlan database mode |
(config)#cvlan registration table map1 bridge 1 | Creating registration table |
(config-cvlan-registration)#cvlan 2-100 svlan 100 | Mapping cvlan to svlan |
(config-cvlan-registration)#exit | Exit cvlan registration mode. |
(config)#commit | Commit the candidate configuration to the running Configuration. |
(config)#interface ge43 | Enter interface mode |
(config-if)#switchport | Make interface as Switchport |
(config-if)#bridge-group 1 | Associate the interface to bridge |
(config-if)#switchport mode provider-network | Configure the mode as provider-network |
(config-if)# switchport provider-network allowed vlan all | Configure allowed VLAN all on the interface |
(config-if)#load-interval 30 | Configure load period in multiple of 30 seconds |
(config-if)#exit | Exit interface mode. |
(config)#interface po1 | Enter the interface mode |
(config-if)#switchport | Make the interface as switch port |
(config-if)#bridge-group 1 | Associate the interface with bridge group 1 |
(config-if)#switchport mode customer-edge hybrid | Set the switching characteristics of this interface to customer-edge hybrid |
(config-if)#switchport customer-edge hybrid allowed vlan all | Set the switching characteristics of this interface to customer-edge hybrid and allow vlan all |
(config-if)#switchport customer-edge vlan registration map1 | Configuring the registration table mapping on lag interface |
(config-if)#load-interval 30 | Configure load period in multiple of 30 seconds |
(config-if)#exit | Exit interface mode. |
(config)#interface ge44 | Enter interface mode |
(config-if)#channel-group 1 mode active | Adding interface to channel-group 1 |
(config-if)#lacp force-up | Enable lacp force-up for the member port interface |
(config-if)#exit | Exit interface mode. |
(config)#interface ge45 | Enter interface mode |
(config-if)#channel-group 1 mode active | Adding interface to channel-group 1 |
(config-if)#commit | Commit the candidate configuration to the running Configuration. |
(config-if)#exit | Exit interface mode. |
Send L2 traffic with incremental source mac of 1000 and with VLAN 100 from CE1 and with incremental source mac of 1000 and with SVLAN 100(TPID 0x88a8), CVLAN 100 from CE2.
Validation
PE1
CE1#show mac address-table count bridge 1
MAC Entries for all vlans:
Dynamic Address Count: 2001
Static (User-defined) Unicast MAC Address Count: 0
Static (User-defined) Multicast MAC Address Count: 0
Total MAC Addresses in Use: 2001
CE1#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 0001 - Oper Key 0001
Link: ge44 (5043) sync: 1
Link: ge45 (5046) sync: 1
CE1#show interface counters rate mbps
+-------------------+--------------+-------------+--------------+-------------+
| Interface | Rx mbps | Rx pps | Tx mbps | Tx pps |
+-------------------+--------------+-------------+--------------+-------------+
ge44 363.65 710252 772.76 1420506
ge45 363.63 710222 0.00 0
ge46 772.77 1420525 727.31 1420526
po1 728.56 1422971 774.09 1422966
CE2#show mac address-table count bridge 1
MAC Entries for all vlans:
Dynamic Address Count: 2001
Static (User-defined) Unicast MAC Address Count: 0
Static (User-defined) Multicast MAC Address Count: 0
Total MAC Addresses in Use: 2001
CE2#show interface counters rate mbps
+-------------------+--------------+-------------+--------------+-------------+
| Interface | Rx mbps | Rx pps | Tx mbps | Tx pps |
+-------------------+--------------+-------------+--------------+-------------+
ge43 774.26 1423267 784.17 1361411
ge44 774.26 1423268 364.36 711634
ge45 0.00 0 364.36 711634
po1 774.26 1423267 728.71 1423267
CE2#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 0001 - Oper Key 0001
Link: ge44 (5020) sync: 1
Link: ge45 (5022) sync: 1
On server side (PE1) to make LAG down you can unconfigure the channel-group 1 configurations and verify force-up is getting enabled in PE2.
To simulate the force-up
PE1(config)#interface ge44 | Enter interface mode. |
PE1(config-if)#no channel-group | Removing channel-group configurations from interface. |
PE1(config-if)#exit | Exit interface mode. |
PE1(config)#interface ge45 | Enter interface mode. |
PE1(config-if)#no channel-group | Removing channel-group configurations from interface. |
PE1(config-if)#exit | Exit interface mode. |
PE1(config)#commit | Commit the candidate configuration to the running Configuration. |
PE2
PE2#show interface brief | include po1
po1 AGG 1 customer-edge up none 1g
PE2#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 0001 - Oper Key 0001
Link: ge44 (5020) sync: 0 (force-up)
Link: ge45 (5022) sync: 0
PE2#show etherchannel detail
Aggregator po1 100001
Aggregator Type: Layer2
Mac address: b8:6a:97:4d:65:d5
Admin Key: 0001 - Oper Key 0001
Actor LAG ID- 0x8000,b8-6a-97-28-a5-c0,0x0001
Receive link count: 0 - Transmit link count: 0
Individual: 0 - Ready: 1
Partner LAG ID- 0x0000,00-00-00-00-00-00,0x0000
Link: ge44 (5020) sync: 0 (force-up)
Link: ge45 (5022) sync: 0
Collector max delay: 5
To forward traffic from ge44 of PE1
PE1(config)#interface ge44 | Enter interface mode. |
PE1(config-if)#switchport | Make the interface as switch port. |
PE1(config-if)#bridge-group 1 | Associate the interface to bridge. |
PE1(config-if)#switchport mode hybrid | Configure the mode as hybrid. |
PE1(config-if)#switchport hybrid allowed vlan all | Configure allowed vlan all for the hybrid mode. |
PE1(config-if)#load-interval 30 | Configure load period in multiple of 30 seconds. |
PE1(config-if)#exit | Exit interface mode. |
PE1(config)#commit | Commit the candidate configuration to the running Configuration. |
PE2#show interface counters rate mbps
+-------------------+--------------+-------------+--------------+-------------+
| Interface | Rx mbps | Rx pps | Tx mbps | Tx pps |
+-------------------+--------------+-------------+--------------+-------------+
ge43 774.25 1423257 784.17 1361400
ge44 774.25 1423258 728.71 1423257
ge45 0.00 0 0.00 0
po1 774.25 1423247 728.70 1423245
CE2#
PE1#show interface counters rate mbps
+-------------------+--------------+-------------+--------------+-------------+
| Interface | Rx mbps | Rx pps | Tx mbps | Tx pps |
+-------------------+--------------+-------------+--------------+-------------+
ge44 657.67 1284505 640.77 1177884
ge45 0.00 0 0.00 0
ge46 772.71 1420426 603.08 1177886
LACP force-up with McLAG
Topology
LACP force-up with McLAG
TOR1
(config)#bridge 1 protocol provider-rstp edge | Create provider rstp bridge. |
(config)#vlan database | Enter vlan database mode |
(config-vlan)#vlan 2-10 type customer bridge 1 state enable | Enabling customer vlan for bridge |
(config-vlan)#vlan 2-10 type service point-point bridge 1 state enable | Enabling service vlan for bridge |
(config-vlan)#exit | Exit vlan configuration mode. |
(config)#cvlan registration table map1 bridge 1 | Creating registration table |
(config-cvlan-registration)#cvlan 2 svlan 2 | Mapping cvlan to svlan |
(config-cvlan-registration)#cvlan 10 svlan 2 | Mapping cvlan to svlan |
(config-cvlan-registration)#exit | Exit cvlan registration mode. |
(config)#commit | Commit the candidate configuration to the running configuration. |
(config)#interface xe49/1 | Entering interface mode |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#exit | Exit interface mode. |
(config)#interface mlag1 | Entering mlag interface |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#bridge-group 1 spanning-tree disable | Associate the interface with bridge group 1and disabling spanning-tree |
(config-if)#switchport mode customer-edge hybrid | Set the switching characteristics of this interface to customer-edge hybrid |
(config-if)#switchport customer-edge hybrid vlan 2 | Set the switching characteristics of this interface to customer-edge hybrid and allow vlan 2 |
(config-if)#switchport customer-edge hybrid allowed vlan all | Set the switching characteristics of this interface to customer-edge hybrid and allow vlan all |
(config-if)#switchport customer-edge vlan registration map1 | Configuring the registration table mapping on mlag interface |
(config-if)#exit | Exit interface mode. |
(config)#interface po1 | Entering dynamic lag interface |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#mlag 1 | Enabling mlag group number |
(config-if)#exit | Exit interface mode. |
(config)#interface ge1 | Entering interface mode |
(config-if)#lacp force-up | Enable lacp force-up for the member port interface |
(config-if)#channel-group 1 mode active | Add this interface to channel group 1 |
(config-if)#exit | Exit the interface mode |
(config)#mcec domain configuration | Entering MCEC mode |
(config-mcec-domain)#domain-address 2222.2222.2222 | Domain address for the mlag domain |
(config-mcec-domain)#domain-system-number 1 | Number to identify the node in a domain |
(config-mcec-domain)#intra-domain-link xe49/1 | Intra domain line between mlag domain |
(config-mcec-domain)#exit | Exit mcec domain mode. |
(config)#commit | Commit the candidate configuration to the running configuration. |
TOR2
(config)#bridge 1 protocol provider-rstp edge | Create provider rstp bridge. |
(config)#vlan database | Enter vlan database mode |
(config-vlan)#vlan 2-10 type customer bridge 1 state enable | Enabling customer vlan for bridge |
(config-vlan)#vlan 2-10 type service point-point bridge 1 state enable | Enabling service vlan for bridge |
(config-vlan)#exit | Exit vlan database mode. |
(config)#cvlan registration table map1 bridge 1 | Creating registration table |
(config-cvlan-registration)#cvlan 2 svlan 2 | Mapping cvlan to svlan |
(config-cvlan-registration)#cvlan 10 svlan 2 | Mapping cvlan to svlan |
(config-cvlan-registration)#exit | Exit cvlan registration mode. |
(config)#commit | Commit the candidate configuration to the running configuration. |
(config)#interface xe49/1 | Entering interface mode |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#exit | Exit interface mode. |
(config)#interface mlag1 | Entering mlag interface |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#bridge-group 1 spanning-tree disable | Associate the interface with bridge group 1and disabling spanning-tree |
(config-if)#switchport mode customer-edge hybrid | Set the switching characteristics of this interface to customer-edge hybrid |
(config-if)#switchport customer-edge hybrid vlan 2 | Set the switching characteristics of this interface to customer-edge hybrid and allow vlan 2 |
(config-if)#switchport customer-edge hybrid allowed vlan all | Set the switching characteristics of this interface to customer-edge hybrid and allow vlan all |
(config-if)#switchport customer-edge vlan registration map1 | Configuring the registration table mapping on mlag interface |
(config-if)#exit | Exit interface mode. |
(config)#interface po1 | Entering dynamic lag interface |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#mlag 1 | Enabling mlag group number |
(config-if)#exit | Exit interface mode. |
(config)#interface ge21 | Entering interface mode |
(config-if)#lacp force-up | Enable lacp force-up for the member port interface |
(config-if)#channel-group 1 mode active | Add this interface to channel group 1 |
(config-if)#exit | Exit the interface mode |
(config)#mcec domain configuration | Entering MCEC mode |
(config-mcec-domain)#domain-address 2222.2222.2222 | Domain address for the mlag domain |
(config-mcec-domain)#domain-system-number 2 | Number to identify the node in a domain |
(config-mcec-domain)#intra-domain-link xe49/1 | Intra domain line between mlag domain |
(config-mcec-domain)#exit | Exit mcec domain mode. |
(config)#commit | Commit the candidate configuration to the running configuration. |
SW1
(config)#config t | Enter configure terminal. |
(config)#bridge 1 protocol rstp vlan-bridge | Configuring the rstp vlan bridge |
(config)#vlan database | Enter vlan database mode. |
(config-vlan)#vlan 2-10 bridge 1 state enable | Configure customer vlan. |
(config-vlan)#exit | Exit vlan configuration mode. |
(config)#interface po1 | Entering interface mode |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#bridge-group 1 spanning-tree disable | Associate the interface with bridge group 1 and disabling spanning-tree |
(config-if)#switchport mode access | Configure switchport mode as access |
(config-if)#switchport access vlan 2,10 | Configure access vlan 2,10 |
(config-if)#exit | Exit interface mode. |
(config)#interface ge1 | Entering interface mode |
(config-if)#channel-group 1 mode active | Add this interface to channel group 1 . |
(config-if)#exit | Exit interface mode. |
(config)#interface ge21 | Entering interface mode |
(config-if)#channel-group 1 mode active | Add this interface to channel group 1. |
(config-if)#exit | Exit interface mode. |
(config-if)#interface ge46 | Entering interface mode |
(config-if)#switchport | Configuring interface as switchport |
(config-if)#bridge-group 1 spanning-tree disable | Associate the interface with bridge group 1and disabling spanning-tree |
(config-if)#switchport mode hybrid | Set the switching characteristics of this interface to hybrid |
(config-if)#switchport hybrid allowed vlan all | Set the switching characteristics of this interface to hybrid and allow vlan all |
(config-if)#exit | Exit interface mode. |
(config)#commit | Commit the candidate configuration to the running configuration. |
Validation
TOR1#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 32769 - Oper Key 16385
Link: ge1 (5026) sync: 1
TOR2#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 16385 - Oper Key 16385
Link: ge21 (5046) sync: 1
SW1#show etherchannel summary
Aggregator po2 100002
Aggregator Type: Layer2
Admin Key: 0002 - Oper Key 0002
Link: ge2 (5001) sync: 1
Link: ge22 (5021) sync: 1
TOR1#show mlag domain summary
------------------------------------
Domain Configuration
------------------------------------
Domain System Number : 2
Domain Address : 1111.2222.3333
Domain Priority : 32768
Intra Domain Interface : po99
Domain Adjacency : UP
------------------------------------
MLAG Configuration
------------------------------------
MLAG-1
Mapped Aggregator : po1
Physical properties Digest : 1 ef 71 4b 7f 37 5b 6a a5 8c e1 2f 95 9a fe cf
Total Bandwidth : 2g
Mlag Sync : IN_SYNC
Mode : Active-Active
Current Mlag state : Active
TOR2#show mlag domain summary
------------------------------------
Domain Configuration
------------------------------------
Domain System Number : 1
Domain Address : 1111.2222.3333
Domain Priority : 32768
Intra Domain Interface : po99
Domain Adjacency : UP
------------------------------------
MLAG Configuration
------------------------------------
MLAG-1
Mapped Aggregator : po1
Physical properties Digest : 1 ef 71 4b 7f 37 5b 6a a5 8c e1 2f 95 9a fe cf
Total Bandwidth : 2g
Mode : Active-Active
Current Mlag state : Activ
TOR1#show mac address-table count bridge 1 interface mlag1
MAC Entries for all vlans:
Dynamic Address Count: 1001
Static (User-defined) Unicast MAC Address Count: 0
Static (User-defined) Multicast MAC Address Count: 0
Total MAC Addresses in Use: 1001
TOR1#show mac address-table l count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 500
TOR1#show mac address-table r count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 501
TOR2#show mac address-table count bridge 1 interface mlag1
MAC Entries for all vlans:
Dynamic Address Count: 1001
Static (User-defined) Unicast MAC Address Count: 0
Static (User-defined) Multicast MAC Address Count: 0
Total MAC Addresses in Use: 1001
TOR2#show mac address-table l count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 501
TOR2#show mac address-table r count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 500
Note: For MLAG case, admin should configure 'force-up' port either on master node or slave node only.
Example: In a static trunk environment, Preboot eXecution Environment (PXE) images are too small for most operating systems to leverage LACP during the boot process. As a result, during a PXE build process, traffic sent by the server is dropped, and the build process can fail.
To correct this situation, a port on an ICX 7750 device connected to a server that is configured as an MCT client can be set to a “force-up” state so that even if the LACPDU is not received from the server, the connected port is up and forwards packets.
To simulate this scenario we can remove channel-group configurations from the server side switch SW1 and check LACP force-up is getting enabled on TOR1:
SW1(config)#interface ge1 | Enter interface mode. |
SW1(config-if)#no channel-group | Removing channel-group configurations from interface. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#interface ge21 | Enter interface mode. |
SW1(config-if)#no channel-group | Removing channel-group configurations from interface. |
SW1(config-if)#exit | Exit interface mode. |
SW1(config)#commit | Commit the candidate configuration to the running Configuration. |
TOR1#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 32769 - Oper Key 16385
Link: ge1 (5026) sync: 0 (force-up)
TOR2#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 16385 - Oper Key 16385
Link: ge21 (5046) sync: 0
TOR1#show mlag domain summary
------------------------------------
Domain Configuration
------------------------------------
Domain System Number : 2
Domain Address : 1111.2222.3333
Domain Priority : 32768
Intra Domain Interface : po99
Domain Adjacency : UP
------------------------------------
MLAG Configuration
------------------------------------
MLAG-1
Mapped Aggregator : po1
Physical properties Digest : 1 ef 71 4b 7f 37 5b 6a a5 8c e1 2f 95 9a fe cf
Total Bandwidth : 1g
Mlag Sync : IN_SYNC
Mode : Active-Active
Current Mlag state : Active
TOR2#show mlag domain summary
------------------------------------
Domain Configuration
------------------------------------
Domain System Number : 1
Domain Address : 1111.2222.3333
Domain Priority : 32768
Intra Domain Interface : po99
Domain Adjacency : UP
------------------------------------
MLAG Configuration
------------------------------------
MLAG-1
Mapped Aggregator : po1
Physical properties Digest : 1 ef 71 4b 7f 37 5b 6a a5 8c e1 2f 95 9a fe cf
Total Bandwidth : 1g
Mlag Sync : IN_SYNC
Mode : Active-Active
Current Mlag state : Active
To forward traffic from ge1 of SW2:
SW1(config)#interface ge1 | Enter interface mode. |
SW1(config-if)#switchport | Make the interface as switch port. |
SW1(config-if)#bridge-group 1 spanning-tree disable | Associate the interface to bridge. |
SW1(config-if)#switchport mode access | Configure the mode as access. |
SW1(config-if)#switchport access vlan 4001 | Configure allowed vlan 4001 for the access mode. |
SW1(config-if)#load-interval 30 | Configure load period in multiple of 30 seconds. |
SW1(config-if)#commit | Commit the candidate configuration to the running configuration. |
SW1(config-if)#exit | Exit interface mode. |
TOR1#show mac address-table count bridge 1 interface mlag1
MAC Entries for all vlans:
Dynamic Address Count: 999
Static (User-defined) Unicast MAC Address Count: 0
Static (User-defined) Multicast MAC Address Count: 0
Total MAC Addresses in Use: 999
TOR1#show mac address-table l count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 999
TOR1#show mac address-table r count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 0
TOR2#show mac address-table count bridge 1 interface mlag1
MAC Entries for all vlans:
Dynamic Address Count: 0
Static (User-defined) Unicast MAC Address Count: 0
Static (User-defined) Multicast MAC Address Count: 0
Total MAC Addresses in Use: 0
TOR2#show mac address-table l count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 0
TOR2#show mac address-table r count bridge 1 interface mlag1
MAC Entries for all vlans:
Total MAC Addresses in Use: 0
TOR1#show etherchannel summary
Aggregator po1 100001
Aggregator Type: Layer2
Admin Key: 32769 - Oper Key 16385
Link: ge1 (5026) sync: 0 (force-up)
TOR1#show etherchannel detail
Aggregator po1 100001
Aggregator Type: Layer2
Mac address: 14:02:ec:1c:31:5b
Admin Key: 32769 - Oper Key 16385
Actor LAG ID- 0x8000,11-11-22-22-33-33,0x4001
Receive link count: 0 - Transmit link count: 0
Individual: 0 - Ready: 1
Partner LAG ID- 0x0000,00-00-00-00-00-00,0x0000
Link: ge1 (5026) sync: 0 (force-up)
Collector max delay: 5
SW1#show interface counters rate mbps
+-------------------+--------------+-------------+--------------+-------------+
| Interface | Rx mbps | Rx pps | Tx mbps | Tx pps |
+-------------------+--------------+-------------+--------------+-------------+
ge1 0.00 0 726.53 1418994
ge46 772.68 1420362 0.00 0
TOR1#show interface counters rate mbps
+-------------------+--------------+-------------+--------------+-------------+
| Interface | Rx mbps | Rx pps | Tx mbps | Tx pps |
+-------------------+--------------+-------------+--------------+-------------+
ge1 729.42 1424656 0.00 0
mlag1 729.42 1424655 0.00 0
po1 729.43 1424658 0.00 0