IP Library › Granted Patent US 9,276,815
Granted Patent B2
US 9,276,815 · App. 14/142,296 · Granted Mar 1, 2016

N-node virtual link trunking (VLT) systems management plane

Inventors: Mohnish Anumala (Cupertino, CA); Jeyasubramanian Irungola Pillai (Chennai, IN); George Azzi (Palo Alto, CA)
Assignee: DELL PRODUCTS L.P.
H04L41/083H04L41/12H04L45/245
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,276,815
App. No.
14/142,296
Filed
Dec 27, 2013
Granted
Mar 1, 2016
Kind
B2
Examiner
ZHAO, WEI
Art Unit
2475
USPC
370/254
Abstract

Aspects of the present invention include an N-Node virtual link trunking (VLT) system comprising a set of N nodes collectively provide a logical fabric-level view that is consistent across the set of N nodes. Embodiments of the N-Node VLT system comprise a control plane mechanism to provide Layer 2 multipathing between access network devices (switches or servers) and the core network. The N-Node VLT system provides a loop-free topology with active-active load-sharing of uplinks from access to the core. Accordingly, the N-Node VLT system eliminates the disadvantage of Spanning Tree Protocol (STP) (active-standby links) by allowing link aggregation group (LAG) terminations on multiple separate distribution or core switches and also supporting a loop-free topology. Additional benefits of an N-Node VLT system include, but are not limited to, higher resiliency, improved link utilization, and improved manageability of the network.

Claims (48)

1. A management plane system for configuring one or more settings to form an n-node virtual link trunking (VLT) system comprising a plurality of nodes communicatively coupled via inter-node port links (INLs) and at least some of the plurality of nodes of the n-node VLT system being communicatively coupled via one or more input/output (I/O) ports to at least one client device to form a VLT link aggregation group (LAG), the management plane system comprising:

a management client operating on a first computing system that provides a centralized interface to a user to configure one or more fabric-level settings for the n-node VLT system to provide consistency of fabric-level settings while allowing individualized configuration of node-level settings for nodes in the n-node VLT system;

a fabric master operating on a node in the n-node VLT system that is communicatively coupled to the management client and communicatively coupled to the other nodes in the n-node VLT system and that, responsive to receiving a fabric-level configuration transaction from the management client, transforms the fabric-level configuration transaction into one or more configuration requests; and

a fabric standby operating on at least one of the other nodes in the n-node VLT system that is communicatively coupled to the fabric master.

2. The system of claim 1 wherein the fabric-level configuration transaction comprises affecting configuration of at least one or more VLT fabric entities, the VLT fabric entities comprising:

a domain entity, the domain entity having a domain identifier and its configuration parameter comprising a system media access control (MAC) address for the n-node VLT system;

nodes entities comprising, for each node in the n-node VLT system, a node identifier and configuration parameters comprising management port identifier and its IP address, and default route;

port channels entities comprising, for each port channel, a port channel identifier and configuration parameters comprising a list of ports, port channel type (INL or VLT), mode, and listing of virtual local area network or networks to which the port channel participates;

inter-node link (INL) entities comprising, for each INL, an INL identifier and configuration parameters comprising a pair of node identifiers of the nodes that are connected by the INL and corresponding port channel identifier; and

virtual link trunking (VLT) entities comprising, for each VLT, a VLT identifier and configuration parameters comprising a list of ports that participate in the VLT and corresponding port channel identifier.

3. The system of claim 1 wherein the management client provides a single point of management for the n-node VLT system via a virtual Internet Protocol (IP) address.

4. The system of claim 3 wherein, responsive to the node with fabric master failing, the fabric standby of one of the other nodes is elevated to the role of fabric master.

5. The system of claim 4 wherein an election mechanism operating on one or more of the fabric standbys selects a node in the n-node VLT system to become the fabric master.

6. The system of claim 1 wherein the fabric manager synchronizes a set of changes to the n-node VLT system to one or more databases of the fabric standbys.

7. The system of claim 6 wherein the fabric manager uses transaction-based configuration with commit/rollback capability across all the nodes in the n-node VLT system.

8. The system of claim 1 wherein two or more nodes in the n-node system act as fabric master and synchronize fabric-level changes across the nodes of the n-node VLT system.

9. A network node device comprising:

a plurality of input/output (I/O) ports, at least a portion of which facilitate communications with one or more client devices and configurable to participate in one or more virtual link trunkings (VLT), each of the one or more VLTs including the network node device and at least one of the one or more client devices;

a plurality of inter-node-link (INL) ports, at least a portion of which facilitate communications with one or more of network node devices in an n-node virtual link trunking (VLT) system, which comprises the network node device and a plurality of network node devices;

a data processing component that processes data packets, and receives data from and sends data to at least some of the plurality of I/O ports and at least some of the plurality of inter-node-link ports;

a fabric master that is communicatively coupled to a management client and communicatively coupled to the other network nodes in the n-node VLT system and that, responsive to receiving a fabric-level configuration transaction from the management client, transforms the fabric-level configuration transaction into one or more configuration requests for applicable network nodes in the n-node VLT system; and

at least one fabric-level logical-components database that stores information with respect to the n-node VLT system such that each of the one or more VLTs that includes the network node device and at least one of the one or more peer network node devices of the n-node VLT system is identified in the at least one fabric-level logical-components database with a VLT identifier that is common to the network node device and the at least one of the one or more peer network node devices but that is unique to that VLT.

10. The network node device of claim 9 wherein the plurality of INL ports are configured such that the network node device is in a full mesh topology with the plurality of peer network node devices of the n-node VLT system.

11. The network node of claim 9 wherein the fabric-level configuration transaction comprises affecting configuration of at least one or more VLT fabric entities, the VLT fabric entities comprising:

a domain entity, the domain entity having a domain identifier and its configuration parameter comprising a system media access control (MAC) address for the n-node VLT system;

nodes entities comprising, for each network node in the n-node VLT system, a node identifier and configuration parameters comprising management port identifier and its IP address, and default route;

port channels entities comprising, for each port channel, a port channel identifier and configuration parameters comprising a list of ports, port channel type (INL or VLT), mode, and listing of virtual local area network or networks to which the port channel participates;

inter-node link (INL) entities comprising, for each INL, an INL identifier and configuration parameters comprising a pair of network node identifiers of the network nodes that are connected by the INL and corresponding port channel identifier; and

virtual link trunking (VLT) entities comprising, for each VLT, a VLT identifier and configuration parameters comprising a list of ports that participate in the VLT and corresponding port channel identifier.

12. The network node device of claim 9 wherein the fabric manager communicates the one or more configuration requests to application programming interfaces of the network nodes in the n-node VLT system.

13. The network node device of claim 9 wherein a fabric standby operates on at least one of the other network nodes in the n-node VLT system that is communicatively coupled to the fabric master.

14. The network node device of claim 9 wherein the fabric manager is accessed by the management client via a virtual Internet Protocol (IP) address.

15. The network node device of claim 13 wherein the fabric standby comprises a fabric-level logical-components database and the fabric manager synchronize a set of changes to the n-node VLT system to databases of the fabric standby.

16. The network node device of claim 15 wherein the fabric manager uses transaction-based configuration with commit/rollback capability across all the network nodes in the n-node VLT system.

17. A method for managing fabric-level entities of a n-node virtual link trunking (VLT) system that comprises a plurality of nodes communicatively coupled via inter-node port links (INLs) and at least some of the plurality of nodes of the n-node VLT system being communicatively coupled via one or more input/output (I/O) ports to one or more client devices to form one or more VLTs, the method comprising:

presenting to a user via a management interface operating on a first computing device a centralized interface to configure one or more fabric-level settings for the n-node VLT system, the management interface communicatively coupled to a fabric master operating on a first node in the n-node VLT system that is communicatively coupled to the other nodes in the n-node VLT system; and

responsive to sending a fabric-level configuration transaction from the management client to the fabric master, transforming the fabric-level configuration transaction into one or more configuration requests for applicable nodes in the n-node VLT system; and

communicating the one or more configuration requests from the fabric master to the applicable nodes in the n-node VLT system.

18. The method of claim 17 wherein the fabric-level configuration transaction comprises affecting configuration of at least one or more VLT fabric entities, the VLT fabric entities comprising:

a domain entity, the domain entity having a domain identifier and its configuration parameter comprising a system media access control (MAC) address for the n-node VLT system;

node entities comprising, for each node in the n-node VLT system, a node identifier and configuration parameters comprising management port identifier and its IP address, and default route;

port channels entities comprising, for each port channel, a port channel identifier and configuration parameters comprising a list of ports, port channel type (INL or VLT), mode, and listing of virtual local area network or networks to which the port channel participates;

inter-node link (INL) entities comprising, for each INL, an INL identifier and configuration parameters comprising a pair of node identifiers of the nodes that are connected by the INL and corresponding port channel identifier; and

virtual link trunking (VLT) entities comprising, for each VLT, a VLT identifier and configuration parameters comprising a list of ports that participate in the VLT and corresponding port channel identifier.

19. The method of claim 17 further comprising:

maintaining a consistent representation of the fabric level of the n-node VLT system by synchronizing fabric-level information across the plurality of nodes of the n-node VLT systems.

20. The method of claim 17 wherein the step of communicating comprises:

using a single distributed transaction to invoke one or more nodes-level application programming interfaces in parallel to propagate the request across the nodes of the n-node VLT system.

Assignments (16)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
RELEASE OF SECURITY INTEREST OF REEL 032809 FRAME 0930 (TL) Recorded Sep 14, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; CREDANT TECHNOLOGIES, INC.; COMPELLENT TECHNOLOGIES, INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
Reel/Frame 040045/0255 →
RELEASE OF REEL 032810 FRAME 0206 (NOTE) Recorded Sep 14, 2016
From: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; CREDANT TECHNOLOGIES, INC.; COMPELLENT TECHNOLOGIES, INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
Reel/Frame 040027/0204 →
RELEASE OF REEL 032809 FRAME 0887 (ABL) Recorded Sep 13, 2016
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; CREDANT TECHNOLOGIES, INC.; COMPELLENT TECHNOLOGIES, INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
Reel/Frame 040017/0314 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (NOTES) Recorded May 1, 2014
From: COMPELLENT TECHNOLOGIES, INC.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 032810/0206 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (ABL) Recorded May 1, 2014
From: COMPELLENT TECHNOLOGIES, INC.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 032809/0887 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (TERM LOAN) Recorded May 1, 2014
From: COMPELLENT TECHNOLOGIES, INC.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 032809/0930 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2014
From: ANUMALA, MOHNISH; PILLAI, JEYASUBRAMANIAN IRUNGOLA; AZZI, GEORGE
To: DELL PRODUCTS, L. P.
Reel/Frame 032581/0324 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2014
From: ANUMALA, MOHNISH; PILLAI, JEYASUBRAMANIAN IRUNGOLA; AZZI, GEORGE
To: DELL PRODUCTS, L. P.
Reel/Frame 031940/0512 →
Continuity (1)
Related Publication 20150188760A1 · Jul 2, 2015