Automatic load balancing in switch fabrics
View Patent ↗A load balancing system and method for network nodes is provided. The load balancing system includes crossbar devices, queues to receive data and a load balancer. The load balancer determines the amount of data in each of the queues and sends data to specific crossbar devices based on the amount of data in each queue. The queues include a high priority queue and a number of non-high priority queues.
1. A load balancing system for network nodes, the load balancing system comprising:
a plurality of crossbar devices;
a plurality of queues configured to receive data; and
a load balancer coupled to the plurality of queues and configured to determine an amount of data in each of the plurality of queues and to send the data to specific ones of the plurality of crossbar devices based on the amount of data in each queue;
wherein the system is configured to place each data of the plurality of data in a specific queue of the plurality of queues based on a priority associated with each data; and
wherein the load balancer is configured to detect availability of additional crossbar devices.
2. The load balancing system of claim 1 wherein the plurality of queues comprises a high priority queue and a plurality of non-high priority queues.
3. The load balancing system of claim 2 wherein the load balancer is configured to send data to specific crossbar devices of the plurality of crossbar devices based on an amount of data in the high priority queue relative to an amount of data in each of the plurality of non-high priority queues.
4. The load balancing system of claim 2 wherein the load balancer is configured to send data to specific crossbar devices in a order that is based on one of the amount of data in the high priority queue and an amount of data in each of the plurality of non-high priority queues.
5. The load balancing system of claim 2 wherein the load balancer is configured to send data to specific crossbar devices of the plurality of crossbar devices based on an amount of data in each of the plurality of non-high priority queues relative to an amount of data in the high priority queue.
6. The load balancing system of claim 2 wherein the load balancer is configured to send data to specific crossbar devices in a order based on one of an amount of data in the high priority queue and an amount of data in each of the plurality of non-high priority queues.
7. The load balancing system of claim 1 further comprising a capacity indicator identifying the amount of data in each queue.
8. The load balancing system of claim 7 wherein the load balancer is configured to determine the amount data in each queue based on examining the capacity indicator and to transmit data to the plurality of crossbar devices in a predetermined order based on the examination of the capacity indicator.
9. The load balancing system of claim 7 wherein the capacity indicator further indicates an occupancy level based on the amount of data in each queue.
10. The load balancing system of claim 9 wherein load balancer is configured to transmit data to the plurality of crossbar devices in a predetermined order based on various occupancy levels of each queue as indicated by the capacity indicator.
11. The load balancing system of claim 10 wherein the occupancy levels are high, medium, low and empty.
12. The load balancing system of claim 1 wherein each of the queues are divided into a plurality of portions having a corresponding portion indicator for each portion of the queues to identify that data are in a corresponding portion of a queue.
13. The load balancing system of claim 12 wherein the portion indicators are modifiable to indicate various occupancy levels in the queue.
14. The load balancing system of claim 12 wherein the load balancer is configured to transmit data from the plurality of queues to the plurality of crossbar devices in a predetermined order based on the portion indicators.
15. The load balancing system of claim 2 wherein each of the queues are divided into a first portion, a second portion and a third portion.
16. The load balancing system of claim 15 wherein the data received are placed first in the first portion, when the first portion is full, the received data are placed in the second portion and, when the second portion is full, the received data are placed the third portion of the queue.
17. The load balancing system of claim 15 wherein the load balancer is configured to determine that data are in the third portion of the queue of the high priority queue and to cause the data in the high priority queue to be transmitted to all the plurality of crossbar devices that are available when data are in the third portion of the queue of the high priority queue.
18. The load balancing system of claim 15 wherein the load balancer is configured to determine that data are only in the first portion of the queue of the high priority queue and to cause the data in the third portion of the non-high priority queues to be transmitted to all the plurality of crossbar devices that are available when data are only in the first portion of the queue of the high priority queue.
19. The load balancing system of claim 15 wherein the load balancer is configured to determine that data are only in the non-high priority queues and to cause the data in the non-high priority queues to be transmitted to all the plurality of crossbar devices that are available when data are only in the non-high priority queues.
20. The load balancing system of claim 15 wherein the load balancer is configured to determine that data are only in the high priority queues and to cause the data in the high priority queues to be transmitted to all the plurality of crossbar devices that are available when data are only in the high priority queues.
21. The load balancing system of claim 15 wherein the load balancer is configured to determine that data are in one of the first and second portions of the queue of the high priority queue and to cause the data in the non-high priority queues to be transmitted to particular predetermined crossbar devices that are available and to cause the data in the high priority queue to be transmitted to remaining crossbar devices from the plurality of crossbar devices that are available.
22. The load balancing system of claim 15 further comprising:
a first indicator identifying that data are in the first portion of a queue;
a second indicator identifying that data are in the second portion of a queue; and
a third indicator identifies that data are in the third portion of a queue.
23. The load balancing system of claim 22 wherein the load balancer is configured to determine that the third indicator identifies that data are in the third portion of the queue of the high priority queue and to cause the data in the non-high priority queues to be transmitted to all the plurality of crossbar devices that are available.
24. The load balancing system of claim 1 wherein the load balancer is configured to detect inoperable crossbar devices.
25. The load balancing system of claim 24 wherein the load balancer is configured to detect inoperable devices by being configured to send a message to the plurality of crossbar devices and to receive a response sent from each of the plurality of crossbar devices that are operating.
26. The load balancing system of claim 24 wherein the load balancer is configured to detect inoperable devices by being configured to send a message to the plurality of crossbar devices and to determine if a response sent from each of the plurality of crossbar devices that are operating is within a predetermined time.
27. The load balancing system of claim 24 wherein the load balancer is configured to detect availability of additional crossbar devices by being configured to attempt to transmit data to the additional crossbar devices.
28. The load balancing system of claim 27 wherein the load balancer is configured to send data to at least one predetermined location and to receive a response sent from each of the additional crossbar devices that are added.
29. The load balancing system of claim 28 wherein the predetermined location is an offset in a shared memory.
30. The load balancing system of claim 27 wherein the load balancer is configured to receive data sent from each of the additional crossbar devices and to update an operational list of available crossbar devices.
31. The load balancing system of claim 1 further comprising a processor coupled to the load balancer.
32. A load balancing method comprising:
receiving a plurality of data;
storing the plurality of data in a plurality of queues;
determining occupancy levels in each of the plurality of queues;
transmitting the data to a plurality of crossbar devices based on the determined occupancy levels in each queue; and
determining the availability of additional crossbar devices;
wherein each data of the plurality of data is placed in a specific queue of the plurality of queues based on a priority associated with each data.
33. The load balancing method of claim 32 wherein the plurality of queues comprises a high priority queue and a plurality of non-high priority queues.
34. The load balancing method of claim 33 further comprising:
dividing each of the queues into a first portion, a second portion and a third portion; and
determining if data are in the first, second and third portions of the plurality of queues.
35. The load balancing method of claim 34 wherein transmitting the data further comprises transmitting the data in the high priority queue to all the plurality of crossbar devices, upon determining that data are in the third portion of the queue of the high priority queue.
36. The load balancing method of claim 34 wherein transmitting the data further comprises transmitting the data in the third portion of the non-high priority queues to all the plurality of crossbar devices, upon determining that data are in the first portion of the queue of the high priority queue.
37. The load balancing method of claim 34 wherein transmitting the data further comprises transmitting the data in the non-high priority queues to all the plurality of crossbar devices, upon determining that data are only in the non-high priority queues.
38. The load balancing method of claim 34 wherein transmitting the data further comprises transmitting the data in the high priority queues to all the plurality of crossbar devices, upon determining that data are only in the high priority queues.
39. The load balancing method of claim 34 wherein transmitting the data further comprises transmitting the data in the non-high priority queues to particular predetermined crossbar devices and transmitting the data in the high priority queue to remaining crossbar devices from the plurality of crossbar devices, upon determining that data are in one of the first and second portions of the queue of the high priority queue.
40. The load balancing method of claim 33 wherein the occupancy levels in each queue are based on an amount of data in the high priority queue and an amount of data in each of the plurality of non-high priority queues.
41. The load balancing method of claim 33 wherein the data are transmitted to specific crossbar devices in an order that is based on an occupancy level of the high priority queue and an occupancy level in each of the plurality of non-high priority queues.
42. The load balancing method of claim 32 further comprising dividing the queues into a plurality of portions having a corresponding portion indicator for each portion of the queues to identify that data are in a corresponding portion of a queue.
43. The load balancing method of claim 42 further comprising modifying the portion indicators to indicate various occupancy levels in the queue.
44. The load balancing method of claim 42 wherein the data are transmitted to specific crossbar devices in an order based on the portion indicators.
45. The load balancing method of claim 32 further comprising detecting an inoperable crossbar devices and ceasing transmitting data to the inoperable crossbar devices.
46. The load balancing method of claim 32 further comprising detecting an operational condition of each of the plurality of crossbar devices and transmitting data to the crossbar devices based on the operational condition.
47. The load balancing method of claim 32 further comprising detecting availability of additional crossbar devices by attempting to transmit data to the additional crossbar devices.