IP Library Granted Patent US 10,820,235
Granted Patent B2
US 10,820,235 · App. 16/258,172 · Granted Oct 27, 2020

Efficient inroute (return channel) load balancing scheme of guaranteed QoS traffic mixed with best effort traffic in an oversubscribed satellite network

Inventors: Satyajit Roy (Gaithersburg, MD); Archana Gharpuray (Germantown, MD)
Assignee: HUGHES NETWORK SYSTEMS, LLC
H04W28/085H04W28/0268H04W28/10H04W28/24H04W24/02H04W84/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,820,235
App. No.
16/258,172
Granted
Oct 27, 2020
Kind
B2
Abstract

A method for balancing inroute traffic load that contains both guaranteed QoS and best effort traffic. Hierarchical grouping levels are defined with the lowest level corresponding to inroutes within the system. Certain levels have common symbol rates, modulation rates, or both. When a new terminal requires admission, it is assigned to entries in the different hierarchical levels so that the inroute traffic load across all levels are balanced. Terminals are admitted to inroutes based, in part, on their channel quality indicator. Inroute traffic load can periodically rebalance based on elapsed time or terminal redistribution.

Claims (130)

1. A method comprising:

selecting an inroute set for a new terminal from at least one inroute set carrying traffic load in a satellite communication system based, in part, on Inroute Set Definition Packets (ISDP) received from a remotely located inroute resource manager for the satellite communication system;

selecting a super inroute group for the new terminal from at least one super inroute group contained in the selected inroute set, each of the at least one super inroute group having a different symbol rate;

selecting an inroute group for the new terminal from one or more inroute groups contained in the selected super inroute group, each of the one or more inroute group having a different modulation rate;

admitting the new terminal to a selected inroute from one or more inroutes contained in the selected inroute group based, at least in part, on a channel quality indicator (CQI) of the new terminal, each of the one or more inroutes having the same symbol rate and modulation rate; and

transmitting and receiving data, by the new terminal, using the selected inroute,

wherein inroute traffic load in the satellite communication system includes guaranteed service terminal traffic and/or backlog terminal traffic, and

wherein the inroute traffic load in the satellite communication system is balanced across the at least one inroute set, the at least one super inroute group, the one or more inroute groups, and the one or more inroutes.

2. The method of claim 1 , wherein the inroute set is selected by the terminal or a gateway.

3. The method of claim 1 , wherein the inroute set is selected based on at least one of a backlog load metric of backlog terminals associated with each inroute set and a committed bandwidth load metric of guaranteed service terminals associated with each inroute set.

4. The method of claim 1 , further comprising:

determining a committed load metric for each of the at least one inroute set based on all guaranteed service terminals contained therein;

determining a backlog load metric for each of the at least one inroute set based on all backlog terminals contained therein; and

including the committed load metric and the backlog load metric in the ISDP received from the inroute resource manager.

5. The method of claim 4 , further comprising:

selecting the inroute set based on the committed load metrics of the at least one inroute set, if the new terminal is a guaranteed service terminal; and

selecting the inroute set based on both the committed load metrics and the backlog load metrics of the at least one inroute set, if the new terminal is a backlog terminal.

6. The method of claim 1 , wherein the super inroute group is selected based on at least one of a CQI of the new terminal, a backlog of the new terminal, a backlog load density associated with each super inroute group, and a committed service load density associated with each super inroute group.

7. The method of claim 1 , wherein:

the selected inroute set contains one super inroute group; and

the one super inroute group is selected for the new terminal.

8. The method of claim 1 , wherein the new terminal is a guaranteed service terminal, and selecting a super inroute group further comprises:

determining a committed bandwidth load density for each super inroute group contained in the selected inroute set;

estimating an oversubscription level for guaranteed service terminals for each super inroute group contained in the selected inroute set;

estimating a bandwidth growth probability for guaranteed service terminals for each super inroute group contained in the selected inroute set; and

selecting the super inroute group for the new terminal based, at least in part, on the committed bandwidth load density, oversubscription level, and bandwidth growth probability of all super inroute group contained in the selected inroute set.

9. The method of claim 8 , wherein:

the committed bandwidth load density is based on a ratio of aggregate effective guaranteed bandwidth allocation and available aggregate symbol rate; and

the effective guaranteed bandwidth allocation includes bandwidth allocated to all guaranteed service terminals and bandwidth allocated to admittance constant bit rate (CBR) sessions from backlog terminals.

10. The method of claim 1 , wherein the new terminal is a backlog terminal and selecting a super inroute group further comprises:

determining a backlog of the new terminal; and

selecting a super inroute group having a low symbol rate if the backlog of the new terminal is low, and selecting a super inroute group having a high symbol rate if the backlog of the new terminal is high.

11. The method of claim 1 , wherein the inroute group for the new terminal is selected based on at least one of a backlog of the new terminal, a backlog load density of each inroute group, a mean backlog load density for the selected super inroute group, a committed service load density for each inroute group, and a mean committed service load density for the selected super inroute group.

12. The method of claim 1 , wherein the new terminal is a guaranteed service terminal, and selecting an inroute group further comprises:

determining a ratio of current throughput and guaranteed subscription for the new terminal;

determining a committed bandwidth load density for each inroute group contained in the selected super inroute group;

determining a mean committed bandwidth load density for the selected super inroute group; and

selecting the inroute group having the lowest committed bandwidth load relative to the mean committed bandwidth load of the super inroute group for the new terminal.

13. The method of claim 1 , wherein the new terminal is a backlog terminal and selecting an inroute group further comprises:

determining a backlog load density for each inroute group contained in the super inroute group;

determining a mean backlog load density for the selected super inroute group; and

selecting the inroute group having the lowest backlog load density relative to the mean backlog load density of the selected super inroute group for the new terminal.

14. The method of claim 1 , wherein the new terminal is admitted to the selected inroute based on at least one of a CQI of the new terminal, a CQI of inroutes within the selected inroute group, a backlog volume of the one or more inroutes in the selected inroute group, a guaranteed bandwidth subscription of the new terminal, an obliged bandwidth of existing terminals in each inroute, an obliged bandwidth available in each inroute, and an actual bandwidth available on each inroute.

15. The method of claim 1 , wherein the new terminal is a guaranteed service terminal and admitting further comprises:

determining an obliged bandwidth for the new terminal based on a guaranteed bandwidth subscription for the new terminal and a growth probability for the new terminal;

determining an obliged bandwidth of all guaranteed service terminals for each inroute contained in the selected inroute group;

calculating an obliged bandwidth left in each inroute contained in the selected inroute group after accounting for the obliged bandwidth of all guaranteed service terminals; and

admitting the new terminal to an inroute whose obliged bandwidth left is greater than the obliged bandwidth of the new terminal.

16. The method of claim 15 , wherein the obliged bandwidth of the new terminal cannot be accommodated by the obliged bandwidth of any of the one or more inroutes contained in the selected inroute group, and further comprising:

determining a minimum bandwidth requirement for the new terminal; and

admitting the new terminal to an inroute whose obliged bandwidth left is greater than the minimum bandwidth requirement of the new terminal.

17. The method of claim 16 , wherein the minimum bandwidth requirement for the new terminal cannot be accommodated by the obliged bandwidth of any of the one or more inroutes contained in the selected inroute group, and further comprising:

determining left over unallocated bandwidth for each inroute contained in the selected inroute group; and

admitting the new terminal to an inroute whose leftover unallocated bandwidth is greater than the minimum bandwidth requirement for the new terminal.

18. The method of claim 17 , wherein the new terminal cannot be accommodated by any of the one or more inroutes contained in the selected inroute group, and further comprising:

moving one or more terminals from a target inroute within the inroute group to at least one destination inroute within the inroute group, until the target inroute can accommodate the minimum bandwidth requirement of the new terminal; and

admitting the new terminal to target inroute.

19. The method of claim 1 , wherein the new terminal is a backlog terminal and admitting further comprises:

determining a backlog volume for each inroute contained in the selected inroute group; and

admitting the new terminal to the inroute having the lowest backlog volume.

20. The method of claim 19 , further comprising:

determining a CQI for the new terminal; and

determining a CQI for each inroute contained in the selected inroute group,

wherein the new terminal is admitted to the inroute having the lowest backlog volume and having a CQI capable of accommodating the CQI of the new terminal.

21. A system comprising:

a satellite; and

a gateway for managing traffic from a plurality of terminals in a satellite communication system, the gateway comprising an inroute resource manager configured to:

select an inroute set for a new terminal from at least one inroute set carrying traffic load in a satellite communication system based, in part, on Inroute Set Definition Packets (ISDP);

select a super inroute group for the new terminal from at least one super inroute group contained in the selected inroute set, each of the at least one super inroute group having a different symbol rate;

select an inroute group for the new terminal from one or more inroute groups contained in the selected super inroute group, each of the one or more inroute groups having a different modulation rate;

admit the new terminal to a selected inroute from one or more inroutes contained in the selected inroute group based, at least in part, on a channel quality indicator (CQI) of the new terminal, each of the one or more inroutes having the same symbol rate and modulation rate; and

transmit and receiving data, by the new terminal, using the selected inroute,

wherein inroute traffic load in the satellite communication system includes guaranteed service terminal traffic and/or backlog terminal traffic, and

wherein the inroute traffic load in the satellite communication system is balanced across the at least one inroute set, the at least one super inroute group, the one or more inroute groups, and the one or more inroutes.

22. The system of claim 21 , wherein the inroute set is selected by the terminal or the gateway.

23. The system of claim 21 , wherein the inroute set is selected based on at least one of a backlog load metric of backlog terminals associated with each inroute set and a committed bandwidth load metric of guaranteed service terminals associated with each inroute set.

24. The system of claim 21 , wherein the inroute resource manager is further configured to:

determine a committed load metric for each of the at least one inroute set based on all guaranteed service terminals contained therein;

determine a backlog load metric for each of the at least one inroute set based on all backlog terminals contained therein; and

include the committed load metric and the backlog load metric in the ISDP.

25. The system of claim 24 , wherein the inroute resource manager is further configured to:

select the inroute set based on the committed load metrics of the at least one inroute set, if the new terminal is a guaranteed service terminal; and

select the inroute set based on both the committed load metrics and the backlog load metrics of the at least one inroute set, if the new terminal is a backlog terminal.

26. The system of claim 21 , wherein the super inroute group is selected based on at least one of a CQI of the new terminal, a backlog of the new terminal, a backlog load density associated with each super inroute group, and a committed service load density associated with each super inroute group.

27. The system of claim 21 , wherein:

the selected inroute set contains one super inroute group; and

the one super inroute group is selected for the new terminal.

28. The system of claim 21 , wherein the new terminal is a guaranteed service terminal, and the inroute resource manager is further configured to select a super inroute group further by:

determining a committed bandwidth load density for each super inroute group contained in the selected inroute set;

estimating an oversubscription level for guaranteed service terminals for each super inroute group contained in the selected inroute set;

estimating a bandwidth growth probability for guaranteed service terminals for each super inroute group contained in the selected inroute set; and

selecting the super inroute group for the new terminal based, at least in part, on the committed bandwidth load density, oversubscription level, and bandwidth growth probability of all super inroute group contained in the selected inroute set.

29. The system of claim 28 , wherein:

the committed bandwidth load density is based on a ratio of aggregate effective guaranteed bandwidth allocation and available aggregate symbol rate; and

the effective guaranteed bandwidth allocation includes bandwidth allocated to all guaranteed service terminals and bandwidth allocated to admittance constant bit rate (CBR) sessions from backlog terminals.

30. The system of claim 21 , wherein the new terminal is a backlog terminal and the inroute resource manager is further configured to select a super inroute group by:

determining a backlog of the new terminal; and

selecting a super inroute group having a low symbol rate if the backlog of the new terminal is low, and selecting a super inroute group having a high symbol rate if the backlog of the new terminal is high.

31. The system of claim 21 , wherein the inroute group for the new terminal is selected based on at least one of a backlog of the new terminal, a backlog load density of each inroute group, a mean backlog load density for the selected super inroute group, a committed service load density for each inroute group, and a mean committed service load density for the selected super inroute group.

32. The system of claim 21 , wherein the new terminal is a guaranteed service terminal, and the inroute resource manager is further configured to select an inroute group by:

determining a ratio of current throughput and guaranteed subscription for the new terminal;

determining a committed bandwidth load density for each inroute group contained in the selected super inroute group;

determining a mean committed bandwidth load density for the selected super inroute group; and

selecting the inroute group having the lowest committed bandwidth load relative to the mean committed bandwidth load of the super inroute group for the new terminal.

33. The system of claim 21 , wherein the new terminal is a backlog terminal and the inroute resource manager is further configured to select an inroute group by:

determining a backlog load density for each inroute group contained in the super inroute group;

determining a mean backlog load density for the selected super inroute group; and

selecting the inroute group having the lowest backlog load density relative to the mean backlog load density of the selected super inroute group for the new terminal.

34. The system of claim 21 , wherein the new terminal is admitted to the selected inroute based on at least one of a CQI of the new terminal, a CQI of inroutes within the selected inroute group, a backlog volume of the one or more inroutes in the selected inroute group, a guaranteed bandwidth subscription of the new terminal, an obliged bandwidth of existing terminals in each inroute, an obliged bandwidth available in each inroute, and an actual bandwidth available on each inroute.

35. The system of claim 21 , wherein the new terminal is a guaranteed service terminal and the inroute resource manager is further configured to admit the new terminal to a selected inroute by:

determining an obliged bandwidth for the new terminal based on a guaranteed bandwidth subscription for the new terminal and a growth probability for the new terminal;

determining an obliged bandwidth of all guaranteed service terminals for each inroute contained in the selected inroute group;

calculating an obliged bandwidth left in each inroute contained in the selected inroute group after accounting for the obliged bandwidth of all guaranteed service terminals; and

admitting the new terminal to an inroute whose obliged bandwidth left is greater than the obliged bandwidth of the new terminal.

36. The system of claim 35 , wherein the obliged bandwidth of the new terminal cannot be accommodated by the obliged bandwidth of any of the one or more inroutes contained in the selected inroute group, and wherein the inroute resource manager is further configured to:

determine a minimum bandwidth requirement for the new terminal; and

admit the new terminal to an inroute whose obliged bandwidth left is greater than the minimum bandwidth requirement of the new terminal.

37. The system of claim 36 , wherein the minimum bandwidth requirement for the new terminal cannot be accommodated by the obliged bandwidth of any of the one or more inroutes contained in the selected inroute group, and wherein the inroute resource manager is further configured to:

determine left over unallocated bandwidth for each inroute contained in the selected inroute group; and

admit the new terminal to an inroute whose leftover unallocated bandwidth is greater than the minimum bandwidth requirement for the new terminal.

38. The system of claim 37 , wherein the new terminal cannot be accommodated by any of the one or more inroutes contained in the selected inroute group, and wherein the inroute resource manager is further configured to:

move one or more terminals from a target inroute within the inroute group to at least one destination inroute within the inroute group, until the target inroute can accommodate the minimum bandwidth requirement of the new terminal; and

admit the new terminal to target inroute.

39. The system of claim 21 , wherein the new terminal is a backlog terminal and the inroute resource manager is further configured to admit the new terminal to a selected inroute by:

determining a backlog volume for each inroute contained in the selected inroute group; and

admitting the new terminal to the inroute having the lowest backlog volume.

40. The system of claim 39 , wherein the inroute resource manager is further configured to:

determine a CQI for the new terminal; and

determine a CQI for each inroute contained in the selected inroute group,

wherein the new terminal is admitted to the inroute having the lowest backlog volume and having a CQI capable of accommodating the CQI of the new terminal.

Assignments (5)
SECURITY INTEREST Recorded Feb 3, 2021
From: HUGHES NETWORK SYSTEMS, LLC
To: U.S. BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 055211/0044 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION NUMBER 15649418 PREVIOUSLY RECORDED ON REEL 050600 FRAME 0314. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF PATENT SECURITY AGREEMENTS. Recorded Sep 3, 2020
From: WELLS FARGO, NATIONAL BANK ASSOCIATION
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 053703/0367 →
ASSIGNMENT OF PATENT SECURITY AGREEMENTS Recorded Oct 1, 2019
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 050600/0314 →
SECURITY INTEREST Recorded May 21, 2019
From: HUGHES NETWORK SYSTEMS, LLC
To: WELLS FARGO BANK, NATIONAL ASSOCIATION - AS COLLATERAL AGENT
Reel/Frame 049239/0675 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2019
From: ROY, SATYAJIT; GHARPURAY, ARCHANA
To: HUGHES NETWORK SYSTEMS, LLC
Reel/Frame 048152/0855 →