IP Library Granted Patent US 12,375,554
Granted Patent B2
US 12,375,554 · App. 18/413,879 · Granted Jul 29, 2025

Network traffic management at radio-based application pipeline processing servers

Inventors: Diwakar Gupta (Seattle, WA); Benjamin Wojtowicz (San Francisco, CA); Upendra Bhalchandra Shevade (Washington, DC); Ximeng Simon Yang (San Francisco, CA)
Assignee: Amazon Technologies, Inc.
H04L67/1008H04L67/60H04W28/08H04W28/16H04M2203/158
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,554
App. No.
18/413,879
Granted
Jul 29, 2025
Kind
B2
Abstract

At a radio-based application pipeline processing server at which a portion of a distributed unit (DU) of a radio-based application is implemented, a particular networking hardware device is selected from among several devices (which include least one device incorporated within a network function accelerator card and at least one device which is not part of an accelerator card) for transmission of at least a portion of mid-haul traffic to a centralized unit (CU). The mid-haul traffic is transmitted to the CU via the selected device. At least a portion of front-haul traffic is transmitted to a radio unit (RU) via a networking hardware device incorporated within a network function accelerator card of the server.

Claims (52)

1. A computer-implemented method, comprising:

executing a virtualized Radio Access Network (RAN) network function of a distributed unit (DU) of a radio-based application at a server which includes a network function accelerator card and a plurality of networking hardware devices, including a first networking hardware device and a second networking hardware device;

transmitting, from the server, using the first networking hardware device, at least a portion of mid-haul traffic of the radio-based application to a centralized unit (CU) of the radio-based application; and

transmitting, from the server, using the second networking hardware device, at least a portion of front-haul traffic of the radio-based application to a radio unit (RU) of the radio-based application, wherein the portion of front-haul traffic includes a result of a network function executed at the network function accelerator card.

2. The computer-implemented method as recited in claim 1 , wherein one or more networking hardware devices of the plurality of networking hardware devices are incorporated within the network function accelerator card.

3. The computer-implemented method as recited in claim 1 , wherein one or more networking hardware devices of the plurality of networking hardware devices are incorporated within a virtualization management offloading card of the server.

4. The computer-implemented method as recited in claim 1 , further comprising:

determining a traffic distribution policy applicable to the radio-based application, wherein the traffic distribution policy is obtained via one or more programmatic interfaces of a cloud computing environment; and

selecting, based at least in part on the traffic distribution policy, the first networking hardware device for transmitting the portion of the mid-haul traffic.

5. The computer-implemented method as recited in claim 1 , further comprising:

selecting, for traffic associated with an isolated virtual network of a cloud computing environment, a particular networking hardware device from among the plurality of networking hardware devices; and

transmitting, from the server, one or more messages of traffic associated with the isolated virtual network via the particular networking hardware device.

6. The computer-implemented method as recited in claim 1 , further comprising:

selecting, for traffic associated with endpoints external to a cloud computing environment, a particular networking hardware device from among the plurality of networking hardware devices, wherein the server comprises a virtual machine of the cloud computing environment; and

transmitting one or more messages of traffic from the virtual machine, via the particular networking hardware device, to an endpoint external to the cloud computing environment.

7. The computer-implemented method as recited in claim 1 , wherein the portion of front-haul traffic includes a result of another network function, wherein the other network function is executed at a processor which is external to the network function accelerator card.

8. A system, comprising:

a server which includes:

one or more processors;

a network function accelerator card; and

a plurality of networking hardware devices, including a first networking hardware device and a second networking hardware device;

wherein the server stores instructions that upon execution on or across the one or more processors:

implement a virtualized Radio Access Network (RAN) network function of a distributed unit (DU) of a radio-based application;

cause to be transmitted, from the server, via the first networking hardware device, at least a portion of mid-haul traffic of the radio-based application to a centralized unit (CU) of the radio-based application; and

cause to be transmitted, from the server, via the second networking hardware device, at least a portion of front-haul traffic of the radio-based application to a radio unit (RU) of the radio-based application, wherein the portion of front-haul traffic includes a result of a network function executed at the network function accelerator card.

9. The system as recited in claim 8 , wherein one or more networking hardware devices of the plurality of networking hardware devices are incorporated within the network function accelerator card.

10. The system as recited in claim 8 , wherein one or more networking hardware devices of the plurality of networking hardware devices are incorporated within a virtualization management offloading card of the server.

11. The system as recited in claim 8 , wherein the server stores further instructions that upon execution on or across the one or more processors:

determine a traffic distribution policy applicable to the radio-based application, wherein the traffic distribution policy is obtained via one or more programmatic interfaces of a cloud computing environment; and

select, based at least in part on the traffic distribution policy, the first networking hardware device for transmitting the portion of the mid-haul traffic.

12. The system as recited in claim 8 , wherein the server stores further instructions that upon execution on or across the one or more processors:

select, for traffic associated with an isolated virtual network of a cloud computing environment, a particular networking hardware device from among the plurality of networking hardware devices; and

cause one or more messages of traffic associated with the isolated virtual network to be transmitted from the server via the particular networking hardware device.

13. The system as recited in claim 8 , wherein the server stores further instructions that upon execution on or across the one or more processors:

select, for traffic associated with endpoints external to a cloud computing environment, a particular networking hardware device from among the plurality of networking hardware devices, wherein the server comprises a virtual machine of the cloud computing environment; and

cause one or more messages of traffic from the virtual machine to be transmitted via the particular networking hardware device to an endpoint external to the cloud computing environment.

14. The system as recited in claim 8 , wherein the portion of front-haul traffic includes a result of another network function, wherein the other network function is executed at a processor which is external to the network function accelerator card.

15. One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors:

implement a virtualized Radio Access Network (RAN) network function of a distributed unit (DU) of a radio-based application;

cause to be transmitted, from a server, via a first networking hardware device of a plurality of networking hardware devices of the server, at least a portion of mid-haul traffic of the radio-based application to a centralized unit (CU) of the radio-based application; and

cause to be transmitted, from the server, via a second networking hardware device of the plurality of networking hardware devices, at least a portion of front-haul traffic of the radio-based application to a radio unit (RU) of the radio-based application, wherein the portion of front-haul traffic includes a result of a network function executed at a network function accelerator card of the server.

16. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein one or more networking hardware devices of the plurality of networking hardware devices are incorporated within the network function accelerator card.

17. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein one or more networking hardware devices of the plurality of networking hardware devices are incorporated within a virtualization management offloading card of the server.

18. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:

determine a traffic distribution policy applicable to the radio-based application, wherein the traffic distribution policy is obtained via one or more programmatic interfaces of a cloud computing environment; and

select, based at least in part on the traffic distribution policy, the first networking hardware device for transmitting the portion of the mid-haul traffic.

19. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:

select, for traffic associated with an isolated virtual network of a cloud computing environment, a particular networking hardware device from among the plurality of networking hardware devices; and

cause one or more messages of traffic associated with the isolated virtual network to be transmitted from the server via the particular networking hardware device.

20. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:

select, for traffic associated with endpoints external to a cloud computing environment, a particular networking hardware device from among the plurality of networking hardware devices, wherein the server comprises a virtual machine of the cloud computing environment; and

cause one or more messages of traffic from the virtual machine to be transmitted via the particular networking hardware device to an endpoint external to the cloud computing environment.

Continuity (2)
Continuation 17364791 · Jun 30, 2021
Related Publication 20240236178A1 · Jul 11, 2024
References Cited (104)
US 5381346A · Monahan-Mitchell · 1995 [cited by applicant]
US 8010673B2 · Dea · 2011 [cited by applicant]
US 8539079B2 · Thireault · 2013 [cited by applicant]
US 9125047B2 · Sundaresan et al. · 2015 [cited by applicant]
US 9703660B2 · Cillis et al. · 2017 [cited by applicant]
US 9838268B1 · Mattson · 2017 [cited by applicant]
US 9876851B2 · Chandramouli et al. · 2018 [cited by applicant]
US 10007555B1 · Kuhne · 2018 [cited by applicant]
US 10064242B2 · Pawar et al. · 2018 [cited by applicant]
US 10135702B2 · Lahiri · 2018 [cited by applicant]
US 10244507B2 · Tarlazzi et al. · 2019 [cited by applicant]
US 10257105B2 · Majmundar et al. · 2019 [cited by applicant]
US 10355946B1 · Dolas · 2019 [cited by applicant]
US 10419550B2 · Nainar et al. · 2019 [cited by applicant]
US 10581717B2 · Tejaprakash et al. · 2020 [cited by applicant]
US 10594456B2 · Park et al. · 2020 [cited by applicant]
US 10608734B2 · Barbieri et al. · 2020 [cited by applicant]
US 10705808B2 · Chiosi et al. · 2020 [cited by applicant]
US 10728091B2 · Zhao · 2020 [cited by applicant]
US 10749721B2 · Fertonani et al. · 2020 [cited by applicant]
US 10750514B2 · Fujinami · 2020 [cited by applicant]
US 10817409B2 · Zeng et al. · 2020 [cited by applicant]
US 10880173B2 · Seenappa et al. · 2020 [cited by applicant]
US 10891140B1 · Levin · 2021 [cited by applicant]
US 10944668B2 · Rajagopal · 2021 [cited by applicant]
US 10959098B2 · Cidon et al. · 2021 [cited by applicant]
US 10999783B2 · Pateromichelakis · 2021 [cited by applicant]
US 11115920B1 · Seetharama · 2021 [cited by applicant]
US 11190413B1 · Priya et al. · 2021 [cited by applicant]
US 11356500B1 · Gupta et al. · 2022 [cited by applicant]
US 11539582B1 · Gupta et al. · 2022 [cited by applicant]
US 11544648B2 · Kass · 2023 [cited by applicant]
US 11552842B2 · Barabell · 2023 [cited by applicant]
US 11720425B1 · Yang · 2023 [cited by applicant]
US 11743117B2 · Gupta · 2023 [cited by applicant]
US 11800404B1 · Yang · 2023 [cited by applicant]
US 11824943B1 · Krasilnikov et al. · 2023 [cited by applicant]
US 11916999B1 · Gupta · 2024 [cited by examiner]
US 11937103B1 · Krasilnikov et al. · 2024 [cited by applicant]
US 11985065B2 · Shevade et al. · 2024 [cited by applicant]
US 20110231839A1 · Bennett · 2011 [cited by applicant]
US 20120127151A1 · Murakami · 2012 [cited by applicant]
US 20180041905A1 · Ashrafi · 2018 [cited by applicant]
US 20180146375A1 · Pawar et al. · 2018 [cited by applicant]
US 20180176148A1 · Ku · 2018 [cited by applicant]
US 20180365635A1 · Lucrecio et al. · 2018 [cited by applicant]
US 20190042326A1 · Chilikin · 2019 [cited by applicant]
US 20190158606A1 · Guim Bernat et al. · 2019 [cited by applicant]
US 20190165906A1 · Bala et al. · 2019 [cited by applicant]
US 20190190785A1 · Power · 2019 [cited by applicant]
US 20190213029A1 · Liu et al. · 2019 [cited by applicant]
US 20190289497A1 · Rajagopal · 2019 [cited by applicant]
US 20190372908A1 · Featonby · 2019 [cited by applicant]
US 20190391855A1 · Bernat et al. · 2019 [cited by applicant]
US 20190394826A1 · Wang et al. · 2019 [cited by applicant]
US 20200142735A1 · Maciocco · 2020 [cited by applicant]
US 20200162332A1 · Liguori · 2020 [cited by applicant]
US 20200204623A1 · Einkauf · 2020 [cited by applicant]
US 20200245229A1 · Horn et al. · 2020 [cited by applicant]
US 20210006944A1 · Raghothaman et al. · 2021 [cited by applicant]
US 20210073047A1 · Bhandaru · 2021 [cited by applicant]
US 20210109789A1 · McWeeney · 2021 [cited by applicant]
US 20210109830A1 · Venugopal · 2021 [cited by applicant]
US 20210144517A1 · Guim Bernat et al. · 2021 [cited by applicant]
US 20210144555A1 · Kim et al. · 2021 [cited by applicant]
US 20210243770A1 · Roessler · 2021 [cited by applicant]
US 20210271517A1 · Guim Bernat · 2021 [cited by applicant]
US 20210279161A1 · Tameshige · 2021 [cited by applicant]
US 20210320878A1 · Young · 2021 [cited by applicant]
US 20220021426A1 · Piirainen · 2022 [cited by applicant]
US 20220030117A1 · Young et al. · 2022 [cited by applicant]
US 20220046084A1 · Nair · 2022 [cited by applicant]
US 20220070734A1 · Rajagopal · 2022 [cited by applicant]
US 20220107837A1 · Youn · 2022 [cited by applicant]
US 20220312418A1 · Lourdu Raja · 2022 [cited by applicant]
US 20220377615A1 · Adunovic · 2022 [cited by applicant]
US 20230315534A1 · Manjari · 2023 [cited by applicant]
US 20230325266A1 · Yang · 2023 [cited by applicant]
US 20230409362A1 · Shevade et al. · 2023 [cited by applicant]
US 20230409363A1 · Shevade et al. · 2023 [cited by applicant]
US 20230412507A1 · Shevade et al. · 2023 [cited by applicant]
US 20240040002A1 · Krasilnikov et al. · 2024 [cited by applicant]
US 20240202153A1 · Huang · 2024 [cited by applicant]
US 20240202157A1 · Paterra · 2024 [cited by applicant]
US 20240205680A1 · Paterra · 2024 [cited by applicant]
WO 2014073949A1 · 2014 [cited by applicant]
U.S. Appl. No. 17/548,391, filed Dec. 10, 2021, Ammar Latif. [cited by applicant]
U.S. Appl. No. 17/364,788, filed Jun. 30, 2021, Diwakar Gupta. [cited by applicant]
U.S. Appl. No. 17/364,779, filed Jun. 30, 2021, Diwakar Gupta. [cited by applicant]
U.S. Appl. No. 17/806,684, filed Jun. 13, 2022, Benjamin Wojtowicz. [cited by applicant]
U.S. Appl. No. 17/806,685, filed Jun. 13, 2022, Benjamin Wojtowicz. [cited by applicant]
U.S. Appl. No. 17/808,518, filed Jun. 23, 2022, Ozgur Dural. [cited by applicant]
Ashfaq Ahmed, et al., “Hybrid Automatic Repeat Request (HARQ) in Wireless Communication Systems and Standards: A Contemporary Survey”, IEEE Communications Surveys & Tutorials 23.4, 2021, pp. 2711-2752. [cited by applicant]
Unknown, “5G; NG-RAN; Architecture Description”, Technical Specification, ETSI TS 138 401, Version 16.8.0, Release 16, Jan. 2022, pp. 1-82. [cited by applicant]
Li Xin et al: “QoS-Aware Service Selection in Geographically Distributed Clouds”, 2013 22nd International Conference on Computer Communication and Networks (ICCCN), IEEE, Jul. 30, 2013, pp. 1-5 [retrieved on Sep. 27, 20… [cited by applicant]
Doan, Tung V., et al. “FAST: Flexible and low-latency state transfer in mobile edge computing.” IEEE Access 9 (Year: 2021). [cited by applicant]
Prados-Garzon, Jonathan, et al. “Handover implementation in a 5G SDN-based mobile network architecture.” 2016 IEEE 27th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC). IEEE. … [cited by applicant]
U.S. Appl. No. 17/810,319, filed Jun. 30, 2022, Julius Mueller, at al. [cited by applicant]
Ramanathan, Shunmugapriya, et al. “Demonstration of containerized central unit live migration in 5g radio access network.” 2022 IEEE 8th International Conference on Network Softwarization (NetSoft). IEEE. (Year: 2022). [cited by applicant]
U.S. Appl. No. 18/067,654, filed Dec. 16, 2022, Frank Paterra. [cited by applicant]
U.S. Appl. No. 18/067,651, filed Dec. 16, 2022, Frank Paterra. [cited by applicant]
U.S. Appl. No. 18/067,650, filed Dec. 16, 2022, Jiandong Huang. [cited by applicant]
U.S. Appl. No. 18/066,943, filed Dec. 15, 2022, Awaiz Ahmad Khan. [cited by applicant]
U.S. Appl. No. 18/630,891, filed Apr. 9, 2024, Shevade, et al. [cited by applicant]