IP Library Granted Patent US 12,260,271
Granted Patent B2
US 12,260,271 · App. 18/334,310 · Granted Mar 25, 2025

Multi-tenant radio-based application pipeline processing system

Inventors: Ximeng Simon Yang (San Francisco, CA); Diwakar Gupta (Seattle, WA); Upendra Bhalchandra Shevade (Washigton, DC)
Assignee: Amazon Technologies, Inc.
G06F9/547H04L12/4641H04L67/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,271
App. No.
18/334,310
Granted
Mar 25, 2025
Kind
B2
Abstract

Connectivity between a radio-based application pipeline processing server and a control plane of a provider network is verified. Based on requests received at the control plane, a first isolated request handler, a second isolated request handler and an offloading manager are launched at the server. The offloading manager causes a first network function for which a request is received from the first request handler to be executed at a first network function accelerator of the server, and a second network function for which a request is received from the second request handler to be executed at a second network function accelerator of the server.

Claims (39)

1. A computer-implemented method, comprising:

obtaining, at a service of a cloud computing environment via one or more programmatic interfaces, an indication of a particular type of RAN (Radio Access Network) network function which is to be executed for a first application of a customer of the cloud computing environment;

selecting, by the service, a server at an edge location of the cloud computing environment to implement at least a portion of the first application, wherein the server is selected based at least in part on the server having a first network function accelerator card for the particular type of RAN network function;

executing one or more network functions of the first application at the server, including a first network function of the particular type of RAN network function, wherein the first network function is executed at the first network function accelerator card.

2. The computer-implemented method as recited in claim 1 , wherein the first network function comprises a network function of a physical layer of a radio-based technology stack.

3. The computer-implemented method as recited in claim 1 , wherein the one or more network functions of the first application comprise a second network function which is executed, without using the first network accelerator card, at a processor of the server.

4. The computer-implemented method as recited in claim 1 , wherein the first network function accelerator card is connected to a processor of the server via a peripheral interconnect.

5. The computer-implemented method as recited in claim 1 , further comprising:

executing one or more network functions of a second application at the server.

6. The computer-implemented method as recited in claim 1 , further comprising:

executing a second network function of the first application at the server, wherein the second network function is executed at a second network function accelerator card.

7. The computer-implemented method as recited in claim 1 , further comprising:

causing one or more metrics obtained from the first network function accelerator card to be presented via one or more programmatic interfaces.

8. A system, comprising:

one or more computing devices;

wherein the one or more computing devices include instructions that upon execution on or across one or more processors:

obtain, at a service of a cloud computing environment via one or more programmatic interfaces, an indication of a particular type of RAN (Radio Access Network) network function which is to be executed for a first application of a customer of the cloud computing environment;

select, by the service, a server at an edge location of the cloud computing environment to implement at least a portion of the first application, wherein the server is selected based at least in part on the server having a first network function accelerator card for the particular type of RAN network function;

cause execution of one or more network functions of the first application at the server, including a first network function of the particular type of RAN network function, wherein the first network function is executed at the first network function accelerator card.

9. The system as recited in claim 8 , wherein the first network function comprises a network function of a physical layer of a radio-based technology stack.

10. The system as recited in claim 8 , wherein the one or more network functions of the first application comprise a second network function which is executed, without using the first network accelerator card, at a processor of the server.

11. The system as recited in claim 8 , wherein the first network function accelerator card is connected to a processor of the server via a peripheral interconnect.

12. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across one or more processors:

cause execution of one or more network functions of a second application at the server.

13. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across one or more processors:

cause execution of a second network function of the first application at the server, wherein the second network function is executed at a second network function accelerator card.

14. The system as recited in claim 8 , wherein the one or more computing devices include further instructions that upon execution on or across one or more processors:

cause one or more metrics obtained from the first network function accelerator card to be presented via one or more programmatic interfaces.

15. One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors:

obtain, at a service of a cloud computing environment via one or more programmatic interfaces, an indication of a particular type of RAN (Radio Access Network) network function which is to be executed for a first application of a customer of the cloud computing environment;

select, by the service, a server at an edge location of the cloud computing environment to implement at least a portion of the first application, wherein the server is selected based at least in part on the server having a first network function accelerator card for the particular type of RAN network function;

cause execution of one or more network functions of the first application at the server, including a first network function of the particular type of RAN network function, wherein the first network function is executed at the first network function accelerator card.

16. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the first network function comprises a network function of a physical layer of a radio-based technology stack.

17. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the one or more network functions of the first application comprise a second network function which is executed, without using the first network accelerator card, at a processor of the server.

18. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the first network function accelerator card is connected to a processor of the server via a peripheral interconnect.

19. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:

cause execution of one or more network functions of a second application at the server.

20. The one or more non-transitory computer-accessible storage media as recited in claim 15 , storing further program instructions that when executed on or across the one or more processors:

cause execution of a second network function of the first application at the server, wherein the second network function is executed at a second network function accelerator card.

Continuity (2)
Continuation 17326218 · May 20, 2021
Related Publication 20230325266A1 · Oct 12, 2023
References Cited (85)
US 8539079B2 · Thireault · 2013 [cited by applicant]
US 9092269B2 · Kandula · 2015 [cited by applicant]
US 9125047B2 · Sundaresan et al. · 2015 [cited by applicant]
US 9529620B1 · Dow · 2016 [cited by applicant]
US 9703660B2 · Cillis et al. · 2017 [cited by applicant]
US 9838268B1 · Mattson · 2017 [cited by applicant]
US 9876851B2 · Chandramouli et al. · 2018 [cited by applicant]
US 10064242B2 · Pawar et al. · 2018 [cited by applicant]
US 10135702B2 · Lahiri · 2018 [cited by applicant]
US 10244507B2 · Tarlazzi et al. · 2019 [cited by applicant]
US 10257105B2 · Majmundar et al. · 2019 [cited by applicant]
US 10419550B2 · Nainar et al. · 2019 [cited by applicant]
US 10581717B2 · Tejaprakash et al. · 2020 [cited by applicant]
US 10594456B2 · Park et al. · 2020 [cited by applicant]
US 10608734B2 · Barbieri et al. · 2020 [cited by applicant]
US 10705808B2 · Chiosi et al. · 2020 [cited by applicant]
US 10749721B2 · Fertonani et al. · 2020 [cited by applicant]
US 10750514B2 · Fujinami · 2020 [cited by applicant]
US 10817409B2 · Zeng et al. · 2020 [cited by applicant]
US 10880173B2 · Seenappa et al. · 2020 [cited by applicant]
US 10891140B1 · Levin · 2021 [cited by examiner]
US 10944668B2 · Rajagopal · 2021 [cited by applicant]
US 10959098B2 · Cidon et al. · 2021 [cited by applicant]
US 10999783B2 · Pateromichelakis · 2021 [cited by applicant]
US 11190413B1 · Priya et al. · 2021 [cited by applicant]
US 11356500B1 · Gupta · 2022 [cited by examiner]
US 11539582B1 · Gupta et al. · 2022 [cited by applicant]
US 11552842B2 · Barabell · 2023 [cited by applicant]
US 20120127151A1 · Murakami · 2012 [cited by applicant]
US 20130343399A1 · Kandula · 2013 [cited by applicant]
US 20140189686A1 · Masters · 2014 [cited by applicant]
US 20140351811A1 · Kruglick · 2014 [cited by applicant]
US 20180146375A1 · Pawar et al. · 2018 [cited by applicant]
US 20180365635A1 · Lucrecio et al. · 2018 [cited by applicant]
US 20190042326A1 · Chilikin · 2019 [cited by applicant]
US 20190158606A1 · Guim Bernat et al. · 2019 [cited by applicant]
US 20190165906A1 · Bala et al. · 2019 [cited by applicant]
US 20190190785A1 · Power et al. · 2019 [cited by applicant]
US 20190213029A1 · Liu et al. · 2019 [cited by applicant]
US 20190289497A1 · Rajagopal · 2019 [cited by applicant]
US 20190391855A1 · Bernat et al. · 2019 [cited by applicant]
US 20190394826A1 · Wang et al. · 2019 [cited by applicant]
US 20200245229A1 · Horn et al. · 2020 [cited by applicant]
US 20210006944A1 · Raghothaman et al. · 2021 [cited by applicant]
US 20210073047A1 · Bhandaru · 2021 [cited by applicant]
US 20210144517A1 · Guim Bernat et al. · 2021 [cited by applicant]
US 20210144555A1 · Kim et al. · 2021 [cited by applicant]
US 20210243770A1 · Roessler · 2021 [cited by applicant]
US 20210271517A1 · Guim Bernat · 2021 [cited by applicant]
US 20210279161A1 · Tameshige · 2021 [cited by examiner]
US 20220021605A1 · Bagwell · 2022 [cited by applicant]
US 20220030117A1 · Young et al. · 2022 [cited by applicant]
US 20220046084A1 · Nair · 2022 [cited by applicant]
US 20220070734A1 · Rajagopal · 2022 [cited by applicant]
US 20220374277A1 · Kim · 2022 [cited by examiner]
US 20220377615A1 · Radunovic · 2022 [cited by applicant]
US 20220405114A1 · Chen · 2022 [cited by applicant]
US 20240045744A1 · Richards · 2024 [cited by examiner]
WO 2014073949 · 2014 [cited by applicant]
U.S. Appl. No. 17/548,391, filed Dec. 10, 2021, Ammar Latif et al. [cited by applicant]
U.S. Appl. No. 17/807,341, filed Jun. 16, 2022, Upendra Bhalchandra Shevade et al. [cited by applicant]
U.S. Appl. No. 17/807,343, filed Jun. 16, 2022, Upendra Bhalchandra Shevade et al. [cited by applicant]
U.S. Appl. No. 17/807,344, filed Jun. 16, 2022, Upendra Bhalchandra Shevade et al. [cited by applicant]
U.S. Appl. No. 17/808,518, filed Jun. 23, 2022, Ozgur Dural. [cited by applicant]
U.S. Appl. No. 17/326,221, filed May 20, 2021, Ximeng Simon Yang. [cited by applicant]
U.S. Appl. No. 17/326,218, filed May 20, 2021, Ximeng Simon Yang. [cited by applicant]
U.S. Appl. No. 17/710,571, filed Mar. 31, 2022, Manjari Asawa. [cited by applicant]
U.S. Appl. No. 17/806,684, filed Jun. 13, 2022, Benjamin Wojtowicz. [cited by applicant]
U.S. Appl. No. 17/806,685, filed Jun. 13, 2022, Benjamin Wojtowicz. [cited by applicant]
U.S. Appl. No. 17/810,319, filed Jun. 30, 2022, Julius Mueller, at al. [cited by applicant]
U.S. Appl. No. 17/809,864, filed Jun. 29, 2022, Nikolay Krasilnikov et al. [cited by applicant]
U.S. Appl. No. 17/820,542, filed Aug. 17, 2022, Nikolay Krasilnikov et al. [cited by applicant]
Unknown, “5G; NG-RAN; Architecture Description”, Technical Specification, ETSI TS 138 401, Version 16.8.0, Release 16, Jan. 2022, pp. 1-82. [cited by applicant]
Ashfaq Ahmed, et al., “Hybrid Automatic Repeat Request (HARQ) in Wireless Communication Systems and Standards: A Contemporary Survey”, IEEE Communications Surveys & Tutorials 23.4, 2021, pp. 2711-2752. [cited by applicant]
U.S. Appl. No. 18/146,126, filed Dec. 23, 2022, Diwakar Gupta. [cited by applicant]
U.S. Appl. No. 18/067,650, filed Dec. 16, 2022, Jiandong Huang. [cited by applicant]
U.S. Appl. No. 18/066,943, filed Dec. 15, 2022, Awaiz Ahmad Khan. [cited by applicant]
U.S. Appl. No. 18/067,654, filed Dec. 16, 2022, Frank Paterra. [cited by applicant]
U.S. Appl. No. 18/067,651, filed Dec. 16, 2022, Frank Paterra. [cited by applicant]
U.S. Appl. No. 17/364,779, filed Jun. 30, 2021, Diwakar Gupta. [cited by applicant]
U.S. Appl. No. 17/364,788, filed Jun. 30, 2021, Diwakar Gupta. [cited by applicant]
U.S. Appl. No. 17/364,789, filed Jun. 30, 2021, Diwakar Gupta. [cited by applicant]
U.S. Appl. No. 17/364,791, filed Jun. 30, 2021, Diwakar Gupta. [cited by applicant]
Li Xin et al: “QoS-Aware Service Selection in Geographically Distributed Clouds”, 2013 22nd International Conference on Computer Communication and Networks (ICCCN), IEEE, Jul. 30, 2013, pp. 1-5 [retrieved on Sep. 27, 20… [cited by applicant]
U.S. Appl. No. 17/461,785, filed Aug. 30, 2021, Diwakar Gupta. [cited by applicant]