IP Library › Granted Patent US 12,323,319
Granted Patent B2
US 12,323,319 · App. 17/550,936 · Granted Jun 3, 2025

Reliability enhancements for multi-access traffic management

Inventors: Shu-ping Yeh (Campbell, CA); Wei Mao (San Jose, CA); Hosein Nikopour (San Jose, CA); Shilpa Talwar (Santa Clara, CA); Murali Narasimha (Lake Oswego, OR); Jingwen Bai (San Jose, CA)
Assignee: Intel Corporation
H04L45/121H04L45/302H04L47/215H04L69/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,323,319
App. No.
17/550,936
Filed
Dec 14, 2021
Granted
Jun 3, 2025
Kind
B2
Art Unit
2416
USPC
370/392
Abstract

The present disclosure is related to multi-access traffic management in multi-access computing environments. A reliability enhancement engine (REE) operated by a multi-access multipath traffic manager identifies traffic flows that have high reliability requirements (“reliability flows”) and performs admission control for the reliability flows. The REE determines a coding rate (e.g., a redundancy factor) and traffic distribution strategies for the identified reliability flows. The REE applies cross-access network coding (NC) on the reliability flows, and handles multi-access acknowledgements and traffic pacing, which may involve multiplexing traffic of the reliability flows with non-high-reliability traffic. Other embodiments may be described and/or claimed.

Claims (91)

1. An edge compute node for providing reliability enhancements in a multi-access communication network, the edge compute node comprising:

interface circuitry arranged to communicatively couple the edge compute node with a set of network access nodes (NANs) in the multi-access communication network, wherein one or more NANs in the set of NANs is communicatively coupled with one or more user devices; and

processor circuitry connected to the interface circuitry, wherein the processor circuitry is to:

collect, via the interface circuitry, metrics related to the multi-access communication network from one or more data sources within the multi-access communication network;

determine, based on the collected metrics, a reliability target, a network coding (NC) group size, and per path characteristics for each network path of a set of network paths in the multi-access communication network;

determine a traffic distribution strategy based on the per path characteristics, the NC group size, and the reliability target, wherein the traffic distribution strategy specifies a number of network coded packets to be routed over respective network paths of the set of network paths;

generate an NC group from a set of incoming packets, wherein the NC group comprises a set of network coded packets to achieve the reliability target; and

route individual subsets from the NC group to the respective network paths according to the traffic distribution strategy.

2. The edge compute node of claim 1 , wherein, to generate the NC group, the processor circuitry is to:

apply NC to packets in the set of incoming packets to produce the set of network coded packets in the NC group.

3. The edge compute node of claim 1 , wherein the processor circuitry is further to:

determine a code rate for encoding the set of incoming packets based on a ratio of the NC group size to a total number of network coded packets in the NC group.

4. The edge compute node of claim 1 , wherein the NC group size is a first NC group size among a plurality of NC group sizes, the traffic distribution strategy is a first traffic distribution strategy, and the processor circuitry is further to:

determine a respective traffic distribution strategy of a plurality of traffic distribution strategies for each NC group size of the plurality of NC group sizes based on the per path characteristics, a corresponding NC group size of the plurality of NC group sizes, and the reliability target.

5. The edge compute node of claim 4 , wherein the processor circuitry is further to:

perform header inspection on the set of packets to determine a packet identifier of the set of incoming packets associated with a reliability flow, wherein the packet identifier is one or more of a source node network address, a destination node network address, an ingress port number, an egress port number, and a quality of service (QOS) flow identifier.

6. The edge compute node of claim 5 , wherein the processor circuitry is further to:

perform automatic burst size detection based on a burst time spread parameter, wherein the burst time spread parameter specifies a maximum arrival time difference between a first packet of a burst of packets and a last packet of the burst of packets, wherein, to perform the automatic burst size detection, the processor circuitry is to:

determine a burst size by counting a number of incoming packets of the set of incoming packets arriving within a time window after arrival of the first packet of the burst of packets, wherein the time window has a same size as the burst time spread parameter;

select a traffic distribution strategy from the plurality of traffic distribution strategies based on the determined burst size; and

when the set of incoming packets are systematic code packets, route incoming packets of the set of incoming packets arriving within the time window for transmission over one or more network paths of the set of network paths without performing NC on the incoming packets arriving within the time window.

7. The edge compute node of claim 1 , wherein the per path characteristics include:

an erasure probability for transmitting packets over individual network paths of the set of network paths; and

delay characteristics indicating an expected time required for sending a number of packets over the individual network paths of the set of network paths.

8. The edge compute node of claim 7 , wherein the processor circuitry is further to:

operate an optimizer to determine an optimal subset of network paths from among the set of network paths and an optimal number of network coded packets to belong to the individual subsets of the NC group.

9. The edge compute node of claim 8 , wherein the processor circuitry is further to:

operate the optimizer to derive a worst-case delay for the individual network paths of the set of network paths based on the erasure probability, the delay characteristics, the reliability target, and the NC group size, wherein the derived worst-case delay is a maximum amount of acceptable delay for delivering the set of network coded packets over the individual network paths that still meets the reliability target;

determine a burst size based on the NC group size; and

generate a mapping function mapping the worst-case delay to the burst size, wherein the mapping function is for determining admission control criteria for performing admission control.

10. The edge compute node of claim 9 , wherein the processor circuitry is further to:

perform admission control for bursty-arrival traffic with a fixed burst size and a burst interval, wherein the burst interval is based on the worst-case delay to the burst size mapping;

perform admission control for periodic-arrival traffic based on an arrival period of the periodic-arrival traffic and the burst size; and

perform the admission control for the bursty-arrival traffic or the periodic-arrival traffic using a leaky-bucket traffic pacing mechanism or a token-bucket traffic pacing mechanism.

11. The edge compute node of claim 8 , wherein the processor circuitry is further to:

determine, based on the collected metrics, a delay bound for the individual network paths of the set of network paths; and

operate the optimizer to:

determine, as the optimal subset of network paths, a most resource efficient subset of the set of network paths among various other subsets of network paths from the set of network paths;

determine a feasibility for the set of network coded packets based on the per path characteristics, the NC group size, the reliability target, and the delay bound; and

generate a feasibility indicator based on the determined feasibility, wherein a value of the feasibility indicator indicates whether sending traffic over the individual network paths is feasible or not.

12. The edge compute node of claim 11 , wherein:

the feasibility indicator includes a value of ‘true’ to indicate that sending traffic over the individual network paths is feasible, and the feasibility indicator includes a value of ‘false’ to indicate that sending traffic over the individual network paths is not feasible; or

the feasibility indicator includes a numeric value, wherein the numeric value being above a predetermined or configured threshold indicates that sending traffic over the individual network paths is feasible, and the numeric value being below the predetermined or configured threshold indicates that sending traffic over the individual network paths is not feasible.

13. The edge compute node of claim 11 , wherein the processor circuitry is further to:

perform admission control using the feasibility indicator, wherein performance of the admission control includes:

rejection of admission of the set of network coded packets when the value of the feasibility indicator indicates that sending traffic over the individual network paths is not feasible; and

admission of the set of network coded packets when the value of the feasibility indicator indicates that sending traffic over the individual network paths is feasible.

14. The edge compute node of claim 13 , wherein the processor circuitry is further to:

determine whether delivering individual subsets of the optimal subsets of network coded packets to be sent over respective ones of the optimal subset of network paths exceeds a reliability flow resource allocation threshold during a period that is within an inter-burst interval or the delay bound; and

reject admission of the set of network coded packets when delivering at least one of the optimal subsets exceeds the reliability flow resource allocation threshold during the period.

15. The edge compute node of claim 1 , wherein the one or more data sources include the set of NANs or the one or more user devices, and the metrics related to the multi-access communication network include access network measurements, wherein the access network measurements include one or more of reference signal received power (RSRP), reference signal received quality (RSRQ), received signal strength indicator (RSSI), received channel power indicator (RCPI), received signal to noise indicator (RSNI), average noise plus interference (ANPI), signal-to-noise ratio (SNR), signal-to-noise and interference ratio (SINR), expected peak data rate, end-to-end delay measurements, backhaul delay measurements, scheduling delay measurements, packet drop rate, and packet error ratio.

16. The edge compute node of claim 15 , wherein the metrics related to the multi-access environment further include capabilities indicated by one or more configurations, wherein the capabilities include one or more of QoS capabilities included in a QoS configuration, wireless local area network (WLAN) capabilities included in a WLAN configuration, and radio resource control (RRC) information included in a RRC configuration.

17. The edge compute node of claim 16 , wherein the metrics related to the multi-access environment further include application layer metrics, wherein the application layer metrics include one or more of priority indicators for data flows, QoS requirements of the data flows, wherein the QoS requirements include one or more of the reliability target, a latency bound, a minimum guaranteed bit rate, and a maximum burst size.

18. The edge compute node of claim 17 , wherein the metrics related to the multi-access environment further include data plane telemetry metrics, wherein the data plane telemetry metrics include one or more of traffic volume estimates of reliability flows, traffic volume estimates of non-reliability flows, flow path and latency metrics, packet drop metrics, traffic congestion metrics, platform load metrics, and application load metrics.

19. One or more non-transitory computer readable media (NTCRM) comprising instructions for operating a reliability enhancement engine (REE), wherein execution of the instructions by one or more processors of a compute node is to cause the compute node to operate the REE to:

collect metrics related to a multi-access communication network from one or more data sources within the multi-access communication network, wherein the one or more data sources include a set of network access nodes (NANs) in the multi-access communication network or one or more user devices connected to the set of NANs;

determine, based on the collected metrics, a reliability target, a network coding (NC) group size, and per path characteristics for each network path of a set of network paths in the multi-access communication network;

determine a traffic distribution strategy based on the per path characteristics, the NC group size, and the reliability target;

generate an NC group from a set of incoming packets, wherein the NC group comprises a set of network coded packets to achieve the reliability target; and

route individual subsets from the NC group to respective network paths of the set of network paths according to the traffic distribution strategy.

20. The one or more NTCRM of claim 19 , wherein execution of the instructions is to cause the compute node to operate the REE to:

determine a number of available transmission units on each network path of the set of network paths;

perform NC on the set of incoming packets to obtain the set of network coded packets; and

deliver the individual subsets of the set of network coded packets to the respective network paths of the set of network paths.

21. The one or more NTCRM of claim 19 , wherein, to determine the number of available transmission units on each network path, execution of the instructions is to cause the compute node to operate the REE to:

calculate a number of independently transmitted packets supported on each network path within a transmission delay bound of the set of incoming packets.

22. The one or more NTCRM of claim 19 , wherein, to perform NC on the set of incoming packets and deliver the individual subsets to the respective network paths, execution of the instructions is to cause the compute node to operate the REE to:

group a succession of the set of incoming packets, wherein a length of the succession of the set of incoming packets is specified by a predefined NC configuration;

determine a number of network coded packets in the set of network coded packets to be generated from each grouping of the incoming packets;

determine respective sizes of corresponding subsets of the individual subsets to be delivered to the respective network paths;

generate the individual subsets from each grouping of the incoming packets according to the NC configuration and a total number of network coded packets in the set of network coded packets; and

deliver the individual subsets to the respective network paths according to the respective sizes.

23. The one or more NTCRM of claim 22 , wherein, to determine the respective sizes of the corresponding subsets, execution of the instructions is to cause the compute node to operate the REE to:

operate an optimizer to determine the respective sizes of the corresponding subsets based on the NC group size, the reliability target, an erasure probability of the respective network paths, a spectral efficiency of the respective network paths, and a number of available transmission units.

24. The one or more NTCRM of claim 23 , wherein execution of the instructions is to cause the compute node to operate the REE to:

determine a score for each network path of the set of network paths based on the erasure probability of a corresponding one of each network path, a spectral efficiency of the corresponding one of each network path, the NC group size, and the reliability target;

generate a preference order for each of the respective network paths according to the score of each network path; and

operate the optimizer to determine the respective sizes of the corresponding subsets further based on the preference order.

25. The one or more NTCRM of claim 24 , wherein execution of the instructions is to cause the compute node to operate the REE to:

operate the optimizer to determine the respective sizes of the corresponding subsets according to a greedy-type algorithm using the preference order, wherein the greedy-type algorithm is a line-search greedy algorithm or a binary-search greedy algorithm; and

apply a recursive final-unit adjustment procedure to a result of the greedy-type algorithm.

26. The one or more NTCRM of claim 19 , wherein the REE is part of a multi-access traffic manager (MA-TM), and the compute node is an edge compute node.

27. The one or more NTCRM of claim 26 , wherein:

the MA-TM is part of an edge platform of an edge compute node, and the REE is an edge app operated by the edge compute node; or

the REE and the MA-TM are implemented as respective edge applications (apps) of an edge compute node.

28. The one or more NTCRM of claim 26 , wherein:

the edge compute node is a Multi-Access Edge Computing (MEC) server of a MEC framework, and the REE is implemented as a MEC app configured to be operated by a MEC platform of the MEC server;

the edge compute node is a Multi-Access Management Services (MAMS) server or a MAMS client of a MAMS framework, and the REE is implemented as a Network Connection Manager (NCM) configured to be operated by the MAMS server or a Client Connection Manager (CCM) configured to be operated by the MAMS client;

the edge compute node is a Radio Access Network (RAN) intelligent controller (RIC) of an Open RAN Alliance (O-RAN) framework, and the REE is implemented as an xApp configured to be operated by the RIC;

the edge compute node is a central unit (CU) of a CU/distributed unit (DU)-split architecture of a next generation (NG)-RAN architecture of a third generation partnership project (3GPP) cellular network, and the REE is implemented as a network function (NF) configured to be operated by the CU; or

the edge compute node is an Edge Enabler Server (EES) or an Edge Configuration Server (ECS) of a 3GPP edge computing architecture, and the REE is implemented as an Edge Application Servers (EAS) configured to be operated by the EES or the ECS.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2021
From: YEH, SHU-PING; MAO, WEI; NIKOPOUR, HOSEIN; TALWAR, SHILPA; NARASIMHA, MURALI; BAI, JINGWEN
To: INTEL CORPORATION
Reel/Frame 058390/0279 →
Continuity (1)
Related Publication 20220109622A1 · Apr 7, 2022
References Cited (64)
US 20150029879A1 · Chou · 2015 [cited by examiner]
US 20220150769A1 · Vivanco · 2022 [cited by examiner]
US 20220338208A1 · Chen · 2022 [cited by examiner]
US 20230092997A1 · Mody · 2023 [cited by examiner]
WO WO2021201933A1 · 2021 [cited by examiner]
Jing Zhu, Multi-access Traffic Management at the Edge, Sep. 2020, 3 Pages, https://www.intel.com/content/www/us/en/research/blogs/multi-access-traffic-management-edge.html (Year: 2020). [cited by examiner]
“3rd Generation Partnership Project; Technical Specification Group Radio Access Network; NG-RAN; Architecture description (Release 16)”, 3GPP TS 38.401 V16.6.0, 79 pages (Jul. 1, 2021). [cited by applicant]
“O-RAN Operations and Maintenance Interface Specification”, O-RAN.WG1.O1-Interface.0-v04.00, O-RAN Alliance, 66 pages (Nov. 2020). [cited by applicant]
“O-RAN Operations and Maintenance Architecture”, O-RAN.WG1.OAM-Architecture-v04.00 2020, O-RAN Alliance, 54 pages (Nov. 2020). [cited by applicant]
“O-RAN Architecture Description”, O-RAN.WG1.O-RAN-Architecture-Description-v04.00, O-RAN Alliance, 33 pages (Mar. 2021). [cited by applicant]
“O-RAN Working Group 3, Near-Real-time RAN Intelligent Controller, E2 Application Protocol (E2AP)”, O-RAN.WG3.E2AP-v01.01, O-RAN Alliance, 84 pages (Jul. 2020). [cited by applicant]
“O-RAN Fronthaul Working Group Control, User and Synchronization Plane Specification”, O-RAN.WG4.CUS.0-v06.00, O-RAN Alliance, 298 pages (Mar. 2021). [cited by applicant]
O-Ran Alliance, “O-RAN Fronthaul Working Group Control, User and Synchronization Plane Specification”, O-RAN.WG4.CUS.0-v06.00, O-RAN Alliance, 298 pages (Mar. 2021). [cited by applicant]
O-Ran Alliance, “Cloud Architecture and Deployment Scenarios for O-RAN Virtualized RAN”, O-RAN.WG6.CAD-v02.01, O-RAN Alliance, 52 pages (Jul. 2020). [cited by applicant]
“O-RAN Working Group 3 Near-Real-time RAN Intelligent Controller E2 Service Model (E2SM) KPM”, ORAN-WG3.E2SM-KPM-v01.00.00, O-RAN Alliance, 44 pages (Feb. 2020). [cited by applicant]
“O-RAN Working Group 3 Near-Real-time RAN Intelligent Controller E2 Service Model (E2SM), RAN Function Network Interface (NI)”, ORAN-WG3.E2SM-NI-v01.00.00, O-RAN Alliance, 44 pages (Feb. 2020). [cited by applicant]
“O-RAN Working Group 3 Near-Real-time RAN Intelligent Controller”, ORAN-WG3.E2SM-v01.00.00, O-RAN Alliance, 27 pages (Feb. 2020). [cited by applicant]
Changhoon Kim et al., “Barefoot Networks Advanced Data-Plane Telemetry”, One Connect, 23 pages (Dec. 2018). [cited by applicant]
Erik Chromy et al., “Admission Control Methods in IP Networks”, Advances in Multimedia, vol. 2013, Article ID 918930, 7 pages (2013), https://doi.org/10.1155/2013/918930. [cited by applicant]
Shu Fan et al., “Cross-Layer Control with Worst Case Delay Guarantees in Multihop Wireless Networks”, Journal of Electrical and Computer Engineering, vol. 2016, Article ID 5762851, 11 pages (Oct. 10, 2016), https://www.… [cited by applicant]
3GPP, “3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; System architecture for the 5G System (5GS); Stage 2 (Release 17)”, 3GPP TS 23.501 v17.2.0, 542 pages (Sep. 24, 2021). [cited by applicant]
3GPP, “3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Architecture for enabling Edge Applications; (Release 17)”, 3GPP TS 23.558 v17.1.0, 162 pages (Sep. 24, 2021). [cited by applicant]
3GPP, “3rd Generation Partnership Project; Technical Specification Group Radio Access Network; Evolved Universal Terrestrial Radio Access (E-UTRA); LTE/WLAN Radio Level Integration Using IPsec Tunnel (LWIP) encapsulatio… [cited by applicant]
3GPP, “3rd Generation Partnership Project; Technical Specification Group Radio Access Network; Evolved Universal Terrestrial Radio Access (E-UTRA) and NR; Multi-connectivity; Stage 2 (Release 16)”, 3GPP TS 37.340 v16.7.… [cited by applicant]
3GPP, “3rd Generation Partnership Project; Technical Specification Group Radio Access Network; NG-RAN; Architecture description (Release 16)”, 3GPP TS 38.401 v16.7.0, 79 pages (Oct. 1, 2021). [cited by applicant]
Kok-Lim Alvin Yau et al., “Application of Reinforcement Learning in Cognitive Radio Networks: Models and Algorithms”, 2014, 24 pages, The Scientific World Journal, vol. 2014, Article ID 209810. [cited by applicant]
Volodymyr Mnih et al, “Human-level control through deep reinforcement learning”, Feb. 26, 2015, 13 pages, vol. 518. [cited by applicant]
Julien Perez et al, “Utility-based Reinforcement Learning for Reactive Grids”, May 2008, 10 pages, The 5th IEEE International Conference on Autonomic Computing, Chicago, USA. [cited by applicant]
Max Pumperla et a., “Deep Learning and the Game of Go”, 2019, 22 pages. [cited by applicant]
David Silver et al., “Deterministic Policy Gradient Algorithms”, 2014, 9 pages, Proceedings of the 31st International Conference on Machine Learning, Beijing, China, 2014. JMLR: W&CP vol. 32. [cited by applicant]
Richard S. Sutton et al., “Reinforcement Learning: An Introduction”, Nov. 5, 2017, 445 pages, London, England. [cited by applicant]
Csaba Szepesvari, “Algorithms for Reinforcement Learning”, Jun. 9, 2009, 98 pages. [cited by applicant]
Yunhao Tang, “Introduction to Deep Learning with Tensorflow”, Feb. 25, 2019, 153 pages, Department of IEOR, Columbia University. [cited by applicant]
Huasen Wu et al.,“Adaptive Exploration-Exploitation Tradeoff for Opportunistic Bandits”, Nov. 30, 2018, 18 pages, arXiv:1709.04004v2 [cs.LG]. [cited by applicant]
Zhao et al., “Improving Worst-Case Delay Analysis for Traffic of Additional Stream Reservation Class in Ethernet-AVB Network”, Sensors 18, No. 11: 3849, 18 pages (Nov. 9, 2018), https://www.mdpi.com/1424-8220/18/11/3849… [cited by applicant]
Hunt et al., “Enhanced Utilization Telemetry for Polling Workloads with collectd and the Data Plane Development Kit (DPDK) User Guide”, Intel Corp., 14 pages (last updated: Aug. 19, 2020) https://networkbuilders.intel.c… [cited by applicant]
“In-band Network Telemetry (INT) Dataplane Specification Version 2.1”, The P4.org Applications Working Group, 56 pages (Nov. 22, 2020), https://p4.org/p4-spec/docs/INT_v2_1.pdf. [cited by applicant]
Johnson et al., “NexRAN: Closed-loop RAN slicing in Powder—A top-to-bottom open-source open-RAN use case”, The 15th ACM Workshop on Wireless Network Testbeds, Experimental evaluation & CHaracterization (WiNTECH), pp. 17… [cited by applicant]
Milić et al., “New Concepts of Asynchronous Circuits Worst-Case Delay and Yield Estimation”, Micro Electronic and Mechanical Systems, Ch. 25, Kenichi Takahata (ed.), IntechOpen, 24 pages (Dec. 1, 2009), https://www.inte… [cited by applicant]
Yaguang Yang, “A Flow Network Model for Software Reliability Assessment”, Sixth American Nuclear Society International Topical Meeting on Nuclear Plant Instrumentation, Control, and Human-Machine Interface Technologies … [cited by applicant]
Michael J. Neely, “Opportunistic Scheduling with Worst Case Delay Guarantees in Single and Multi-Hop Networks”, Proceedings IEEE INFOCOM, 2011, pp. 1728-1736 (Apr. 10, 2011), https://ee.usc.edu/stochastic-nets/docs/wc-d… [cited by applicant]
Henry D. Pfister, “A Short Introduction to Channel Coding”, Supplemental Material for Graphical Models and Inference, 21 pages (Sep. 15, 2015), http://pfister.ee.duke.edu/courses/ece590_gmi/coding_intro.pdf. [cited by applicant]
Prof. John A. Stankovic et al., “Admission Control, Reservation, and Reflection in Operating Sytsems”, Appeared in IEEE Bulletin of the Technical Committee on Operating Systems and Application Environments (TCOS), vol. … [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; System architecture for the 5G System (5GS); Stage 2 (Release 17)”, 3GPP TS 23.501 v17.3.0, 559 pages (Dec. 23, 2021). [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Management and orchestration; Concepts, use cases and requirements (Release 17)” 3GPP TS 28.530 v17.2.0, 37 pages (Dec. 23,… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Management and orchestration; Performance assurance (Release 16)”, 3GPP TS 28.550 v16.8.0, 85 pages (Sep. 23, 2021). [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Telecommunication management; Performance Management (PM); Concept and requirements (Release 16)”, 3GPP TS 32.401 v16.0.0, … [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Telecommunication management; Subscriber and equipment trace; Trace concepts and requirements (Release 17)”, 3GPP TS 32.421… [cited by applicant]
“Zero-touch network and Service Management (ZSM); Reference Architecture”, ETSI GS ZSM 002 V1.1.1, 80 pages (Aug. 2019). [cited by applicant]
X. Geng et al., “5G End-to-end Network Slice Mapping from the view of Transport Network”, IETF, draft-geng-teas-network-slice-mapping-04, 19 pages (Oct. 25, 2021), https://www.ietf.org/archive/id/draft-geng-teas-network… [cited by applicant]
A. Farrel et al., “Framework for IETF Network Slices”, IETF, draft-ietf-teas-ietf-network-slices-05, 40 pages (Oct. 25, 2021), https://www.ietf.org/archive/id/draft-ietf-teas-ietf-network-slices-05.txt. [cited by applicant]
Mnavarro,“Architecture”, ONAP Developer Wiki, 4 pages (Jul. 26, 2019; retrieved on Dec. 23, 2021), https://wiki.onap.org/display/DW/Architecture. [cited by applicant]
Lillicrap et al., “Continuous Control With Deep Reinforcement Learning”, arXiv:1509.02971v6 [cs.LG], London, U.K., 14 pages (Jul. 5, 2019). [cited by applicant]
Langford et al., “The Epoch-Greedy Algorithm for Multi-armed Bandits with Side Information”, Advances in Neural Information Processing Systems (NIPS), vol. 20, 8 pages (2007), https://papers.nips.cc/paper/2007/file/4b04… [cited by applicant]
Konda et al., “Actor-Critic Algorithms”, Advances in Neural Information Processing Systems (NIPS), vol. 12, pp. 1008-1014 (2000). [cited by applicant]
Konda, “Actor-Critic Algorithms”, MIT PhD Thesis, 147 pages (Jun. 2002). [cited by applicant]
Toro Icarte et al., “Reward Machines: Exploiting Reward Function Structure in Reinforcement Learning”, arXiv:2010.03950v1 [cs.LG], 31 pages (Oct. 6, 2020). [cited by applicant]
Dalal et al., “Safe Exploration in Continuous Action Spaces”, arXiv:1801.08757v1, 9 pages (Jan. 26, 2018). [cited by applicant]
Wirth et al., “Model-Free Preference-Based Reinforcement Learning”, Proceedings of the Thirtieth Association for the Advancement of Artificial Intelligence (AAAI-16), Germany, pp. 2222-2228 (Mar. 2, 2016), https://www.a… [cited by applicant]
Agrawal, “Reinforcement Learning: Lecture Notes, Spring 2019”, Columbia University IEOR 8100, 104 pages (2019). [cited by applicant]
Bengio et al., “Learning Long-Term Dependencies with Gradient Descent is Difficult”, IEEE Transactions on Neural Networks, vol. 5, No. 2, pp. 157-166 (Mar. 1994). [cited by applicant]
Bengio et al.,“Representation Learning: A Review and New Perspectives”, arXiv:1206.5538v3 [cs.LG], 30 pages (Apr. 23, 2014). [cited by applicant]
Chia-Yu Chang, “Cloudification and Slicing in 5G Radio Access Network”, Networking and Internet Architecture [cs.NI], Sorbonne Université, 2018, NNT: 2018SORUS293, HAL id: tel-02501244, version 1, 227 pages (Mar. 6, 202… [cited by applicant]
Coronado et al., “Zero Touch Management: A Survey of Network Automation Solutions for 5G and 6G Networks”, IEEE Communications Survey s & Tutorials, vol. 24, No. 4, Fourth Quarter, pp. 2535-2578, 44 pages, (2022). [cited by applicant]
Cited By (2)
US 12,580,840 US 12,701,436