IP Library › Granted Patent US 11,412,052
Granted Patent B2
US 11,412,052 · App. 16/235,137 · Granted Aug 9, 2022

Quality of service (QoS) management in edge computing environments

Inventors: Francesc Guim Bernat (Barcelona, ES); Patrick Bohan (Portland, OR); Kshitij Arun Doshi (Tempe, AZ); Brinda Ganesh (Portland, OR); Andrew J. Herdrich (Hillsboro, OR); Monica Kenguva (Phoenix, AZ); Karthik Kumar (Chandler, AZ); Patrick G Kutch (Tigard, OR); Felipe Pastor Beneyto (Holmdel, NJ); Rashmin Patel (Chandler, AZ); Suraj Prabhakaran (Aachen, DE); Ned M. Smith (Beaverton, OR); Petar Torre (Feldkirchen, DE); Alexander Vul (San Jose, CA)
Assignee: Intel Corporation
H04L67/148G06F9/4856H04L41/5019H04L43/0811H04L47/82H04L67/10H04L67/34H04W4/40H04W4/70H04L41/5003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,412,052
App. No.
16/235,137
Granted
Aug 9, 2022
Kind
B2
Abstract

An architecture to perform resource management among multiple network nodes and associated resources is disclosed. Example resource management techniques include those relating to: proactive reservation of edge computing resources; deadline-driven resource allocation; speculative edge QoS pre-allocation; and automatic QoS migration across edge computing nodes. In a specific example, a technique for service migration includes: identifying a service operated with computing resources in an edge computing system, involving computing capabilities for a connected edge device with an identified service level; identifying a mobility condition for the service, based on a change in network connectivity with the connected edge device; and performing a migration of the service to another edge computing system based on the identified mobility condition, to enable the service to be continued at the second edge computing apparatus to provide computing capabilities for the connected edge device with the identified service level.

Claims (99)

1. An edge computing apparatus, comprising:

processing circuitry; and

a memory device including instructions embodied thereon, wherein the instructions, which when executed by the processing circuitry, configure the processing circuitry to perform operations to:

identify a service operated with computing resources of the edge computing apparatus, the service providing computing capabilities for a connected edge device with an identified service level;

identify a mobility condition for the service, based on a change in network connectivity from the edge computing apparatus to the connected edge device;

determine whether a second edge computing apparatus supports a capability of a trusted execution environment (TEE) of a computing resource of the edge computing apparatus;

responsive to a determination that the second edge computing apparatus supports the capability of the TEE, perform a migration of the service using a migration interface to the second edge computing apparatus, based on the identified mobility condition, wherein the service is continued at the second edge computing apparatus to provide computing capabilities for the connected edge device with the identified service level, wherein the migration interface is adapted to access the computing resource of the edge computing apparatus that contains the trusted execution environment (TEE), wherein the TEE is used to assist the migration of the service, wherein to assist the migration of the service, the TEE conditionally allows the computing resource access to a function, a sensor input, and code, and wherein the TEE conditionally allows the computing resource to access the function, the sensor input, and the code according to a type of the TEE and a strength of protection offered by the TEE; and

responsive to a determination that the second edge computing device does not support the capability of the TEE:

locate a security equivalent edge computing apparatus to which the service can be migrated, wherein to locate a security equivalent edge computing apparatus includes use of an orchestrator policy that defines an acceptable mapping and a security level; and

migrate the service to the security equivalent edge computing apparatus.

2. The apparatus of claim 1 , the instructions further to perform operations to:

proactively reserve resources for the service at the second edge computing apparatus, prior to migration of the service, wherein the resources are reserved to enable migration of the service with uninterrupted use of the reserved resources at the second edge computing device.

3. The apparatus of claim 2 , wherein the operations to proactively reserve resources include operations to:

identify usage of the service and the resources used for the service at the edge computing apparatus;

receive location updates from the connected edge device;

predict locations of the connected edge device and predict usage of the service by the connected edge device at the predicted locations, based on the location updates and the identified usage; and

communicate, to the second edge computing apparatus, the predicted locations and usage of the connected edge device, wherein the predicted locations and the predicted usage of the service are used to reserve the resources at the second edge computing apparatus prior to the migration of the service.

4. The apparatus of claim 3 , wherein the service is one of a plurality of services that are identified and migrated to the second edge computing apparatus by proactively reserving the resources, wherein the plurality of services are associated with a respective plurality of service levels including the identified service level, and wherein the services are initiated at differing times based on the respective plurality of service levels.

5. The apparatus of claim 1 , the instructions further to perform operations to:

allocate resources for the service at the second edge computing apparatus, based on a deadline associated with resource usage of the service, wherein the resources are pre-allocated to enable migration of the service with uninterrupted use at the second edge computing apparatus, and wherein the migration of the service occurs based on the deadline.

6. The apparatus of claim 5 , wherein the operations to allocate resources based on the deadline include operations to:

identify usage of the service and the resources allocated for the service at the edge computing apparatus;

identify the deadline and constraints involved in the operation of the service, based on the usage of the service and the resources allocated for the service at the edge computing apparatus, and based on the mobility condition; and

communicate, to the second edge computing apparatus, data indicating the deadline and constraints, wherein the data indicating the deadline and constraints is used to reserve resources at the second edge computing apparatus prior to the migration of the service.

7. The apparatus of claim 6 , wherein the constraints involved in the operation of the service involves a priority of execution operations for the service, and wherein the identified usage of the service and the resources used for the service is based at least in part on predicted usage of the service by the connected edge device.

8. The apparatus of claim 1 , the instructions further to perform operations to:

perform speculative allocation of resources among a plurality of edge computing apparatuses including the second edge computing apparatus and a third edge computing apparatus, wherein the second edge computing apparatus is located along a first mobility path and the third edge computing apparatus is located along a second mobility path.

9. The apparatus of claim 8 , wherein the operations to perform the speculative allocation of resources include operations to:

identify multiple potential mobility location paths and potential computing nodes for use of the service by the connected edge device, the mobility location paths including the first and second mobility path, wherein the potential computing nodes include the second and third edge computing apparatuses;

forecast future resource needs for execution of the service;

forecast a probability and estimated time of usage of the service at the potential computing nodes, according to the forecasted future resource needs; and

communicate service pre-allocation information among the potential computing nodes in the potential mobility location paths;

wherein the service pre-allocation information is used for the speculative allocation of resources along respective nodes in the potential mobility location paths; and

wherein the migration of the service to the second edge computing apparatus occurs based on movement of the connected edge device to the first mobility path.

10. The apparatus of claim 9 , wherein the operations to perform the speculative allocation of resources further include operations to:

perform a cleanup of resources of the potential computing nodes along one or more unselected paths, including operations to communicate service deallocation information to the third edge computing apparatus.

11. The apparatus of claim 1 , the instructions further to perform operations to:

initiate the migration of the service automatically, according to a quality of service (QoS) criteria, wherein the QoS criteria is determined from the resources and capabilities required for service operation at the edge computing apparatus and at the second edge computing apparatus.

12. The apparatus of claim 11 , wherein the operations to initiate the migration of the service automatically include operations to:

identify the resources and the capabilities required for the service operation;

identify a platform configuration for the service used at the edge computing apparatus, to accomplish the resources and the capabilities required for the service operation; and

communicate the platform configuration from the edge computing apparatus to the second edge computing apparatus, wherein the platform configuration is adapted for use with the second edge computing apparatus;

wherein the service is operated with the adapted platform configuration to achieve the QoS criteria for the service.

13. The apparatus of claim 1 , wherein to assist the migration of the service, the TEE further conditionally allows the computing resource access to data.

14. The apparatus of claim 1 , wherein when no acceptable mapping and security level is available, the service is not migrated.

15. A method, performed by an edge computing apparatus operated in a mobility network, comprising:

evaluating data for a service operated with computing resources of the edge computing apparatus, the service providing computing capabilities for a connected edge device with an identified service level;

detecting a mobility condition for the service, based on a change in network connectivity from the edge computing apparatus to the connected edge device;

determining whether a second edge computing apparatus supports a capability of a trusted execution environment (TEE) of a computing resource of the edge computing apparatus;

responsive to a determination that the second edge computing apparatus supports the capability of the TEE, performing a migration of the service using a mitigation interface to the second edge computing apparatus, based on the detected mobility condition, wherein the service is continued at the second edge computing apparatus to provide computing capabilities for the connected edge device with the identified service level, wherein the migration interface is adapted to access the computing resource of the edge computing apparatus that contains the TEE, wherein the TEE is used to assist the migration of the service, wherein to assist the migration of the service, the TEE conditionally allows the computing resource access to a function, a sensor input, and code, and wherein the TEE conditionally allows the computing resource to access the function, the sensor input, and the code according to a type of the TEE and a strength of protection offered by the TEE; and

responsive to a determination that the second edge computing device does not support the capability of the TEE:

locate a security equivalent edge computing apparatus to which the service can be migrated, wherein to locate a security equivalent edge computing apparatus includes use of an orchestrator policy that defines an acceptable mapping and a security level; and

migrate the service to the security equivalent edge computing apparatus.

16. The method of claim 15 , further comprising:

proactively reserving resources for the service at the second edge computing apparatus, prior to migration of the service, wherein the resources are reserved to enable migration of the service with uninterrupted use of the reserved resources at the second edge computing device.

17. The method of claim 16 , wherein proactively reserving resources comprises:

identifying usage of the service and the resources used for the service at the edge computing apparatus;

receiving location updates from the connected edge device;

predicting locations of the connected edge device and predict usage of the service by the connected edge device at the predicted locations, based on the location updates and the identified usage; and

communicating, to the second edge computing apparatus, the predicted locations and usage of the connected edge device, wherein the predicted locations and the predicted usage of the service are used to reserve the resources at the second edge computing apparatus prior to the migration of the service.

18. The method of claim 17 , wherein the service is one of a plurality of services that are identified and migrated to the second edge computing apparatus by proactively reserving the resources, wherein the plurality of services are associated with a respective plurality of service levels including the identified service level, and wherein the services are initiated at differing times based on the respective plurality of service levels.

19. The method of claim 15 , further comprising:

allocating resources for the service at the second edge computing apparatus, based on a deadline associated with resource usage of the service, wherein the resources are pre-allocated to enable migration of the service with uninterrupted use at the second edge computing device, and wherein the migration of the service occurs based on the deadline.

20. The method of claim 19 , wherein allocating resources based on the deadline comprises:

identifying usage of the service and the resources allocated for the service at the edge computing apparatus;

identifying the deadline and constraints involved in operation of the service, based on the usage of the service and the resources allocated for the service at the edge computing apparatus, and based on the mobility condition; and

communicating, to the second edge computing apparatus, data indicating the deadline and constraints, wherein the data indicating the deadline and constraints is used to reserve resources at the second edge computing apparatus prior to the migration of the service.

21. The method of claim 20 , wherein the constraints involved in operation of the service involves a priority of execution operations for the service, and wherein the identified usage of the service and the resources used for the service is based at least in part on predicted usage of the service by the connected edge device.

22. The method of claim 15 , further comprising:

performing speculative allocation of resources among a plurality of edge computing apparatuses including the second edge computing apparatus and a third edge computing apparatus, wherein the second edge computing apparatus is located along a first mobility path and the third edge computing apparatus is located along a second mobility path.

23. The method of claim 22 , wherein performing the speculative allocation of resources further comprises:

identifying multiple potential mobility location paths and potential computing nodes for use of the service by the connected edge device, the mobility location paths including the first and second mobility path, wherein the potential computing nodes include the second and third edge computing apparatuses;

forecasting future resource needs for execution of the service;

forecasting a probability and estimated time of usage of the service at the potential computing nodes, according to the forecasted future resource needs; and

communicating service pre-allocation information among the potential computing nodes in the potential mobility location paths;

wherein the service pre-allocation information is used for the speculative allocation of resources along respective nodes in the potential mobility location paths; and

wherein the migration of the service to the second edge computing apparatus occurs based on movement of the connected edge device to the first mobility path.

24. The method of claim 23 , wherein performing the speculative allocation of resources further comprises:

performing a cleanup of resources of the potential computing nodes along one or more unselected paths, including operations to communicate service deallocation information to the third edge computing apparatus.

25. The method of claim 15 , further comprising:

initiating the migration of the service automatically, according to a quality of service (QoS) criteria, wherein the QoS criteria is determined from the resources and capabilities required for service operation at the edge computing apparatus and at the second edge computing apparatus, wherein initiating the migration of the service automatically further comprises:

identifying the resources and the capabilities required for the service operation;

identifying a platform configuration for the service used at the edge computing apparatus, to accomplish the resources and the capabilities required for the service operation; and

communicating the platform configuration from the edge computing apparatus to the second edge computing apparatus, wherein the platform configuration is adapted for use with the second edge computing apparatus;

wherein the service is operated with the adapted platform configuration to achieve the QoS criteria for the service.

26. A system, comprising:

a first edge computing node, the first edge computing node comprising processing circuitry to operate a migration function, the migration function configured to:

operate a service with computing resources of the first edge computing node, the service providing computing capabilities for a connected edge device with an identified service level;

identify a mobility condition for the service, based on a change in network connectivity from the first edge computing node to the connected edge device;

determine whether a second edge computing node supports a capability of a trusted execution environment (TEE) of a computing resource of the first edge computing node;

responsive to a determination that the second edge computing node supports the capability of the TEE, perform communications to initiate a migration of the service using a migration interface, and to communicate the identified service level for the service wherein the migration interface is adapted to access the computing resource of the first edge computing node that contains the TEE, wherein the TEE is used to assist the migration of the service, wherein to assist the migration of the service, the TEE conditionally allows the computing resource access to a function, a sensor input, and code, and wherein the TEE conditionally allows the computing resource to access the function, the sensor input, and the code according to a type of the TEE and a strength of protection offered by the TEE; and

responsive to a determination that the second edge computing device does not support the capability of the TEE:

locate a security equivalent edge computing node to which the service can be migrated, wherein to locate a security equivalent edge computing apparatus includes use of an orchestrator policy that defines an acceptable mapping and a security level; and

migrate the service to the security equivalent edge computing node;

the second edge computing node, the second edge computing node comprising processing circuitry to operate the migration function, the migration function configured to:

initiate a new instance of the service with computing resources of the second edge computing node, the service providing computing capabilities for the connected edge device with the identified service level; and

perform communications to receive the migration of the service, wherein the service is continued at the second edge computing node to provide computing capabilities for the connected edge device with the identified service level; and

the security equivalent edge computing node.

27. The system of claim 26 , wherein the first edge computing node and the second edge computing node are operated at respective computing resources at base stations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2019
From: GUIM BERNAT, FRANCESC; BOHAN, PATRICK; DOSHI, KSHITIJ ARUN; GANESH, BRINDA; HERDRICH, ANDREW J.; KENGUVA, MONICA; KUMAR, KARTHIK; KUTCH, PATRICK G; PASTOR BENEYTO, FELIPE; PATEL, RASHMIN; PRABHAKARAN, SURAJ; SMITH, NED M.; TORRE, PETAR; VUL, ALEXANDER
To: INTEL CORPORATION
Reel/Frame 050874/0936 →
Continuity (1)
Related Publication 20190158606A1 · May 23, 2019