IP Library Granted Patent US 11,886,259
Granted Patent B2
US 11,886,259 · App. 17/499,757 · Granted Jan 30, 2024

Thermal management for extended reality ecosystem

Inventors: Bardia Zandian (Redwood City, CA); Eugene Gorbatov (Sammamish, WA); Pankaj Raghuvanshi (San Jose, CA); Shrirang Madhav Yardi (San Jose, CA)
Assignee: Meta Platforms Technologies, LLC
G06F1/206G06F1/163G06T15/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,886,259
App. No.
17/499,757
Granted
Jan 30, 2024
Kind
B2
Abstract

A method by a computing system associated with a set of disjoint devices that includes at least one wearable device includes receiving a request to perform a task. The method further includes determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices. The method further includes determining a plurality of workload assignments needed to be performed to accomplish the task. The method further includes distributing, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices. The method further includes performing the task by causing the one or more devices to execute the distributed plurality of work assignments.

Claims (49)

1. A method comprising, by a computing system associated with a set of disjoint devices that includes at least one wearable device:

receiving a request to perform a task;

determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices, wherein determining the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between a predetermined thermal design power (TDP) limit and an estimation of a current power consumption for each device;

determining a plurality of workload assignments needed to be performed to accomplish the task;

distributing, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and

performing the task by causing the one or more devices to execute the distributed plurality of work assignments.

2. The method of claim 1 , wherein determining the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between the predetermined TDP limit and the current power consumption based at least in part on a head pose or an object pose associated with the at least one wearable device.

3. The method of claim 1 , wherein determining, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices comprises determining the thermal constraint differential at runtime.

4. The method of claim 1 , wherein, prior to determining the plurality of workload assignments needed to be performed to accomplish the task, the method further comprises:

determining one or more execution parameters associated with an application corresponding to the task to be performed; and

estimating, based on the one or more execution parameters associated with the application, a power consumption of the plurality of workload assignments.

5. The method of claim 4 , further comprising:

determining the plurality of workload assignments based on the thermal constraint differential and the estimation of the power consumption of the plurality of workload assignments.

6. The method of claim 5 , wherein a number of the plurality of workload assignments is greater than a number of the one or more devices of the set of disjoint devices.

7. The method of claim 1 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the method further comprising:

determining, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and

redistributing, based on the second thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices, wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

8. The method of claim 1 , wherein the one or more power or thermal constraints comprises a device processing speed, a device storage capacity, a device thermal rating, or a device power rating.

9. A computing system associated with a set of disjoint devices that includes at least one wearable device, one or more devices of the set of disjoint devices including:

one or more non-transitory computer-readable storage media including instructions; and

one or more processors coupled to the one or more non-transitory computer-readable storage media, the one or more processors configured to execute the instructions to:

receive a request to perform a task;

determine, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices, wherein determining the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between a predetermined thermal design power (TDP) limit and an estimation of a current power consumption for each device;

determine a plurality of workload assignments needed to be performed to accomplish the task;

distribute, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and

perform the task by causing the one or more devices to execute the distributed plurality of work assignments.

10. The computing system of claim 9 , wherein the instructions to determine the thermal-constraint differential for each device of the set of disjoint devices further comprise instructions to determine a difference between the predetermined TDP limit and the current power consumption based at least in part on a head pose or an object pose associated with the at least one wearable device.

11. The computing system of claim 9 , wherein the instructions to determine, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices further comprises instructions to determine the thermal constraint differential at runtime.

12. The computing system of claim 9 , wherein, prior to determining the plurality of workload assignments needed to be performed to accomplish the task, the instructions further comprise instructions to:

determine one or more execution parameters associated with an application corresponding to the task to be performed; and

estimate, based on the one or more execution parameters associated with the application, a power consumption of the plurality of workload assignments.

13. The computing system of claim 12 , wherein the instructions further comprise instructions to:

determine the one or more rendering workload assignments to be performed by the set of disjoint devices based on the thermal constraint differential and the estimation of the power consumption of the rendering workload associated with rendering the frame.

14. The computing system of claim 13 , wherein a number of the plurality of workload assignments is greater than a number of the one or more devices of the set of disjoint devices.

15. The computing system of claim 9 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the instructions further comprising instructions to:

determine, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and

redistribute, based on the second thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices, wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

16. The computing system of claim 9 , wherein the one or more power or thermal constraints comprises a device processing speed, a device storage capacity, a device thermal rating, or a device power rating.

17. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of one or more devices of a set of disjoint devices that includes at least one wearable device, cause the one or more processors to:

receive a request to perform a task;

determine, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices, wherein determining the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between a predetermined thermal design power (TDP) limit and an estimation of a current power consumption for each device;

determine a plurality of workload assignments needed to be performed to accomplish the task;

distribute, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and

perform the task by causing the one or more devices to execute the distributed plurality of work assignments.

18. The non-transitory computer-readable medium of claim 17 , wherein the instructions to determine the thermal-constraint differential for each device of the set of disjoint devices further comprise instructions to determine a difference between the predetermined TDP limit and the current power consumption based at least in part on a head pose or an object pose associated with the at least one wearable device.

19. The non-transitory computer-readable medium of claim 17 , wherein the instructions to determine, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices further comprises instructions to determine the thermal constraint differential at runtime.

20. The non-transitory computer-readable medium of claim 17 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the instructions further comprising instructions to:

determine, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and

redistribute, based on the second thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices, wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

Assignments (2)
CHANGE OF NAME Recorded Jul 6, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060591/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2021
From: ZANDIAN, BARDIA; GORBATOV, EUGENE; RAGHUVANSHI, PANKAJ; YARDI, SHRIRANG MADHAV
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 058025/0010 →