IP Library › Granted Patent US 12,248,346
Granted Patent B1
US 12,248,346 · App. 18/525,102 · Granted Mar 11, 2025

Thermal management for extended reality ecosystem

Inventors: Bardia Zandian (Redwood City, CA); Eugene Gorbatov (Sammamish, WA); Pankaj Raghuvanshi (San Jose, CA); Shrirang Madhav Yardi (San Jose, CA)
Assignee: Meta Platforms Technologies, LLC
G06F1/206G06F1/163G06T15/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,248,346
App. No.
18/525,102
Granted
Mar 11, 2025
Kind
B1
Abstract

A method by a computing system associated with a set of disjoint devices that includes at least one wearable device includes receiving a request to perform a task. The method further includes determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices. The method further includes determining a plurality of workload assignments needed to be performed to accomplish the task. The method further includes distributing, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices. The method further includes performing the task by causing the one or more devices to execute the distributed plurality of work assignments.

Claims (44)

1. A method, by a computing system associated with a set of disjoint devices in an extended reality (XR) ecosystem that includes at least one XR device, comprising:

receiving a request to perform a task associated with providing XR content to a user;

determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices;

determining a plurality of workload assignments needed to be performed to accomplish the task, wherein the plurality of workload assignments is configured to be performed by one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and

performing the task by causing the one or more devices in the extended reality (XR) ecosystem to execute the plurality of workload assignments.

2. The method of claim 1 , wherein determining, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between a predetermined thermal design power (TDP) limit and a current power consumption.

3. The method of claim 1 , wherein determining, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices comprises determining the thermal constraint differential at runtime.

4. The method of claim 1 , further comprising:

determining one or more execution parameters associated with an application corresponding to the task to be performed; and

estimating, based on the one or more execution parameters associated with the application, a power consumption of the plurality of workload assignments.

5. The method of claim 1 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the method further comprising:

determining, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and

redistributing, based on the second thermal-constraint differential of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices.

6. The method of claim 5 , wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

7. The method of claim 1 , wherein a number of the plurality of workload assignments is greater than a number of the one or more devices of the set of disjoint devices.

8. A computing system associated with a set of disjoint devices in an extended reality (XR) ecosystem that includes at least one XR device, one or more devices of the set of disjoint devices including:

one or more non-transitory non-volatile computer-readable storage media including instructions; and

one or more processors coupled to the one or more non-transitory computer-readable storage media, the one or more processors configured to execute the instructions to:

receive a request to perform a task associated with providing XR content to a user;

determine, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices;

determine a plurality of workload assignments needed to be performed to accomplish the task, wherein the plurality of workload assignments is configured to be performed by one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and

perform the task by causing the one or more devices in the extended reality (XR) ecosystem to execute the plurality of workload assignments.

9. The computing system of claim 8 , wherein the instructions to determine, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices further comprise instructions to determine a difference between a predetermined thermal design power (TDP) limit and a current power consumption.

10. The computing system of claim 8 , wherein the instructions to determine, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices further comprises instructions to determine the thermal constraint differential at runtime.

11. The computing system of claim 8 , wherein the instructions further comprise instructions to:

determine one or more execution parameters associated with an application corresponding to the task to be performed; and

estimate, based on the one or more execution parameters associated with the application, a power consumption of the plurality of workload assignments.

12. The computing system of claim 8 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the instructions further comprising instructions to:

determine, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and

redistribute, based on the second thermal-constraint differential of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices.

13. The computing system of claim 12 , wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

14. The computing system of claim 8 , wherein a number of the plurality of workload assignments is greater than a number of the one or more devices of the set of disjoint devices.

15. A non-transitory non-volatile computer-readable medium comprising instructions that, when executed by one or more processors of one or more devices of a set of disjoint devices in an extended reality (XR) ecosystem that includes at least one XR device, cause the one or more processors to:

receive a request to perform a task associated with providing XR content to a user;

determine, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices;

determine a plurality of workload assignments needed to be performed to accomplish the task, wherein the plurality of workload assignments is configured to be performed by one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and

perform the task by causing the one or more devices in the extended reality (XR) ecosystem to execute the plurality of workload assignments.

16. The non-transitory non-volatile computer-readable medium of claim 15 , wherein the instructions to determine, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices further comprise instructions to determine a difference between a predetermined thermal design power (TDP) limit and a current power consumption.

17. The non-transitory non-volatile computer-readable medium of claim 15 , wherein the instructions to determine, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices further comprises instructions to determine the thermal constraint differential at runtime.

18. The non-transitory non-volatile computer-readable medium of claim 15 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the instructions further comprising instructions to:

determine, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and

redistribute, based on the second thermal-constraint differential of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices.

19. The non-transitory non-volatile computer-readable medium of claim 18 , wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

20. The non-transitory non-volatile computer-readable medium of claim 15 , wherein a number of the plurality of workload assignments is greater than a number of the one or more devices of the set of disjoint devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2024
From: ZANDIAN, BARDIA; GORBATOV, EUGENE; RAGHUVANSHI, PANKAJ; YARDI, SHRIRANG MADHAV
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 067364/0950 →
Continuity (1)
Continuation 17499757 · Oct 12, 2021
References Cited (21)
US 9311152B2 · Miller et al. · 2016 [cited by applicant]
US 9348656B2 · Presant et al. · 2016 [cited by applicant]
US 10064141B2 · Lee et al. · 2018 [cited by applicant]
US 20130109371A1 · Brogan · 2013 [cited by examiner]
US 20170083364A1 · Zhao · 2017 [cited by examiner]
US 20170139462A1 · Potlapally · 2017 [cited by examiner]
US 20170329649A1 · Cudak · 2017 [cited by examiner]
US 20180004260A1 · Amin-Shahidi · 2018 [cited by examiner]
US 20180329465A1 · Tavakoli et al. · 2018 [cited by applicant]
US 20180332160A1 · Brogan · 2018 [cited by examiner]
US 20190034235A1 · Yang et al. · 2019 [cited by applicant]
US 20190114212A1 · Gwin · 2019 [cited by examiner]
US 20190122463A1 · Romero · 2019 [cited by examiner]
US 20190324517A1 · Keceli et al. · 2019 [cited by applicant]
US 20200285298A1 · Basu · 2020 [cited by examiner]
US 20200409755A1 · Macnamara et al. · 2020 [cited by applicant]
US 20220147016A1 · Vishwakarma · 2022 [cited by examiner]
US 20220240408A1 · Faulkner · 2022 [cited by examiner]
US 20220308927A1 · Chen · 2022 [cited by examiner]
International Preliminary Report on Patentability for International Application No. PCT/US2022/046200, mailed Apr. 25, 2024, 7 pages. [cited by applicant]
International Search report and Written Opinion for International Application No. PCT/US2022/046200, mailed Dec. 19, 2022, 8 pages. [cited by applicant]