Granted Patent B2

US 10,445,937 · App. 15/794,729 · Granted Oct 15, 2019

Inventor: Brian Mullins (Altadena, CA)

Assignee: DAQRI, LLC

G06T19/006G02B27/017G06F3/011G06F3/015G06F8/38G06F9/451G06Q10/10G02B2027/014G02B2027/0187G06F3/012G06F3/14G06F2203/0383

Abstract

Claims (76)

1. A first display device comprising:

a head-mounted device;

one or more hardware processors; and

a memory storing instructions that, when executed by the one or more hardware processors, cause the first display device to perform operations comprising:

determining a first device configuration of the first display device and a first context of a first AR application operating on the first display device;

detecting a second display device that comprises a head up display (HUD) system of a vehicle;

determining a second device configuration of the second display device and a second context of a second AR application operating on the second display device;

generating a first collaboration configuration for the first display device and a second collaboration configuration for the second display device, the first and second collaboration configurations being generated based on the first device configuration, the first context, the second device configuration, and the second context; and

allocating a task of the first AR application to the second AR application based on the first collaboration configuration, the second display device being configured to perform the allocated task based on the second collaboration configuration.

2. The first display device of claim 1 , wherein the first device configuration identifies a first display size, wherein the second device configuration identifies a second display size,

wherein the operations further comprise:

determining that the second display size is larger than the first display size; and

the allocating of the task includes allocating a display operation of the first AR application to the second AR application in response to determining that the second display size is larger than the first display size.

3. The first display device of claim 1 , wherein the first device configuration identifies a first computing capacity, wherein the second device configuration identifies a second computing capacity,

wherein the operations further comprise:

determining that the second computing capacity is larger than the first computing capacity; and

the allocating of the task includes allocating a computation operation from the first AR application to be performed by the second AR application in response to determining that the second computing capacity is larger than the first computing capacity.

4. The first display device of claim 1 , wherein the operations further comprise:

modifying a first task of the first AR application in the first display device based on the first collaboration configuration; and

modifying a second task of the second AR application in the second display device based on the second collaboration configuration.

5. The first display device of claim 1 , wherein the operations further comprise:

identifying a common task executed by the first and second display devices based on the common task identified in the first and second configurations and in the first and second contexts;

determining that the first display device is configured to perform the common task more efficiently than the second display device;

assigning the common task to the first display device in the first collaboration configuration; and

removing the common task from the second display device in the second collaboration configuration.

6. The first display device of claim 1 , wherein the operations further comprise:

disabling a first display of the first display device; and

causing a second display of the second display device to display content from the first AR application using the second collaboration configuration on the second AR application of the second display device.

7. The first display device of claim 1 , wherein the first device configuration identifies hardware and software specifications of the first display device, and hardware and software resource capacities and availabilities of the first display device, and

wherein the second device configuration identifies hardware and software specifications of the second display device, and hardware and software resource capacities and availabilities of the second display device.

8. The first display device of claim 1 , wherein the first context includes a user-based context and an ambient-based context of the first display device,

the user-based context being generated based on a user profile of a first user of the first display device, a user credential of the first user, and biometric data from the first user, the biometric data including at least one of a heart rate, a blood pressure, or brain activity, and

the ambient-based context indicating at least one of a geographic location of the first display device, an orientation and a position of the first display device, an ambient pressure, an ambient humidity level, or an ambient light level.

9. The first display device of claim 1 , wherein the first collaboration configuration includes an allocation instruction of tasks from the first AR application to the second AR application.

10. The first display device of claim 1 , wherein the operations further comprise:

generating first AR content based on the first collaboration configuration;

generating second AR content based on the second collaboration configuration;

causing a display of the first AR content in the display of the first display device; and

causing a display of the second AR content in the display of the second display device.

11. A method comprising:

determining a first device configuration of the first display device and a first context of a first AR application operating on the first display device, the first display device comprising a head mounted device;

detecting a second display device that comprises a head up display (HUD) system of a vehicle;

determining a second device configuration of the second display device and a second context of a second AR application operating on the second display device;

generating a first collaboration configuration for the first display device and a second collaboration configuration for the second display device, the first and second collaboration configurations being generated based on the first device configuration, the first context, the second device configuration, and the second context; and

allocating a task of the first AR application to the second AR application based on the first collaboration configuration, the second display device being configured to perform the allocated task based on the second collaboration configuration.

12. The method of claim 11 , wherein the first device configuration identifies a first display size, wherein the second device configuration identifies a second display size,

wherein the method further comprises:

determining that the second display size is larger than the first display size; and

the allocating of the task includes allocating a display operation of the first AR application to the second AR application in response to determining that the second display size is larger than the first display size.

13. The method of claim 11 , wherein the first device configuration identifies a first computing capacity, wherein the second device configuration identifies a second computing capacity,

wherein the method further comprises:

determining that the second computing capacity is larger than the first computing capacity; and

the allocating of the task includes allocating a computation operation from the first AR application to be performed by the second AR application in response to determining that the second computing capacity is larger than the first computing capacity.

14. The method of claim 11 , further comprising:

modifying a first task of the first AR application in the first display device based on the first collaboration configuration; and

modifying a second task of the second AR application in the second display device based on the second collaboration configuration.

15. The method of claim 11 , further comprising:

identifying a common task executed by the first and second display devices based on the common task identified in the first and second configurations and in the first and second contexts;

determining that the first display device is configured to perform the common task more efficiently than the second display device;

assigning the common task to the first display device in the first collaboration configuration; and

removing the common task from the second display device in the second collaboration configuration.

16. The method of claim 11 , further comprising:

disabling a first display of the first display device; and

causing a second display of the second display device to display content from the first AR application using the second collaboration configuration on the second AR application of the second display device.

17. The method of claim 11 , wherein the first device configuration identifies hardware and software specifications of the first display device, and hardware and software resource capacities and availabilities of the first display device, and

wherein the second device configuration identifies hardware and software specifications of the second display device, and hardware and software resource capacities and availabilities of the second display device.

18. The method of claim 11 , wherein the first context includes a user-based context and an ambient-based context of the first display device,

the user-based context being generated based on a user profile of a first user of the first display device, a user credential of the first user, and biometric data from the first user, the biometric data including at least one of a heart rate, a blood pressure, or brain activity, and

the ambient-based context indicating at least one of a geographic location of the first display device, an orientation and a position of the first display device, an ambient pressure, an ambient humidity level, or an ambient light level.

19. The method of claim 11 , wherein the first collaboration configuration includes an allocation instruction of tasks from the first AR application to the second AR application.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

determining a first device configuration of the first display device and a first context of a first AR application operating on the first display device, the first display device comprising a head mounted device;

detecting a second display device that comprises a head up display (HUD) system of a vehicle;

determining a second device configuration of the second display device and a second context of a second AR application operating on the second display device;

generating a first collaboration configuration for the first display device and a second collaboration configuration for the second display device, the first and second collaboration configurations being generated based on the first device configuration, the first context, the second device configuration, and the second context; and

allocating a task of the first AR application to the second AR application based on the first collaboration configuration, the second display device being configured to perform the allocated task based on the second collaboration configuration.

Assignments (12)

Continuity (2)