Granted Patent B2

US 10,379,345 · App. 15/595,607 · Granted Aug 13, 2019

Inventor: Brian Mullins (Altadena, CA)

Assignee: DAQRI, LLC

G02B27/017G06F3/011G06T19/006G02B2027/014

Abstract

Claims (73)

1. An augmented-reality device comprising:

an optical sensor;

a transparent display; and

one or more hardware processors comprising a virtual desktop application, the virtual desktop application configured to perform operations comprising:

detecting, using the optical sensor, a first physical display device of a computer, the first physical display device being located within a display distance of the augmented-reality device;

generating a virtual display device configured to operate as a second physical display device of the computer, the second physical display device configured to be controlled by the computer;

displaying the virtual display device in the transparent display, the virtual display device appearing adjacent to the first physical display device;

determining that a graphical display of a first application is maximized in the first physical display device and that a graphical display of a second application is minimized in the first physical display device, both the first application and the second application operating on the computer; and

causing the graphical display of the second application to be maximized in the virtual display device in response to determining that the graphical display of the second application is minimized in the first physical display device.

2. The augmented-reality device of claim 1 , wherein the operations further comprise:

detecting the computer;

generating a unique display identifier;

causing the computer to display the unique display identifier in the first physical display device;

detecting that the unique display identifier is displayed in the first physical display device; and

confirming that the first physical display device is associated with the computer based on the detection.

3. The augmented-reality device of claim 1 , wherein the operations further comprise:

accessing a display content of an application operating on the computer connected to the first physical display device; and

displaying the display content of the application in the virtual display device.

4. The augmented-reality device of claim 1 , wherein the operations further comprise:

accessing a display content of a second application operating on the computer, the computer configured to operate a first application; and

displaying the display content of the second application in the virtual display device, a display content of the first application displayed in the first physical display device.

5. The augmented-reality device of claim 4 , wherein the computer is configured to detect a user input at the computer, to determine that the user input is related to the second application, and to update the content of the second application based on the user input, and

wherein the operations further comprise:

updating the content of the second application in the virtual display device in response to the user input at the computer.

6. The augmented-reality device of claim 1 , wherein the operations further comprise:

determining that the virtual display device is located within a central area of the transparent display; and

causing the computer to update content of the virtual display device in response to determining that the virtual display device is located within the central area of the transparent display.

7. The augmented-reality device of claim 1 , wherein the operations further comprise:

determining that the virtual display device is located within a central area of the transparent display;

notifying the computer that the virtual display device has been selected in response to the determining that the virtual display device is located within the central area of the transparent display, the computer configured to receive a user input related to a second application displayed in the virtual display device in response to the notifying, both the second application and a first application operating on the computer; and

causing the computer to update content of the virtual display device in response to the user input.

8. The augmented-reality device of claim 1 , wherein the operations further comprise:

determining that the graphical display of the second application is maximized in the first physical display device; and

causing the graphical display of the second application to be minimized in the virtual display device in response to determining that the graphical display of the second application is maximized in the first physical display device.

9. The augmented-reality device of claim 1 , wherein the operations further comprise:

communicating with a display driver of the computer, the display driver configured to generate a first desktop area in the first physical display device and to generate a second desktop area in the virtual display device, the second desktop area being an expansion of the first desktop area.

10. A method comprising:

detecting, using an optical sensor of an augmented-reality device, a first physical display device of a computer, the first physical display device being located within a display distance of the augmented-reality device;

generating a virtual display device configured to operate as a second physical display device of the computer, the second physical display device configured to be controlled by the computer;

displaying the virtual display device in the transparent display, the virtual display device appearing adjacent to the first physical display device;

determining that a graphical display of a first application is maximized in the first physical display device and that a graphical display of a second application is minimized in the first physical display device, both the first application and the second application operating on the computer; and

causing the graphical display of the second application to be maximized in the virtual display device in response to determining that the graphical display of the second application is minimized in the first physical display device.

11. The method of claim 10 , further comprising:

detecting the computer;

generating a unique display identifier;

causing the computer to display the unique display identifier in the first physical display device;

detecting that the unique display identifier is displayed in the first physical display device; and

confirming that the first physical display device is associated with the computer based on the detection.

12. The method of claim 10 , further comprising:

accessing a display content of an application operating on the computer connected to the first physical display device; and

displaying the display content of the application in the virtual display device.

13. The method of claim 10 , further comprising:

accessing a display content of a second application operating on the computer, the computer configured to operate a first application; and

displaying the display content of the second application in the virtual display device, a display content of the first application displayed in the first physical display device.

14. The method of claim 13 , wherein the computer is configured to detect a user input at the computer, to determine that the user input is related to the second application, and to update the content of the second application based on the user input, and

wherein the method further comprises:

updating the content of the second application in the virtual display device in response to the user input at the computer.

15. The method of claim 10 , further comprising:

determining that the virtual display device is located within a central area of the transparent display; and

causing the computer to update content of the virtual display device in response to determining that the virtual display device is located within the central area of the transparent display.

16. The method of claim 10 , further comprising:

determining that the virtual display device is located within a central area of the transparent display;

notifying the computer that the virtual display device has been selected in response to the determining that the virtual display device is located within the central area of the transparent display, the computer configured to receive a user input related to a second application displayed in the virtual display device in response to the notifying, both the second application and a first application operating on the computer; and

causing the computer to update content of the virtual display device in response to the user input.

17. The method of claim 10 , further comprising:

determining that the graphical display of the second application is maximized in the first physical display device; and

causing the graphical display of the second application to be minimized in the virtual display device in response to determining that the graphical display of the second application is maximized in the first physical display device.

18. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a computer, cause the computer to perform operations comprising:

detecting, using an optical sensor of an augmented-reality device, a first physical display device of a computer, the first physical display device being located within a display distance of the augmented-reality device;

generating a virtual display device configured to operate as a second physical display device of the computer, the second physical display device configured to be controlled by the computer;

displaying the virtual display device in the transparent display, the virtual display device appearing adjacent to the first physical display device;

determining that a graphical display of a first application is maximized in the first physical display device and that a graphical display of a second application is minimized in the first physical display device, both the first application and the second application operating on the computer; and

causing the graphical display of the second application to be maximized in the virtual display device in response to determining that the graphical display of the second application is minimized in the first physical display device.

Assignments (10)

Continuity (1)