IP Library Granted Patent US 10,310,265
Granted Patent B2
US 10,310,265 · App. 15/039,405 · Granted Jun 4, 2019

Device, method, and system of providing extended display with head mounted display

Inventors: Yair Giwnewer (Tal El, IL); Tomer Rider (Naahryia, IL); Aviv Ron (Klachim, IL); Yevgeniy Kiveisha (Bney Aish, IL); Minghao Jiang (Shanghai, CN)
Assignee: INTEL CORPORATION
G02B27/017G02B27/02G06F1/00G06F3/011G06F3/012G06F3/013G02B2027/014G02B2027/0138G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,310,265
App. No.
15/039,405
Filed
May 25, 2016
Granted
Jun 4, 2019
Kind
B2
Examiner
REGN, MARK W
Art Unit
2622
USPC
345/8
Abstract

A head mounted display for displaying computer-generated information in conjunction with a physical display of a computer system is provided. The head mounted display includes a generation logic, a see through display, and a presentation unit. The generation logic is used to generate at least one virtual display. The presentation unit is used to present the at least one virtual display on the see-through display. The see-through display is configured to enable a user of the head mounted display to view the at least one virtual display and the physical display in a real-world scene. The at least one virtual display is presented on the see-through display as an additional object in the real-world scene, and the at least one virtual display is used in conjunction with the physical display to present the computer-generated information in an extended desktop from a visual perspective of the user.

Claims (67)

1. A head mounted display (HMD), comprising:

a generation logic to generate at least one virtual display;

a see-through display; and

a presentation unit to present the at least one virtual display on the see-through display; and

a memory coupled to the presentation unit,

wherein the see-through display is configured to enable a user to view the at least one virtual display and a physical display in a real-world scene,

wherein the at least one virtual display is presented on the see-through display as an additional object in the real-world scene, and

wherein the at least one virtual display is used in conjunction with the physical display to present a first computer-generated information in a first extended desktop from a visual perspective of the user, the first extended desktop comprising a first portion assigned to the physical display and a second portion assigned to the at least one virtual display, wherein the presentation unit is configured to determine if the physical display is in a field of vision of the HMD; and wherein the presentation unit is configured to present the first computer-generated information that has been previously stored in the memory in a second extended desktop comprising a third portion assigned to the at least one virtual display that represents the first portion, if the physical display is not in the field of vision of the HMD to continue viewing the first computer-generated information after the removal of physical display from the field of vision.

2. The HMD of claim 1 , wherein the first computer-generated information is presented in the first extended desktop while the physical display is in the field of vision of the HMD.

3. The HMD of claim 1 , further comprising:

a calculation logic to

determine a position of the head mounted display;

determine a location of the physical display based on at least the determined position of the head mounted display;

determine a surface position and a screen area of the physical display based on at least the determined location of the physical display; and

provide the determined position of the head mounted display, the determined location of the physical display, the determined surface position of the physical display, and the determined screen area of the physical display to the generation logic.

4. The HMD of claim 3 , further comprising:

the calculation logic to re-determine the position of the head mounted display, the location of the physical display, the surface position of the physical display, and the screen area of the physical display in response to at least one of

a physical movement of the physical display,

a physical movement of the HMD, and

an amount of time elapsed from at least one of a previous determination of the position of the HMD, a previous determination of the location of the physical display, a previous determination of the surface position of the physical display, and a previous determination screen area of the physical display.

5. The HMD of claim 3 , wherein the generation logic generates the at least one virtual display with a screen area that is a multiple of the screen area of the physical display, wherein eye-tracking data is gathered by at least one eye-tracking sensor, and wherein the generation logic generates the at least one virtual display based on at least one of

the gathered eye-tracking data,

the determined position of the head mounted display,

the determined location of the physical display,

the determined surface position of the physical display, and

the determined screen area of the physical display.

6. The HMD of claim 1 , further comprising:

a perspective logic to determine a desired relative display orientation between the first portion and the second portion; and

an association logic to configure the first portion and the second portion of the first extended desktop with the desired relative display orientation, wherein the at least one virtual display is used in conjunction with the physical display to present the configured first portion and the configured second portion of the first extended desktop from a visual perspective of the user.

7. The HMD of claim 1 , wherein the at least one virtual display is presented on the see-through display as an additional object that is adjacently located to the physical display in the real-world scene from a visual perspective of the user.

8. The HMD of claim 1 , wherein the at least one virtual display is presented on the see-through display as an additional object that is superimposed over the physical display in the real-world scene from a visual perspective of the user.

9. A computer-implemented method, comprising:

generating, with a Head Mounted Display (HMD), at least one virtual display;

presenting the at least one virtual display on the HMD, wherein the HMD is configured to enable a user to view the at least one virtual display and a physical display in a real-world scene, wherein the at least one virtual display is presented on the HMD as an additional object in the real-world scene, and wherein the at least one virtual display is used in conjunction with the physical display to present a first computer-generated information in a first extended desktop from a visual perspective of the user, the first extended desktop comprising a first portion assigned to the physical display and a second portion assigned to the at least one virtual display;

determining if the physical display is in a field of vision of the HMD; and

presenting the first computer-generated information in a second extended desktop comprising a third portion assigned to the at least one virtual display that represents the first portion, if the physical display is not in the field of vision of the HMD to continue viewing the first computer-generated information after the removal of physical display from the field of vision.

10. The computer-implemented method of claim 9 , wherein the first computer-generated information is presented in the first extended desktop while the physical display is in a field of vision of the HMD.

11. The computer-implemented method of claim 9 , further comprising:

determining a position of the head mounted display;

determining a location of the physical display based on at least the determined position of the head mounted display;

determining a surface position and a screen area of the physical display based on at least the determined location of the physical display; and

providing the determined position of the head mounted display, the determined location of the physical display, the determined surface position of the physical display, and the determined screen area of the physical display to the HMD.

12. The computer-implemented method of claim 11 , further comprising:

re-determining the position of the head mounted display, the location of the physical display, the surface position of the physical display, and the screen area of the physical display in response to at least one of

a physical movement of the physical display,

a physical movement of the HMD, and

an amount of time elapsed from at least one of a previous determination of the position of the HIVID, a previous determination of the location of the physical display, a previous determination of the surface position of the physical display, and a previous determination screen area of the physical display.

13. The computer-implemented method of claim 11 , wherein the determining the location of the physical display further includes determining each angle between each vertex of the physical display, and wherein at least one of the surface position and the screen area of the physical display is modified using the determined angles.

14. The computer-implemented method of claim 11 , wherein the generating includes generating the at least one virtual display with a screen area that is a multiple of the screen area of the physical display, wherein the generating includes gathering eye-tracking data, and wherein the generating includes generating the at least one virtual display based on at least one of the gathered eye-tracking data,

the determined position of the head mounted display,

the determined location of the physical display,

the determined surface position of the physical display, and

the determined screen area of the physical display.

15. The computer-implemented method of claim 9 , further comprising:

determining a desired relative display orientation between the first portion and the second portion; and

configuring the first portion and the second portion of the first extended desktop with the desired relative display orientation, wherein the at least one virtual display is used in conjunction with the physical display to present the configured first portion and the configured second portion of the first extended desktop from a visual perspective of the user.

16. The computer-implemented method of claim 9 , wherein the at least one virtual display is presented on the HMD as an additional object that is adjacently located to the physical display in the real-world scene from a visual perspective of the user.

17. The computer-implemented method of claim 9 , wherein the at least one virtual display is presented on the HMD as an additional object that is superimposed over the physical display in the real-world scene from a visual perspective of the user.

18. A multi-display system, comprising:

a physical display, wherein the physical display is used to present computer-generated information to a user;

a generation logic to generate a virtual display; and

a Head Mounted Display (HMD), the HMD comprising:

a see-through display; and

a presentation unit to present the at least one virtual display on the see-through display,

wherein the see-through display is configured to enable the user to view the at least one virtual display and the physical display in a real-world scene,

wherein the at least one virtual display is presented on the see-through display as an additional object in the real-world scene, and

wherein the at least one virtual display is used in conjunction with the physical display to present a first computer-generated information in a first extended desktop from a visual perspective of the user, the first extended desktop comprising a first portion assigned to the physical display and a second portion assigned to the at least one virtual display, wherein the presentation unit is configured to determine if the physical display is in a field of vision of the HMD; and wherein the presentation unit is configured to present the first computer-generated information that has been previously stored in the memory in a second extended desktop comprising a third portion assigned to the at least one virtual display that represents the first portion, if the physical display is not in the field of vision of the HMD to continue viewing the first computer-generated information after the removal of physical display from the field of vision.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2016
From: GIWNEWER, YAIR; RIDER, TOMER; RON, AVIV; KIVEISHA, YEVGENIY; JIANG, MINGHAO
To: INTEL CORPORATION
Reel/Frame 038721/0648 →
Continuity (1)
Related Publication 20170168296A1 · Jun 15, 2017
Cited By (2)
US 12,277,724 US 12,675,958