IP Library Granted Patent US 10,546,426
Granted Patent B2
US 10,546,426 · App. 15/886,764 · Granted Jan 28, 2020

Real-world portals for virtual reality displays

Inventors: Alexandru Octavian Balan (Sammamish, WA); Youding Zhu (Sammamish, WA); Min shik Park (Bellevue, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006G02B27/017G06F3/011G06T15/20G06T19/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,546,426
App. No.
15/886,764
Granted
Jan 28, 2020
Kind
B2
Abstract

A virtual reality scene is displayed via a display device. A real-world positioning of a peripheral control device is identified relative to the display device. Video of a real-world scene of a physical environment located behind a display region of the display device is captured via a camera. A real-world portal is selectively displayed via the display device that includes a portion of the real-world scene and simulates a view through the virtual reality scene at a position within the display region that tracks the real-world positioning of the peripheral control device.

Claims (54)

1. A method, comprising:

displaying a virtual reality scene via a display device;

identifying a real-world positioning of a peripheral control device relative to the display device;

capturing video of a real-world scene of a physical environment located behind a display region of the display device via a camera; and

displaying a real-world portal via the display device, the real-world portal including a portion of the real-world scene and simulating a view through the virtual reality scene at a position within the display region,

wherein the position of the real-world portal within the display region tracks a section of a virtual field of view of the peripheral control device that is spaced away from and spatially locked to the real-world positioning of the peripheral control device.

2. The method of claim 1 , wherein the portion of the real-world scene is a limited field of view of the camera that is less than an entire field of view of the camera; and

wherein the limited field of view is defined by a virtual viewing window corresponding to the section that is spaced away from and spatially locked to the real-world positioning of the peripheral control device.

3. The method of claim 2 , wherein the section is a section of a cone that represents the virtual field of view of the peripheral control device.

4. The method of claim 2 , wherein the virtual viewing window is spaced away from the peripheral control device by a pre-defined distance in physical space.

5. The method of claim 2 , further comprising:

locking a real-world positioning of the virtual viewing window relative to the physical environment responsive to engagement of a view-lock mode in which the virtual viewing window is no longer spatially locked to the real-world positioning of the peripheral control device.

6. The method of claim 2 , further comprising:

locking the position at which the real-world portal is displayed within the display region responsive to engagement of a portal-lock mode in which the position within the display region no longer tracks the real-world positioning of the peripheral control device.

7. The method of claim 1 , wherein an application provides the virtual reality scene for display, and wherein the real-world portal is displayed as an overlay to the virtual reality scene provided by the application.

8. The method of claim 1 , wherein the display device is a head-mounted display device.

9. The method of claim 8 , wherein the head-mounted display device is a near-eye head-mounted display device that occludes a user's view of the physical environment.

10. The method of claim 8 , wherein the camera is an outward facing camera of the head-mounted display device that approximates a perspective of a user wearing the head-mounted display device.

11. The method of claim 1 , wherein the peripheral control device is a handheld controller.

12. The method of claim 1 , further comprising:

receiving a user input via a user interface of the peripheral control device; and

responsive to the user input, engaging or disengaging a real-world viewing mode, wherein:

while the real-world viewing mode is engaged, the real-world portal is displayed via the display device, and

while the real-world viewing mode is disengaged, the real-world portal is not displayed via the display device.

13. The method of claim 1 , wherein the portion of the real-world scene included in the real-world portal is displayed at an apparent real-world scale.

14. A virtual reality system, comprising:

a computing system configured to:

display a virtual reality scene via a display device;

identify a real-world positioning of a peripheral control device relative to the display device;

capture video of a real-world scene of a physical environment located behind a display region of the display device via a camera; and

display a real-world portal via the display device, the real-world portal including a portion of the real-world scene and simulating a view through the virtual reality scene at a position within the display region,

wherein the position of the real-world portal within the display region tracks a section of a virtual field of view of the peripheral control device that is spaced away from and spatially locked to the real-world positioning of the peripheral control device.

15. The virtual reality system of claim 14 , wherein the display device is a head mounted display device;

wherein the camera is an outward facing camera of the head-mounted display device; and

wherein the peripheral control device is a handheld controller.

16. The virtual reality system of claim 14 , wherein the computing system is further configured to:

receive a user input via a user interface of the peripheral control device; and

responsive to the user input, engage or disengage a real-world viewing mode, wherein:

while the real-world viewing mode is engaged, the real-world portal is displayed via the display device, and

while the real-world viewing mode is disengaged, the real-world portal is not displayed via the display device.

17. The virtual reality system of claim 14 , wherein the portion of the real-world scene is a limited field of view of the camera that is less than an entire field of view of the camera; and

wherein the limited field of view is defined by a virtual viewing window corresponding to the section that is spaced away from and spatially locked to the real-world positioning of the peripheral control device.

18. The virtual reality system of claim 17 , wherein the computing system is further configured to:

receive a user input via a user interface of the peripheral control device; and

responsive to the user input, lock a real-world positioning of the virtual viewing window relative to the physical environment such that the virtual viewing window is no longer spatially locked to the real-world positioning of the peripheral control device.

19. The virtual reality system of claim 14 , wherein the computing system is further configured to:

receive a user input via a user interface of the peripheral control device; and

responsive to the user input, lock the position at which the real-world portal is displayed within the display region such that the position within the display region no longer tracks the real-world positioning of the peripheral control device.

20. A storage machine holding instructions executable by a logic machine to:

display a virtual reality scene via a display device;

identify a real-world positioning of a peripheral control device relative to the display device;

capture video of a real-world scene of a physical environment located behind a display region of the display device via a camera; and

display a real-world portal via the display device, the real-world portal including a portion of the real-world scene and simulating a view through the virtual reality scene at a position within the display region,

wherein the position of the real-world portal within the display region tracks a section of a cone that represents a virtual field of view of the peripheral control device that is spaced away from and spatially locked to the real-world positioning of the peripheral control device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2018
From: BALAN, ALEXANDRU OCTAVIAN; ZHU, YOUDING; PARK, MIN SHIK
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 044805/0563 →
Continuity (2)
Provisional Application 62614142 · Jan 5, 2018
Related Publication 20190213793A1 · Jul 11, 2019
Cited By (2)
US 12,548,208 US 12,579,764