IP Library › Granted Patent US 11,009,716
Granted Patent B2
US 11,009,716 · App. 16/837,694 · Granted May 18, 2021

Transitioning into a VR environment and warning HMD users of real-world physical obstacles

Inventors: Kenneth Liam Kiemele (Redmond, WA); Michael Thomas (Redmond, WA); Charles W. Lapp, III (Issaquah, WA); Christian Michael Sadak (Seattle, WA); Thomas Salter (Seattle, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G02B27/0179G02B27/017G02B27/0172G06F3/011G09G3/3611G02B2027/014G02B2027/0118G02B2027/0138G02B2027/0141G02B2027/0187G09G5/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,009,716
App. No.
16/837,694
Granted
May 18, 2021
Kind
B2
Abstract

Optimizations are provided for facilitating an improved transition between a real-world environment and a virtual reality environment. Initially, use of a HMD is detected and one or more real-world physical objects within a threshold proximity to the HMD are identified. Subsequently, a replicated environment, which includes virtual representations of the real-world physical object(s), is obtained and rendered in a virtual reality display. The replicated environment is transitioned out of view and a VR environment is subsequently rendered in the virtual reality display. In some instances, rendering of virtual representations of real-world physical objects into the VR environment occurs is response to detected triggering event.

Claims (40)

1. A computer system comprising:

one or more processors; and

one or more computer-readable hardware storage media having stored thereon computer-executable instructions, the computer-executable instructions being executable by the one or more processors to cause the computer system to implement a method that includes:

the computer system rendering a virtual reality environment in a virtual reality display of a head mounted display (“HMD”);

the computer system detecting a relative proximity of at least one real-world physical object to the HMD;

the computer system detecting a predetermined triggering event for triggering a notification to the user of the at least one real-world physical object;

the computer system, in response to detecting the predetermined triggering event, obtaining a computer-generated virtual representation of the at least one real-world physical object; and

the computer system, in response to detecting the predetermined triggering event, and only while conditions of the triggering event continue to be present, rendering the computer-generated virtual representation of the at least one real-world physical object in the virtual reality display.

2. The computer system of claim 1 , wherein the virtual representation of the at least one real-world physical object comprises an untextured representation of the at least one real-world physical object.

3. The computer system of claim 1 , wherein the obtaining includes obtaining at least two different virtual representations, the at least two different virtual representations including an untextured representation of the at least one real-world physical object and one or more partially textured representation of the at least one real-world physical object, and wherein the rendering includes rendering at least the one or more partially textured representation.

4. The computer system of claim 1 , wherein the predetermined triggering event is a detection of the HMD within a threshold proximity to and orientation towards the at least one real-world physical object.

5. The computer system of claim 1 , wherein the predetermined triggering event is a detection of the HMD moving at a threshold velocity towards the at least one real-world physical object.

6. The computer system of claim 5 , wherein the threshold velocity is a variable velocity value based on a function of the proximity of the HMD to the at least one real-world physical object.

7. The computer system of claim 6 , wherein the variable velocity value is also based on a function of an orientation of the HMD.

8. The computer system of claim 1 , wherein the predetermined triggering event is a detection of a new real-world physical object moving within a predetermined threshold proximity to the HMD.

9. The computing system of claim 1 , wherein the predetermined triggering event comprises an acoustic signal that is generated externally from, and detected by, the computer system.

10. The computer system of claim 1 , wherein rendering the virtual representation of the at least one real-world physical object comprises rendering the virtual representation of the at least one real-world physical object while refraining from rendering the virtual environment simultaneously with the virtual representation.

11. The computer system of claim 1 , wherein execution of the computer-executable instructions further causes the computer system to:

after rendering the virtual representation of the at least one real-world physical object in the virtual reality display and in response to determining that conditions of the triggering event are no longer present, cease to render the virtual representation of the at least one real-world physical object in the virtual reality display.

12. A method implemented by a computing system for warning a user that is wearing a head mounted display (“HMD”) of one or more obstacles that are present in the real world, the method comprising:

the computing system rendering a virtual reality environment in a virtual reality display of the HMD;

the computing system detecting the proximity of at least one real-world physical object to the HMD;

the computing system detecting a predetermined triggering event for triggering a notification to the user of the at least one real-world physical object;

the computing system obtaining a computer-generated virtual representation of the at least one real-world physical object; and

the computing system, in response to detecting the predetermined triggering event, temporarily rendering the computer-generated virtual representation of the at least one real-world physical object in the virtual reality display for a predetermined period of time.

13. The method of claim 12 , wherein the virtual representation of the at least one real-world physical object comprises an untextured representation of the at least one real-world physical object.

14. The method of claim 12 , wherein the obtaining includes obtaining at least two different virtual representations, the at least two different virtual representations including an untextured representation of the at least one real-world physical object and one or more partially textured representation of the at least one real-world physical object, and wherein the rendering includes rendering at least the one or more partially textured representation.

15. The method of claim 12 , wherein the predetermined triggering event is a detection of the HMD moving at a threshold velocity towards the at least one real-world physical object.

16. The method of claim 12 , wherein the predetermined triggering event is a detection of a new real-world physical object moving within a predetermined threshold proximity to the HMD.

17. The method of claim 12 , wherein rendering the virtual representation of the at least one real-world physical object comprises rendering the virtual representation of the at least one real-world physical object while refraining from rendering the virtual environment simultaneously with the virtual representation.

18. The method of claim 12 , further comprising:

after rendering the virtual representation of the at least one real-world physical object in the virtual reality display and in response to determining that conditions of the triggering event are no longer present, ceasing to render the virtual representation of the at least one real-world physical object in the virtual reality display.

19. The method of claim 12 , wherein the temporarily rendering of the computer-generated virtual representation of the at least one real-world physical object in the virtual reality display for the predetermined period of time comprises pulsing the rendering of the of the computer-generated virtual representation of the at least one real-world physical object in the virtual reality display for the predetermined period of time.

20. A computer program product comprising one or more hardware storage devices having stored thereon computer-executable instructions, the computer-executable instructions being executable by one or more processors of a computer system to cause the computer system to implement a method that includes:

rendering a virtual reality environment in a virtual reality display of a head mounted display (“HMD”);

subsequent to rendering the virtual reality environment in the virtual reality display, detecting a proximity of a real-world physical object within a threshold proximity to the HMD;

detecting the HMD is facing towards the one real-world physical object;

obtaining a virtual representation of the one real-world physical object; and

rendering the virtual representation of the real-world physical object in the virtual reality display of the HMD to warn a user of the HMD of the real-world object and based on detecting the real-world physical object is within a threshold proximity to the HMD and that the HMD is facing towards the real-world physical object.

21. The computer program product of claim 20 , wherein the rendering of the virtual representation of the one real-world physical object in the virtual reality display occurs at least temporarily while refraining from rendering the virtual environment simultaneously with the virtual representation in the virtual reality display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2020
From: KIEMELE, KENNETH LIAM; THOMAS, MICHEAL; LAPP, CHARLES W., III; SADAK, CHRISTIAN MICHAEL; SALTER, THOMAS
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 052288/0389 →
Continuity (2)
Division 15667509 · Aug 2, 2017
Related Publication 20200225495A1 · Jul 16, 2020
Cited By (11)
US 12,197,634 US 12,254,581 US 12,272,012 US 12,315,363 US 12,548,245 US 12,572,253 US 12,608,075 US 12,613,938 US 12,633,068 US 12,670,001 US 12,681,561