IP Library Granted Patent US 11,826,651
Granted Patent B2
US 11,826,651 · App. 16/848,795 · Granted Nov 28, 2023

Methods for providing interactive content in a virtual reality scene to guide an HMD user to safety within a real world space

Inventors: Glenn T. Black (San Mateo, CA); Michael G. Taylor (San Mateo, CA); Todd Tokubo (San Mateo, CA)
Assignee: Sony Interactive Entertainment Inc.
A63F13/65A63F13/211A63F13/212A63F13/213A63F13/25A63F13/30A63F13/5255G06T11/60A63F13/837A63F2300/8082G06F3/013G06T13/80G06T19/003G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,826,651
App. No.
16/848,795
Granted
Nov 28, 2023
Kind
B2
Abstract

Methods for providing guidance to a user wearing a head mounted display (HMD) are provided. One example method includes using a camera of the HMD to track the user wearing the HMD in a real-world space, and identifying a safe zone within the real-world space for interacting with a virtual reality space via the HMD. The method further includes detecting movements of the user in the real-world space. The method includes integrating content into the virtual reality space. The content is configured to provide guidance in direction of movement of the user toward the safe zone of the real-world space. If the user continues to move away from safe zone, pausing presentation of the virtual reality space, and resuming the presentation when the user is in the safe zone.

Claims (36)

1. A method for providing guidance to a user wearing a head mounted display (HMD), comprising,

using a camera of the HMD to track the user wearing the HMD in a real-world space;

identifying a safe zone within the real-world space for physical movements of the user during interaction with a virtual reality space via the HMD;

tracking said physical movements of the user in the real-world space;

integrating content into the virtual reality space, wherein at least a portion of the content is graphical content used to indicate relative position of the user with reference to the safe zone, the content is configured to provide descriptive direction information to guide the user toward the safe zone of the real-world space; and

if the user continues to move away from the safe zone, pausing presentation of the virtual reality space to allow the user to re-enter the safe zone, and resuming the presentation when the user is in the safe zone.

2. The method of claim 1 , further comprising,

identifying real-world objects in the real-world space using image data from the camera, wherein one or more of the real-world objects is identified as an obstacle to the user.

3. The method of claim 2 , wherein the obstacle is used to define part of a boundary for the safe zone.

4. The method of claim 1 , wherein the graphical content is rendered as an overlay graphic, the overlay graphic is used to assist in providing said guidance.

5. The method of claim 4 , wherein the overlay graphic is configured to load in front of the user as viewed by the user wearing the HMD.

6. The method of claim 4 , wherein the overlay graphic is removed when the user moves back to the safe zone while wearing the HMD.

7. The method of claim 4 , wherein the overlay graphic is an animated image providing text and/or audio related to the guidance.

8. The method of claim 4 , wherein the overlay graphic is an animated character providing text and/or audio related to the guidance to take one or more steps in a direction of movement until the user of the HMD is in the safe zone.

9. The method of claim 1 , wherein obstacles in the real world space are used to define the safe zone, and the safe zone changes as obstacles are present or not present over time.

10. The method of claim 1 , wherein the pausing occurs for a period of time during which the user wearing the HMD is determined to be outside of the safe zone.

11. The method of claim 1 , wherein pausing the presentation further comprising,

turning on a see-through mode of the HMD to allow the user to view the real-world space, upon detecting the user continuing to move away from the safe zone.

12. The method of claim 1 , wherein pausing the presentation further comprising,

providing a virtual overhead view that is mapped to the real-world space in which the user is interacting, the virtual overhead view presented as an overlay and includes an interactive indicator to identify relative location of the user with reference to the safe zone.

13. The method of claim 1 , wherein the graphical content is selected to match context of the virtual reality space so as to appear native to content of the virtual reality space.

14. Computer readable media, being non-transitory, having program instructions for providing guidance to a user wearing a head mounted display (HMD), comprising,

program instructions for using a camera of the HMD to track the user wearing the HMD in a real-world space;

program instructions for identifying a safe zone within the real-world space for physical movements of the user during interaction with a virtual reality space via the HMD;

program instructions for tracking said physical movements of the user in the real-world space;

program instructions for integrating content into the virtual reality space, wherein at least a portion of the content is graphical content used to indicate relative position of the user with reference to the safe zone, the content is configured to provide descriptive direction information to guide the user toward the safe zone of the real-world space; and

program instructions for pausing presentation of the virtual reality space if the user continues to move away from the safe zone so as to allow the user to re-enter the safe zone, and resuming the presentation when the user is in the safe zone.

15. The computer readable media of claim 14 , further comprising,

program instructions for identifying real-world objects in the real-world space using image data from the camera, wherein one or more of the real-world objects is identified as an obstacle to the user.

16. The computer readable media of claim 15 , wherein the obstacle is used to define part of a boundary for the safe zone.

17. The computer readable media of claim 14 , wherein the graphical content is rendered as an overlay graphic, the overlay graphic is used to assist in providing said guidance.

18. The computer readable media of claim 17 , wherein the overlay graphic is configured to load in front of the user as viewed by the user wearing the HMD.

19. The computer readable media of claim 17 , wherein the overlay graphic is removed when the user moves back to the safe zone while wearing the HMD.

20. The computer readable media of claim 17 , wherein the overlay graphic is an animated image providing text and/or audio related to the guidance.

21. The computer readable media of claim 14 , wherein program instructions for pausing the presentation further comprising,

program instructions for providing a virtual overhead view that is mapped to the real-world space in which the user is interacting, the virtual overhead view presented as an overlay and includes an interactive indicator to identify relative location of the user with reference to the safe zone.

Continuity (3)
Continuation 15715114 · Sep 25, 2017
Provisional Application 62402053 · Sep 30, 2016
Related Publication 20200238177A1 · Jul 30, 2020
Cited By (2)
US 12,207,225 US 12,566,490