IP Library Granted Patent US 12,154,201
Granted Patent B2
US 12,154,201 · App. 18/362,260 · Granted Nov 26, 2024

Systems and methods for modifying a safety boundary for virtual reality systems

Inventors: John Pollard (Fairview, TX); Jimmy K. Yun (Mountain View, CA); Jason Dong Uk Kim (Lucas, TX)
Assignee: Meta Platforms Technologies, LLC
G06T11/60G06F3/011G06T5/80G06T11/001G16H40/67
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,154,201
App. No.
18/362,260
Granted
Nov 26, 2024
Kind
B2
Abstract

The disclosed computer-implemented method may include establishing a virtual boundary for a virtual-world environment in reference to a real-world environment, and determining whether the virtual boundary requires a correction. The method may include providing, in response to determining that the virtual boundary requires the correction, and alert and, in response to the alert, receiving a request from a user to modify the virtual boundary. The method may further include monitoring, in response to the request from the user, an orientation of a direction indicator to generate orientation data, and modifying the virtual boundary based on the orientation data. Various other methods, systems, and computer-readable media are also disclosed.

Claims (76)

1. A method comprising:

capturing image data associated with a view of a real-world environment using an imaging system of a head-mounted display system;

displaying a pass-through view of the real-world environment, based at least in part upon the image data, to a user in a display of the head-mounted display system;

receiving an indication of a reference elevation representing a plane of the real-world environment;

monitoring an orientation of a direction indicator to generate first orientation data and to establish, with respect to the reference elevation, a virtual boundary for a virtual-world environment;

displaying the virtual boundary in the pass-through view of the real-world environment;

determining whether a dimension of the virtual boundary satisfies a minimum threshold value;

displaying a notification when the dimension of the virtual boundary does not satisfy the minimum threshold value;

receiving a request from a user to modify the virtual boundary;

in response to the request from the user, monitoring the orientation of the direction indicator to generate second orientation data; and

modifying the virtual boundary based on the reference elevation and the second orientation data.

2. The method of claim 1 , further comprising presenting an indication of the minimum threshold value to the user if the dimension does not satisfy the minimum threshold value.

3. The method of claim 1 , wherein modifying the virtual boundary comprises resetting the virtual boundary based on the reference elevation and the second orientation data.

4. The method of claim 1 , wherein the dimension comprises a length or a width of the virtual boundary.

5. The method of claim 1 , wherein the dimension comprises an area of the virtual boundary.

6. The method of claim 1 , further comprising displaying the virtual boundary in a first color if the dimension does not satisfy the minimum threshold value and displaying the virtual boundary in a second color if the dimension satisfies the minimum threshold value.

7. The method of claim 1 , wherein the first and second orientation data includes elevation data of an elevation of the direction indicator with respect to the reference elevation.

8. The method of claim 7 , wherein modifying the virtual boundary comprises determining an intersection between the plane and a virtual line that extends from the direction indicator at an elevation indicated by the elevation data and at the orientation indicated by the second orientation data.

9. The method of claim 1 , wherein:

at least a portion of the captured image data has lens-induced distortion;

the displaying the pass-through view of the real-world environment comprises correcting the lens-induced distortion in the image data to produce a compensated view of the real-world environment; and

the displaying the virtual boundary comprises superimposing the virtual boundary on the compensated view of the real-world environment.

10. The method of claim 1 , wherein modifying the virtual boundary includes adding portions to or subtracting portions from the virtual boundary.

11. The method of claim 1 , further comprising receiving a confirmation of the reference elevation.

12. A tangible, non-transitory computer-readable storage medium having instructions stored thereon that, when executed by a processing system, cause the processing system to perform operations comprising:

capturing image data associated with a view of a real-world environment using an imaging system of a head-mounted display system;

displaying a pass-through view of the real-world environment, based at least in part upon the image data, to a user in a display of the head-mounted display system;

receiving an indication of a reference elevation representing a plane of the real-world environment;

monitoring an orientation of a direction indicator to generate first orientation data and to establish, with respect to the reference elevation, a virtual boundary for a virtual-world environment;

displaying the virtual boundary in the pass-through view of the real-world environment;

determining whether a dimension of the virtual boundary satisfies a minimum threshold value;

displaying a notification when the dimension of the virtual boundary does not satisfy the minimum threshold value;

receiving a request from a user to modify the virtual boundary;

in response to the request from the user, monitoring the orientation of the direction indicator to generate second orientation data; and

modifying the virtual boundary based on the reference elevation and the second orientation data.

13. The non-transitory computer-readable storage medium of claim 12 , further comprising instructions for presenting the minimum threshold value to the user if the dimension does not satisfy the minimum threshold value.

14. The non-transitory computer-readable storage medium of claim 12 , wherein modifying the virtual boundary comprises resetting the virtual boundary based on the reference elevation and the second orientation data.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the dimension comprises a length or a width of the virtual boundary.

16. The non-transitory computer-readable storage medium of claim 12 , wherein the dimension comprises an area of the virtual boundary.

17. The non-transitory computer-readable storage medium of claim 12 , further comprising instructions for displaying the virtual boundary in a first color if the dimension does not satisfy the minimum threshold value and displaying the virtual boundary in a second color if the dimension satisfies the minimum threshold value.

18. The non-transitory computer-readable storage medium of claim 12 , wherein the first and second orientation data includes elevation data of an elevation of the direction indicator with respect to the reference elevation.

19. The non-transitory computer-readable storage medium of claim 18 , wherein modifying the virtual boundary comprises determining an intersection between the plane and a virtual line that extends from the direction indicator at an elevation indicated by the elevation data and at the orientation indicated by the second orientation data.

20. The non-transitory computer-readable storage medium of claim 12 , wherein:

the captured view of the real-world environment has lens-induced distortion;

the displaying the pass-through view of the real-world environment comprises correcting the lens-induced distortion in the captured view to produce a compensated view of the real-world environment; and

the displaying the virtual boundary comprises superimposing the virtual boundary on the compensated view of the real-world environment.

21. The non-transitory computer-readable storage medium of claim 12 , wherein modifying the virtual boundary includes adding portions to or subtracting portions from the virtual boundary.

22. The non-transitory computer-readable storage medium of claim 12 , further comprising instructions for receiving a confirmation of the reference elevation.

23. A head-mounted display system comprising:

a display secured to a user attachment system;

an imaging system;

a direction indicator; and

a processing system configured to:

capture image data associated with a view of a real-world environment using the imaging system;

display a pass-through view of the real-world environment, based at least in part upon the image data, to a user in the display;

receive an indication of a reference elevation representing a plane of the real-world environment;

monitor an orientation of the direction indicator to generate first orientation data and to establish, with respect to the reference elevation, a virtual boundary for a virtual-world environment;

display the virtual boundary in the pass-through view of the real-world environment;

determine whether a dimension of the virtual boundary satisfies a minimum threshold value;

display a notification when the dimension of the virtual boundary does not satisfy the minimum threshold value;

receive a request from a user to modify the virtual boundary;

in response to the request from the user, monitor the orientation of the direction indicator to generate second orientation data; and

modify the virtual boundary based on the reference elevation and the second orientation data.

24. The head-mounted display system of claim 23 , wherein the processing system is further configured to present the minimum threshold value to the user if the dimension does not satisfy the minimum threshold value.

25. The head-mounted display system of claim 23 , wherein modifying the virtual boundary comprises resetting the virtual boundary based on the reference elevation and the second orientation data.

26. The head-mounted display system of claim 23 , wherein the dimension comprises a length or a width of the virtual boundary.

27. The head-mounted display system of claim 23 , wherein the dimension comprises an area of the virtual boundary.

28. The head-mounted display system of claim 23 , wherein the processing system is further configured to display the virtual boundary in a first color if the dimension does not satisfy the minimum threshold value and display the virtual boundary in a second color if the dimension satisfies the minimum threshold value.

29. The head-mounted display system of claim 23 , wherein the first and second orientation data includes elevation data of an elevation of the direction indicator with respect to the reference elevation.

30. The head-mounted display system of claim 29 , wherein modifying the virtual boundary comprises determining an intersection between the plane and a virtual line that extends from the direction indicator at an elevation indicated by the elevation data and at the orientation indicated by the second orientation data.

31. The head-mounted display system of claim 23 , wherein:

the captured view of the real-world environment has lens-induced distortion;

the displaying the pass-through view of the real-world environment comprises correcting the lens-induced distortion in the captured view to produce a compensated view of the real-world environment; and

the displaying the virtual boundary comprises superimposing the virtual boundary on the compensated view of the real-world environment.

32. The head-mounted display system of claim 23 , wherein modifying the virtual boundary includes adding portions to or subtracting portions from the virtual boundary.

33. The head-mounted display system of claim 23 , wherein the processing system is further configured to receive a confirmation of the reference elevation.

Assignments (2)
CHANGE OF NAME Recorded Oct 8, 2024
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 069135/0971 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2024
From: POLLARD, JOHN; YUN, JIMMY K; KIM, JASON DONG UK
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 068839/0089 →
Continuity (3)
Continuation 17665211 · Feb 4, 2022
Continuation 16177424 · Oct 31, 2018
Related Publication 20230377744A1 · Nov 23, 2023
Cited By (1)
US 12,726,606