IP Library Granted Patent US 11,880,941
Granted Patent B1
US 11,880,941 · App. 17/521,450 · Granted Jan 23, 2024

Comfortable navigation in large-scale virtual worlds when constrained by small-scale physical environment

Inventors: Gioacchino Noris (Zurich, CH); Matthew James Alderman (Snohomish, WA); Alexandru-Eugen Ichim (Rüschlikon, CH)
Assignee: Meta Platforms Technologies, LLC
G06T19/003G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,880,941
App. No.
17/521,450
Granted
Jan 23, 2024
Kind
B1
Abstract

In one embodiment, a method includes segmenting a layout of a physical space surrounding a user into physical segments; generating, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments; identifying, based on a current location of the user with respect to the physical space, a portion of the physical segments for which to enable an intrusion detection feature; detecting a physical object in the portion of the physical segments that corresponds to a particular virtual path of the virtual paths; and in response to the detecting, displaying a representation of the physical object in the particular virtual path.

Claims (78)

1. A computer-implemented method comprising, by a virtual-reality computing system:

segmenting a layout of a physical space surrounding a user into physical segments;

generating, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments;

identifying a first physical segment of the physical segments that the user is located within, the first physical segment corresponding to a first virtual path of the virtual paths;

activating an intrusion detection feature for the first physical segment;

while the user is navigating the first virtual path by traveling the first physical segment, detecting a physical object;

determining that a location of the physical object is in the first physical segment;

in response to the determination, displaying a representation of the physical object in the first virtual path;

determining, after displaying the representation of the physical object in the first virtual path, based on an updated location of the user with respect to the physical space, that the user has moved from the first physical segment to a second physical segment of the physical segments;

in response to the determination that the user has moved from the first physical segment to the second physical segment of the physical segments that corresponds to a second virtual path of the virtual paths:

i) ceasing, in response to a determination that the location of the physical object is not in the second physical segment, to display the representation of the physical object in the first virtual path;

ii) disabling the intrusion detection feature for the first physical segment; and

iii) activating the intrusion detection feature for the second physical segment that the user is located within;

detecting an additional physical object;

determining that a location of the additional physical object is in the second physical segment; and

displaying, in response to the determination that the location of the additional physical object is in the second physical segment, a representation of the additional physical object in the second virtual path.

2. The computer-implemented method of claim 1 , wherein detecting the physical object further comprises detecting the physical object entering the first physical segment that corresponds to the first virtual path after generating the virtual paths for the virtual environment.

3. The computer-implemented method of claim 2 , wherein the first physical segment is initially exclusive of the physical object when the virtual paths are generated.

4. The computer-implemented method of claim 1 , further comprising:

after determining that the location of the physical object is in the first physical segment, identifying a proximity of the user with respect to the physical object in the first physical segment.

5. The computer-implemented method of claim 4 , further comprising:

determining, based on the proximity of the user with respect to the physical object, that the user is within a threshold distance of the physical object.

6. The computer-implemented method of claim 5 , wherein

displaying the representation of the physical object in the first virtual path is further in response to the determination that the user is within the threshold distance of the physical object.

7. The computer-implemented method of claim 5 , further comprising:

identifying a sightline of the user with respect to the physical object; and

determining that the physical object is located within the sightline of the user, wherein

displaying the representation of the physical object in the first virtual path is further in response to the determination that the physical object is located within the sightline of the user.

8. The computer-implemented method of claim 1 , further comprising:

determining, based on a current location of the user with respect to the physical space, that the user is located outside of the physical segments of the physical space; and

in response to determining that the user is located outside of the physical segments of the physical space, updating a graphical user interface (GUI) to correspond to additional physical space that is outside of the physical segments the user is located in.

9. The computer-implemented method of claim 1 , further comprising:

concealing representations of additional physical objects physically located in remaining physical segments of the physical space.

10. The computer-implemented method of claim 1 , wherein the first physical segment is adjacent to the second physical segment.

11. A system comprising a processor having access to memory media storing instructions executable by the processor to:

segment a layout of a physical space surrounding a user into physical segments;

generate, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments;

identify a first physical segment of the physical segments that the user is located within, the first physical segment corresponding to a first virtual path of the virtual paths;

activate an intrusion detection feature for the first physical segment;

while the user is navigating the first virtual path by traveling the first physical segment, detect a physical object;

determining that a location of the physical object is in the first physical segment;

in response to the determination, display a representation of the physical object in the first virtual path;

determine, after displaying the representation of the physical object in the first virtual path, based on an updated location of the user with respect to the physical space, that the user has moved from the first physical segment to a second physical segment of the physical segments;

in response to the determination that the user has moved from the first physical segment to the second physical segment of the physical segments that corresponds to a second virtual path of the virtual paths:

i) cease, in response to a determination that the location of the physical object is not in the second physical segment, to display the representation of the physical object in the first virtual path;

ii) disable the intrusion detection feature for the first physical segment; and

iii) activate the intrusion detection feature for the second physical segment that the user is located within;

detect an additional physical object;

determine that a location of the additional physical object is in the second physical segment; and

display, in response to the determination that the location of the additional physical object is in the second physical segment, a representation of the additional physical object in the second virtual path.

12. The system of claim 11 , wherein detecting the physical object further comprises detect the physical object entering the first physical segment that corresponds to the first virtual path after generating the virtual paths for the virtual environment.

13. The system of claim 12 , wherein the first physical segment is initially exclusive of the physical object when the virtual paths are generated.

14. The system of claim 11 , the instructions further comprising:

after determining that the location of the physical object is in the first physical segment, identify a proximity of the user with respect to the physical object in the first physical segment.

15. The system of claim 14 , the instructions further comprising:

determine, based on the proximity of the user with respect to the physical object, that the user is within a threshold distance of the physical object.

16. The system of claim 15 , wherein

displaying the representation of the physical object in the first virtual path is further in response to the determination that the user is within the threshold distance of the physical object.

17. The system of claim 15 , the instructions further comprising:

identify a sightline of the user with respect to the physical object; and

determine that the physical object is located within the sightline of the user, wherein

displaying the representation of the physical object in the first virtual path is further in response to the determination that the physical object is located within the sightline of the user.

18. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

segment a layout of a physical space surrounding a user into physical segments;

generate, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments;

identify a first physical segment of the physical segments that the user is located within, the first physical segment corresponding to a first virtual path of the virtual paths;

activate an intrusion detection feature for the first physical segment;

while the user is navigating the first virtual path by traveling the first physical segment, detect a physical object;

determining that a location of the physical object is in the first physical segment;

in response to the determination, display a representation of the physical object in the first virtual path;

determine, after displaying the representation of the physical object in the first virtual path, based on an updated location of the user with respect to the physical space, that the user has moved from the first physical segment to a second physical segment of the physical segments;

in response to the determination that the user has moved from the first physical segment to the second physical segment of the physical segments that corresponds to a second virtual path of the virtual paths:

i) cease, in response to a determination that the location of the physical object is not in the second physical segment, to display the representation of the physical object in the first virtual path;

ii) disable the intrusion detection feature for the first physical segment; and

iii) activate the intrusion detection feature for the second physical segment that the user is located within;

detect an additional physical object;

determine that a location of the additional physical object is in the second physical segment; and

display, in response to the determination that the location of the additional physical object is in the second physical segment, a representation of the additional physical object in the second virtual path.

Assignments (2)
CHANGE OF NAME Recorded Jul 6, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060591/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2021
From: NORIS, GIOACCHINO; ALDERMAN, MATTHEW JAMES; ICHIM, ALEXANDRU-EUGEN
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 058358/0556 →
Continuity (1)
Continuation 16774788 · Jan 28, 2020
Cited By (3)
US 12,283,002 US 12,315,092 US 12,400,409