IP Library › Granted Patent US 11,961,296
Granted Patent B2
US 11,961,296 · App. 18/159,234 · Granted Apr 16, 2024

Systems and methods for detecting objects within the boundary of a defined space while in artificial reality

Inventors: Alexandru-Eugen Ichim (Ruschlikon, CH); Sarthak Ray (Santa Clara, CA); Alexander Sorkine Hornung (Zurich, CH); Gioacchino Noris (Zurich, CH); Gaurav Chaurasia (Meilen, CH); Jan Oberländer (Binningen, CH)
Assignee: Meta Platforms Technologies, LLC
G06V20/20G06F3/013G06T7/74G06T15/205G06T19/006G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,961,296
App. No.
18/159,234
Granted
Apr 16, 2024
Kind
B2
Abstract

A system generates a plurality of spatial points based on depth measurements of physical objects. The system determines, based on the plurality of spatial points, an occupancy score for each voxel within a plurality of voxels. The system identifies, based on a gaze of the user, a first set of occupied voxels that are in a field of view of the user and a second set of occupied voxels that are outside the field of view of the user. The system updates the occupancy scores of the first set of occupied voxels by temporally decaying one or more of the plurality of spatial points within the first set of occupied voxels. The system maintains the occupancy scores of the second set of occupied voxels. The system detects intrusions in a predefined subspace within a physical space based on the updated occupancy scores of the first set of occupied voxels.

Claims (42)

1. A method comprising, by a computing system:

generating a plurality of spatial points based on depth measurements of one or more physical objects within a physical space surrounding a user;

determining, based on the spatial points, an occupancy score for each voxel within a plurality of voxels;

rendering, based on the occupancy score for each voxel, a virtual space representing the physical space,

displaying the virtual space to the user;

while displaying the virtual space, receiving an input from the user creating a boundary of a subspace within the virtual space;

determining, based on the occupancy scores of the plurality of voxels, that additional unoccupied space exists outside of the boundary of the subspace; and

outputting a suggestion to the user to expand the boundary of the subspace based on the determination that additional unoccupied space exists outside of the boundary of the subspace.

2. The method of claim 1 , further comprising:

in response to a determination that additional unoccupied space exists outside of the boundary of the subspace, providing tools to the user to modify the boundary.

3. The method of claim 1 , wherein the one or more of the plurality of spatial points are temporally decayed based on a lifespan associated with each of the one or more of the plurality of spatial points.

4. The method of claim 1 , wherein the one or more of the plurality of spatial points that are temporally decayed are located within a predetermined distance from a device worn by the user.

5. The method of claim 1 , wherein the occupancy score for each voxel within the plurality of voxels has a predetermined maximum value.

6. The method of claim 1 , wherein the occupancy score for each voxel within the plurality of voxels is determined based on a number of spatial points within that voxel.

7. A system comprising one or more processors and one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:

generate a plurality of spatial points based on depth measurements of one or more physical objects within a physical space surrounding a user;

determine, based on the spatial points, an occupancy score for each voxel within a plurality of voxels;

render, based on the occupancy score for each voxel, a virtual space representing the physical space,

display the virtual space to the user;

while displaying the virtual space, receive an input from the user creating a boundary of a subspace within the virtual space;

determine, based on the occupancy scores of the plurality of voxels, that additional unoccupied space exists outside of the boundary of the subspace; and

output a suggestion to the user to expand the boundary of the subspace based on the determination that additional unoccupied space exists outside of the boundary of the subspace.

8. The system of claim 7 , further comprising instructions operable when executed by one or more of the processors to cause the system to:

in response to a determination that additional unoccupied space exists outside of the boundary of the subspace, provide tools to the user to modify the boundary.

9. The system of claim 7 , wherein the one or more of the plurality of spatial points are temporally decayed based on a lifespan associated with each of the one or more of the plurality of spatial points.

10. The system of claim 7 , wherein the one or more of the plurality of spatial points that are temporally decayed are located within a predetermined distance from a device worn by the user.

11. The system of claim 7 , wherein the occupancy score for each voxel within the plurality of voxels has a predetermined maximum value.

12. The system of claim 7 , wherein the occupancy score for each voxel within the plurality of voxels is determined based on a number of spatial points within that voxel.

13. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

generate a plurality of spatial points based on depth measurements of one or more physical objects within a physical space surrounding a user;

determine, based on the spatial points, an occupancy score for each voxel within a plurality of voxels;

render, based on the occupancy score for each voxel, a virtual space representing the physical space,

display the virtual space to the user;

while displaying the virtual space, receive an input from the user creating a boundary of a subspace within the virtual space;

determine, based on the occupancy scores of the plurality of voxels, that additional unoccupied space exists outside of the boundary of the subspace; and

output a suggestion to the user to expand the boundary of the subspace based on the determination that additional unoccupied space exists outside of the boundary of the subspace.

14. The one or more computer-readable non-transitory storage media of claim 13 , wherein the software is further operable to:

in response to a determination that additional unoccupied space exists outside of the boundary of the subspace, provide tools to the user to modify the boundary.

15. The one or more computer-readable non-transitory storage media of claim 13 , wherein the one or more of the plurality of spatial points are temporally decayed based on a lifespan associated with each of the one or more of the plurality of spatial points.

16. The one or more computer-readable non-transitory storage media of claim 13 , wherein the one or more of the plurality of spatial points that are temporally decayed are located within a predetermined distance from a device worn by the user.

17. The one or more computer-readable non-transitory storage media of claim 13 , wherein the occupancy score for each voxel within the plurality of voxels has a predetermined maximum value.

18. The one or more computer-readable non-transitory storage media of claim 13 , wherein the occupancy score for each voxel within the plurality of voxels is determined based on a number of spatial points within that voxel.

Continuity (3)
Continuation 17479961 · Sep 20, 2021
Continuation 16844913 · Apr 9, 2020
Related Publication 20230177833A1 · Jun 8, 2023
Cited By (3)
US 12,283,002 US 12,315,092 US 12,400,409