IP Library Granted Patent US 12,229,904
Granted Patent B2
US 12,229,904 · App. 18/168,491 · Granted Feb 18, 2025

Adaptive model updates for dynamic and static scenes

Inventors: Fabian Langguth (Zurich, CH); Alexander Sorkine Hornung (Zurich, CH)
Assignee: Meta Platforms Technologies, LLC
G06T19/006G06T17/00G06T19/20G06V10/255G06V20/64G06T2200/04G06T2210/36G06T2219/004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,904
App. No.
18/168,491
Granted
Feb 18, 2025
Kind
B2
Abstract

In one embodiment, a computing system may monitor one or more regions of a first 3D model of an environment to determine a frequency the respective region changes. The computing system may determine a first region of the one or more regions is static based on the frequency the respective region changes. The computing system may delay a first time period to a second time period to update the first 3D model based on comparisons between a second 3D model and first depth measurements of the first region. The computing system may detect whether the first region changed after the second time period based on comparisons between the second 3D model and the first depth measurements of the first region. The computing system may in response to detecting a change in the first region, update the first 3D model of the first region.

Claims (45)

1. A method comprising, by a computing system:

monitoring one or more regions of a first 3D model of an environment to determine a frequency a respective region changes;

determining a first region of the one or more regions is static based on the frequency the respective region changes;

delaying a first time period to a second time period to update the first 3D model based on comparisons between a second 3D model and first depth measurements of the first region;

detecting whether the first region changed after the second time period based on the comparisons between the second 3D model and the first depth measurements of the first region; and

in response to detecting a change in the first region, updating the first 3D model of the first region.

2. The method of claim 1 , wherein the first 3D model comprises a plurality of voxels.

3. The method of claim 2 , wherein the second 3D model comprises a set of the plurality of voxels of the first 3D model.

4. The method of claim 1 , wherein the second 3D model comprises a plurality of voxel occupancy values.

5. The method of claim 1 , further comprising:

identifying one or more objects using the first 3D model to detect objects in the environment; and

assigning one or more characteristics to the identified one or more objects based on a respective object.

6. The method of claim 5 , further comprising:

segmenting the environment into a plurality of regions based on the one or more characteristics assigned to the identified one or more objects.

7. The method of claim 5 , further comprising:

tracking the one or more identified objects based on the first 3D model, wherein updates to the first 3D model updates a position of the one or more identified objects.

8. The method of claim 1 , further comprising:

segmenting the environment into a plurality of regions based on a predetermined segmentation pattern for the environment.

9. The method of claim 1 , wherein one or more characteristics are associated with the first region, and wherein the detecting whether the first region changed occurs after a third time period based on the characteristics associated with the first region.

10. The method of claim 1 , wherein the detecting whether the first region changed comprises comparing the first depth measurements of the first region to a plurality of voxels of the second 3D model of the first region.

11. The method of claim 1 , wherein the detecting whether the first region changed comprises comparing the first depth measurements of the first region to a plurality of voxel occupancy values of the second 3D model of the first region.

12. The method of claim 1 , wherein the detecting whether the first region changed comprises determining whether the change between the second 3D model of the first region and the first depth measurements of the first region generated after the second time period exceeds a threshold change.

13. The method of claim 12 , wherein the threshold change comprises one of a threshold number of voxels and a threshold number of voxel occupancy values.

14. The method of claim 1 , further comprising:

labeling the one or more regions of the first 3D model based on a frequency of previous updates to the respective region, wherein the detecting whether the first region changed occurs after a third time period based on a label of the respective region.

15. The method of claim 1 , further comprising:

detecting whether a second region changed after a third time period based on comparisons between the second 3D model of the second region and second depth measurements of the second region; and

in response to detecting a change in the second region falls below a threshold change, skipping an update to the first 3D model of the second region.

16. The method of claim 1 , wherein a resolution of the second 3D model is lower than a resolution of the first 3D model.

17. One or more computer-readable non-transitory storage media embodying software that is operable when executed by one or more processors to:

monitor one or more regions of a first 3D model of an environment to determine a frequency a respective region changes;

determine a first region of the one or more regions is static based on the frequency the respective region changes;

delay a first time period to a second time period to update the first 3D model based on comparisons between a second 3D model and first depth measurements of the first region;

detect whether the first region changed after the second time period based on the comparisons between the second 3D model and the first depth measurements of the first region; and

in response to detecting a change in the first region, update the first 3D model of the first region.

18. The one or more computer-readable non-transitory storage media of claim 17 , wherein the first 3D model comprises a plurality of voxels.

19. A system comprising:

one or more processors; and

one or more computer-readable non-transitory storage media coupled to the one or more processors and comprising instructions operable when executed by the one or more processors to cause the system to:

monitor one or more regions of a first 3D model of an environment to determine a frequency a respective region changes;

determine a first region of the one or more regions is static based on the frequency the respective region changes;

delay a first time period to a second time period to update the first 3D model based on comparisons between a second 3D model and first depth measurements of the first region;

detect whether the first region changed after the second time period based on the comparisons between the second 3D model and the first depth measurements of the first region; and

in response to detecting a change in the first region, update the first 3D model of the first region.

20. The system of claim 19 , wherein the first 3D model comprises a plurality of voxels.

Continuity (3)
Continuation 17220814 · Apr 1, 2021
Provisional Application 63078804 · Sep 15, 2020
Related Publication 20230245404A1 · Aug 3, 2023
References Cited (2)
US 20150262412A1 · Gruber et al. · 2015 [cited by applicant]
US 20170278304A1 · Hildreth et al. · 2017 [cited by applicant]