IP Library › Granted Patent US 12,292,495
Granted Patent B2
US 12,292,495 · App. 17/655,783 · Granted May 6, 2025

Sensor data based map creation for autonomous systems and applications

Inventors: Amir Akbarzadeh (San Jose, CA); Andrew Carley (Kenmore, WA); Birgit Henke (Seattle, WA); Si Lu (San Jose, CA); Ivana Stojanovic (Oakland, CA); Jugnu Agrawal (San Jose, CA); Michael Kroepfl (Kirkland, WA); Yu Sheng (San Diego, CA); David Nister (Bellevue, WA); Enliang Zheng (Redmond, WA)
Assignee: NVIDIA CORPORATION
G01S13/04B60W40/10B60W40/12B60W60/001G01S7/003G01S7/40G01S13/86G01S13/89G01S13/931G01S17/04G01S17/931G06T7/73G06V10/26G06V10/28B60W2420/408G01S2013/9316G06T2207/10044G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,292,495
App. No.
17/655,783
Granted
May 6, 2025
Kind
B2
Abstract

One or more embodiments of the present disclosure relate to generation of map data. In these or other embodiments, the generation of the map data may include determining whether objects indicated by the sensor data are static objects or dynamic objects. Additionally or alternatively, sensor data may be removed or included in the map data based on determinations as to whether it corresponds to static objects or dynamic objects.

Claims (46)

1. A method comprising:

obtaining sensor data representative of a geographical area, the sensor data including one or more sensor data sets, at least one sensor data set of the one or more sensor data sets being obtained using one or more sensors disposed on a corresponding ego-machine of one or more ego-machines during traversal through the geographical area by the corresponding ego-machine; and

determining that an object indicated by the sensor data is a static object based at least on at least a threshold number of sensor data sets that individually indicate a presence of the object at a particular location in the geographical area.

2. The method of claim 1 , further comprising removing sensor data that corresponds to the object in response to determining that the object is not a static object.

3. The method of claim 1 , wherein the determining that the object is a static object includes determining that the object is indicated as being at the particular location by two or more sensor data sets that each correspond to a same track traversed by a same ego-machine through the geographical area.

4. The method of claim 1 , wherein the determining that the object is a static object includes determining that the object is indicated as being at the particular location by two or more sensor data sets that correspond to different tracks traversed through the geographical area.

5. The method of claim 1 , wherein the determining that the object is a static object further includes determining that the object is disposed along one or more tracks of the one or more ego-machines that correspond to one or more of the sensor data sets.

6. The method of claim 1 , wherein the determining that the object is a static object includes: performing a first determination that the object is a static object based at least on a first threshold number of first sensor data sets that indicate a presence of the object at the particular location, the first sensor data sets corresponding to a same track traversed by a same ego-machine through the geographical area; and

performing a second determination that the object is a static object based at least on a second threshold number of second sensor data sets that indicate a presence of the object at the particular location, the second sensor data sets each corresponding to different tracks traversed by two or more different ego-machines through the geographical area.

7. The method of claim 6 , wherein the second determination is performed in response to the first determination being that the object is a static object.

8. The method of claim 6 , wherein:

the second threshold number is larger than the first threshold number.

9. At least one processor comprising:

one or more circuits to:

obtain sensor data corresponding to a geographical area, the sensor data including one or more sensor data sets, at least one sensor data set of the one or more sensor data sets being obtained using one or more sensors disposed on a corresponding ego-machine of one or more ego-machines during traversal through the geographical area by the corresponding ego-machine; and

determine that an object indicated by the sensor data is a dynamic object based at least on a particular number of sensor data sets individually indicating a presence of the object at a particular location in the geographical area not satisfying one or more thresholds.

10. The at least one processor of claim 9 , wherein the one or more circuits are further to remove sensor data that corresponds to the object in response to determining that the object is a dynamic object.

11. The at least one processor of claim 9 , wherein the determining that the object is a dynamic object includes determining that the object is indicated as being at the particular location by less than a threshold number of sensor data sets that correspond to a same track traversed by a same ego-machine through the geographical area.

12. The at least one processor of claim 9 , wherein the determining that the object is a dynamic object includes determining that the object is indicated as being at the particular location by less than a threshold number of sensor data sets that correspond to different tracks traversed through the geographical area.

13. The at least one processor of claim 9 , wherein the determining that the object is a dynamic object is further based at least on the object being disposed along one or more tracks of the one or more ego-machines that correspond to one or more of the sensor data sets.

14. A system comprising:

one or more processors to:

obtain sensor data corresponding to a geographical area, the sensor data including a plurality of sensor data sets, at least one sensor data set of the plurality of sensor data sets being obtained using one or more sensors disposed on a corresponding ego-machine of one or more ego-machines during traversal through the geographical area by the corresponding ego-machine; and

determine that an object indicated by the sensor data is a static object based at least on a particular number of sensor data sets of the plurality of sensor data sets individually indicating a presence of the object at a particular location in the geographical area.

15. The system of claim 14 , wherein the determining that the object is a static object includes determining that the object is indicated as being at the particular location by a threshold number of sensor data sets that correspond to a same track traversed by a same ego-machine through the geographical area.

16. The system of claim 14 , wherein the determining that the object is a static object includes determining that the object is indicated as being at the particular location by a threshold number of sensor data sets that correspond to different tracks traversed through the geographical area.

17. The system of claim 14 , wherein the determining that the object is a static object is further based at least on whether the object is disposed along one or more tracks of the one or more ego-machines that correspond to one or more of the sensor data sets.

18. The system of claim 14 , wherein the determining that the object is a static object includes:

performing a first determination that the object is a static object based at least on a first number of first sensor data sets that indicate a presence of the object at the particular location, the first sensor data sets each corresponding to a same track traversed by a same ego-machine through the geographical area; and

performing a second determination that the object is a static object based at least on a second number of second sensor data sets that indicate a presence of the object at the particular location, the second sensor data sets each corresponding to different tracks traversed by two or more different ego-machines through the geographical area.

19. The system of claim 18 , wherein the second determination is performed in response to the first determination being that the object is a static object.

20. The system of claim 18 , wherein:

the first determination is based at least on the first number of first sensor data sets satisfying a first threshold; and

the second determination is based at least on the second number of second sensor data sets satisfying a second threshold that is greater than or equal to the first threshold.

21. The system of claim 14 , wherein the system is implemented in or is associated with one or more of:

a control system for an autonomous or semi-autonomous machine;

a perception system for an autonomous or semi-autonomous machine;

a system for performing simulation operations;

a system for performing deep learning operations;

a system for generating synthetic data;

a system for generating multi-dimensional assets using a collaborative content platform;

a system implemented using an edge device;

a system implemented using a robot;

a system incorporating one or more virtual machines (VMs);

a system implemented at least partially in a data center; or

a system implemented at least partially using cloud computing resources.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2022
From: AKBARZADEH, AMIR; CARLEY, ANDREW; HENKE, BIRGIT; NISTER, DAVID; ZHENG, ENLIANG; STOJANOVIC, IVANA; KROEPFL, MICHAEL; SHENG, YU; AGRAWAL, JUGNU; LU, SI
To: NVIDIA CORPORATION
Reel/Frame 060143/0513 →
Continuity (2)
Provisional Application 63269602 · Mar 18, 2022
Related Publication 20230296748A1 · Sep 21, 2023
References Cited (27)
US 9623905B2 · Shashua · 2017 [cited by examiner]
US 9631943B2 · Shashua · 2017 [cited by examiner]
US 9665100B2 · Shashua · 2017 [cited by examiner]
US 9933268B2 · Bagheri · 2018 [cited by examiner]
US 10697779B2 · Holz · 2020 [cited by examiner]
US 10838067B2 · Izzat · 2020 [cited by examiner]
US 11170567B2 · Omari · 2021 [cited by examiner]
US 11237004B2 · Prasser · 2022 [cited by examiner]
US 11402468B2 · Emadi · 2022 [cited by examiner]
US 11971487B2 · Muramatsu · 2024 [cited by examiner]
US 20150378015A1 · You · 2015 [cited by examiner]
US 20160161265A1 · Bagheri · 2016 [cited by examiner]
US 20170010616A1 · Shashua · 2017 [cited by examiner]
US 20170010617A1 · Shashua · 2017 [cited by examiner]
US 20170010618A1 · Shashua · 2017 [cited by examiner]
US 20180120419A1 · Bialer · 2018 [cited by examiner]
US 20180203124A1 · Izzat · 2018 [cited by examiner]
US 20180306589A1 · Holz · 2018 [cited by examiner]
US 20190041523A1 · Muramatsu · 2019 [cited by examiner]
US 20190220003A1 · Sharma · 2019 [cited by examiner]
US 20190301873A1 · Prasser · 2019 [cited by examiner]
US 20210173043A1 · Lang · 2021 [cited by examiner]
US 20210199759A1 · Emadi · 2021 [cited by examiner]
US 20210383695A1 · Kose Cihangir · 2021 [cited by examiner]
US 20230213664A1 · Kulkarni · 2023 [cited by examiner]
US 20230230258A1 · Psota · 2023 [cited by examiner]
US 20230316735A1 · Lee · 2023 [cited by examiner]