IP Library Granted Patent US 10,697,779
Granted Patent B2
US 10,697,779 · App. 15/494,216 · Granted Jun 30, 2020

Landmark placement for localization

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,697,779
App. No.
15/494,216
Granted
Jun 30, 2020
Kind
B2
Abstract

Embodiments are provided that include receiving sensor data from a sensor positioned at a plurality of positions in an environment. The environment includes a plurality of landmarks. The embodiments also include determining, based on the sensor data, a subset of the plurality of landmarks detected at each of the plurality of positions. The embodiments further include determining, based on the subset of the plurality of landmarks detected at each of the plurality of positions, a detection frequency of each landmark. The embodiments additionally include determining, based on the determined detection frequency of each landmark, a localization viability metric associated with each landmark. The embodiments still further include providing for display, via a user interface, a map of the environment. The map includes an indication of the localization viability metric associated with each landmark.

Claims (53)

1. A method comprising:

moving a sensor to a plurality of positions within an environment, wherein the environment comprises a plurality of landmarks;

obtaining sensor data using the sensor at each of the plurality of positions;

detecting one or more landmarks based on the sensor data obtained at each of the plurality of positions;

defining a respective region surrounding each respective landmark, wherein two or more different landmarks of the plurality of landmarks have different defined regions;

determining a detection frequency for each landmark, wherein the detection frequency corresponds to a number of positions at which sensor data was obtained within the region defined for a respective landmark, and to a number of times that the respective landmark was detected at the positions at which sensor data was obtained within the region;

determining, based on the determined detection frequency of each landmark, a localization viability metric associated with each landmark; and

providing for display, via a user interface, a map of the environment, wherein the map comprises an indication of the localization viability metric associated with each landmark.

2. The method of claim 1 , wherein the sensor is mounted on a manually-operated sensor device.

3. The method of claim 1 , wherein the sensor is mounted on a robotic vehicle.

4. The method of claim 3 , further comprising:

receiving additional sensor data from a second sensor positioned at a plurality of positions in the environment; and

determining, based on the additional sensor data, an updated localization viability metric associated with each landmark, wherein the map comprises an indication of the updated localization viability metric associated with each landmark.

5. The method of claim 1 , further comprising:

determining, for a given landmark, a number of landmarks detected at each position at which the given landmark was detected; and

determining the localization viability metric associated with the given landmark based on the number of landmarks detected at each position at which the given landmark was detected.

6. The method of claim 5 , further comprising:

determining, for the given landmark, a number of landmarks detected at a particular position of the plurality of positions;

determining whether the number of landmarks detected at the particular position meets or exceeds a detected landmark threshold; and

determining the localization viability metric associated with the given landmark based on the determination of whether the number of landmarks detected at the particular position meets or exceeds the detected landmark threshold.

7. The method of claim 1 , further comprising:

determining, for a given landmark, that the landmark is part of a geometric arrangement of landmarks that is similar to another arrangement of landmarks within the environment; and

determining the localization viability metric associated with the given landmark based on the determination that the landmark is part of a geometric arrangement of landmarks that is similar to another arrangement of landmarks within the environment.

8. The method of claim 1 , wherein the indication of the localization viability metric associated with a given landmark is selected from a plurality of viability levels, wherein each viability level is associated with a different color for display on the map.

9. The method of claim 8 , wherein selecting a viability level of the plurality for the given landmark comprises:

determining within which of a plurality of ranges of detection frequencies the detection frequency associated with the given landmark falls, wherein;

a first viability level of the plurality is associated with a first range of detection frequencies rates, and a second viability level of the plurality is associated with a second range of detection frequencies; and

the first viability level corresponds to a first color for display on the map of the environment and the second viability level corresponds to a second color for display on the map of the environment.

10. The method of claim 1 , wherein the indication of the localization viability metric associated with a given landmark comprises a colored portion of the map corresponding to a position of the landmark within the environment, wherein the colored portion of the map corresponding to the position of the landmark within the environment provides a visual indication of a viability level of the localization viability metric.

11. The method of claim 1 , wherein the provided map of the environment comprises an indication of a portion of the environment from which the sensor has obtained the sensor data and an indication of a portion of the environment from which the sensor has yet to obtain sensor data, wherein the portion of the environment from which the sensor has obtained the sensor data corresponds to the plurality of positions within the environment at which the sensor data was obtained.

12. The method of claim 1 , wherein providing the map of the environment comprises providing updates to the map based on the received sensor data.

13. A system comprising:

a sensor;

one or more processors;

a non-transitory computer-readable medium; and

program instructions stored on the non-transitory computer readable medium and executable by the one or more processors to:

move a sensor to a plurality of positions within an environment, wherein the environment comprises a plurality of landmarks;

obtain sensor data using the sensor at each of the plurality of positions;

detect one or more landmarks based on the sensor data obtained at each of the plurality of positions;

define a respective region surrounding each respective landmark, wherein two or more different landmarks of the plurality of landmarks have different defined regions;

determine a detection frequency for each landmark, wherein the detection frequency corresponds to a number of positions at which sensor data was obtained within the region defined for a respective landmark, and to a number of times that the respective landmark was detected at the positions at which sensor data was obtained within the region;

determine, based on the determined detection frequency of each landmark, a localization viability metric associated with each landmark; and

provide for display, via a user interface, a map of the environment, wherein the map comprises an indication of the localization viability metric associated with each landmark.

14. A non-transitory computer readable medium having stored therein instructions executable by one or more processors to cause a computing system to perform functions comprising:

moving a sensor to a plurality of positions within an environment, wherein the environment comprises a plurality of landmarks;

obtaining sensor data using the sensor at each of the plurality of positions;

detecting one or more landmarks based on the sensor data obtained at each of the plurality of positions;

defining a respective region surrounding each respective landmark, wherein two or more different landmarks of the plurality of landmarks have different defined regions;

determining a detection frequency for each landmark, wherein the detection frequency corresponds to a number of positions at which sensor data was obtained within the region defined for a respective landmark, and to a number of times that the respective landmark was detected at the positions at which sensor data was obtained within the region;

determining, based on the determined detection frequency of each landmark, a localization viability metric associated with each landmark; and

providing for display, via a user interface, a map of the environment, wherein the map comprises an indication of the localization viability metric associated with each landmark.

15. The method of claim 1 , wherein defining the respective region surrounding each respective landmark comprises defining, for each respective landmark, a region that excludes portions of the environment that visually block a line of sight to the respective landmark.

16. The method of claim 1 , wherein defining the respective region surrounding each respective landmark comprises defining an area for the respective region that is within a radius of each respective landmark.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2025
From: GOOGLE LLC
To: GDM HOLDING LLC
Reel/Frame 071109/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2023
From: X DEVELOPMENT LLC
To: GOOGLE LLC
Reel/Frame 064658/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2017
From: HOLZ, DIRK
To: X DEVELOPMENT LLC
Reel/Frame 042118/0597 →