IP Library Granted Patent US 12,092,754
Granted Patent B2
US 12,092,754 · App. 17/229,338 · Granted Sep 17, 2024

Detection or correction for multipath reflection

Inventors: Bo Li (Pittsburgh, PA); James Curry (Bozeman, MT); Shaogang Wang (Pittsburgh, PA)
Assignee: Aurora Operations, Inc
G01S7/021G01S7/4804G01S13/865G01S13/931
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,092,754
App. No.
17/229,338
Granted
Sep 17, 2024
Kind
B2
Abstract

Ranging and detection data is processed to identify or correct for multipath reflection. A sensor point that represents a location of an object, the location based on an incidence of an electromagnetic wave received at a sensor is obtained. The first sensor point is determined to be a product of multipath reflection. A first point of reflection on a surface of a surface model is determined. The location of the first sensor point is corrected based on the first point of reflection on the surface of the surface model.

Claims (49)

1. A method comprising:

obtaining a location of a first sensor point that represents a location of an image of an object, wherein the first sensor point is associated with a mirror image of the object across a surface plane;

determining that the first sensor point is a product of multipath reflection using a surface model;

determining a first point of reflection on a surface of the surface model; and

correcting the location of the first sensor point based on the first point of reflection on the surface of the surface model, wherein correcting the location of the first sensor point includes:

determining a surface plane at the first point of reflection on the surface of the surface model at least in part by:

querying a neighborhood of the first point of reflection on the surface of the surface model;

computing a normal associated with the surface plane based on the neighborhood of the first point of reflection on the surface of the surface model, wherein the surface plane is based on the computed normal; and

mirroring the first sensor point across the surface plane at the first point of reflection to represent the location of the object.

2. The method of claim 1 , wherein the multipath reflection includes a reflection of an electromagnetic wave at the object and one or more other surfaces before the electromagnetic wave is received at a sensor.

3. The method of claim 1 , wherein determining the first sensor point is a product of multipath reflection is based on the location of the first sensor point relative to the surface of the surface model.

4. The method of claim 1 , further comprising:

obtaining a second sensor point;

determining that the second sensor point is the product of multipath reflection;

determining a second point of reflection on the surface of the surface model; and

correcting a location of the second sensor point based on the second point of reflection on the surface.

5. The method of claim 1 , wherein determining the first point of reflection on the surface using at least one of a binary search and a linear step progression.

6. The method of claim 1 , further comprising:

incorporating the first sensor point and the surface model into a common coordinate system.

7. The method of claim 2 , wherein the electromagnetic wave is one of light, wherein the sensor includes a light detection and ranging (LIDAR) sensor; and

a radio wave, wherein the sensor includes a radio detection and ranging (RADAR) sensor.

8. The method of claim 1 , wherein the first sensor point is determined to be the product of multipath reflection when an altitude of the first sensor point is determined to be below an altitude of the surface of the surface model, wherein the surface model is a model of a ground surface and based on a three-dimensional map.

9. The method of claim 1 , wherein the object is a physical object and the surface model is generated from a three-dimensional map.

10. The method of claim 1 , wherein the location of the image of the object represented by the location of the first sensor point, due to the multipath reflection, is the mirror image of the location of the object reflected across the surface plane.

11. A system comprising one or more processors and memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to perform operations including:

obtain a location of a first sensor point that represents a location of an image of an object, the first sensor point is associated with a mirror image of the object across a surface plane;

determine that the first sensor point is a product of multipath reflection;

determine a first point of reflection on a surface of a surface model; and

correct the location of the first sensor point based on the first point of reflection on the surface of the surface model, wherein the operations to correct the location of the first sensor point including:

determine a surface plane at the first point of reflection on the surface of the surface model at least in part by:

query a neighborhood of the first point of reflection on the surface of the surface model;

compute a normal associated with the surface plane based on the neighborhood of the first point of reflection on the surface of the surface model, wherein the surface plane is based on the computed normal; and

mirror the first sensor point across the surface plane at the first point of reflection to represent the location of the object.

12. The system of claim 11 , wherein the multipath reflection includes a reflection of an electromagnetic wave at the object and one or more other surfaces before the electromagnetic wave is received at a sensor.

13. The system of claim 11 , wherein determining the first sensor point is a product of multipath reflection is based on the location of the first sensor point relative to the surface of the surface model.

14. The system of claim 11 , wherein the operations further comprise:

obtain a second sensor point;

determine that the second sensor point is the product of multipath reflection;

determine a second point of reflection on the surface of the surface model; and

correct a location of the second sensor point based on the second point of reflection on the surface.

15. The system of claim 11 , wherein determining the first point of reflection on the surface uses at least one of a binary search and a linear step progression.

16. The system of claim 11 , wherein the operations further comprise:

incorporate the first sensor point and the surface model into a common coordinate system.

17. The system of claim 12 , wherein the electromagnetic wave is one of:

light, wherein the sensor includes a light detection and ranging (LIDAR) sensor; and

a radio wave, wherein the sensor includes a radio detection and ranging (RADAR) sensor.

18. The system of claim 11 , wherein the first sensor point is determined to be the product of multipath reflection when an altitude of the first sensor point is determined to be below an altitude of the surface of the surface model, wherein the surface model is a model of ground surface and based on a three-dimensional map.

19. The system of claim 11 , wherein the object is a physical object and the surface model is generated from a three-dimensional map.

20. The system of claim 11 , wherein the location of the image of the object represented by the location of the first sensor point, due to the multipath reflection, is the mirror image of the location of the object reflected across the surface plane.

Assignments (3)
CHANGE OF NAME Recorded Jun 30, 2021
From: AURORA INNOVATION OPCO, INC.
To: AURORA OPERATIONS, INC.
Reel/Frame 056779/0958 →
MERGER AND CHANGE OF NAME Recorded Jun 29, 2021
From: AVIAN U MERGER SUB CORP.; AURORA INNOVATION, INC.
To: AURORA INNOVATION OPCO, INC.
Reel/Frame 056706/0473 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2021
From: LI, BO; CURRY, JAMES; WANG, SHAOGANG
To: AURORA INNOVATION, INC.
Reel/Frame 055929/0113 →
Continuity (1)
Related Publication 20220326343A1 · Oct 13, 2022