IP Library › Granted Patent US 11,255,960
Granted Patent B2
US 11,255,960 · App. 16/752,575 · Granted Feb 22, 2022

Synthetic aperture radar (SAR) based convolutional navigation

Inventors: Soheil Kolouri (Calabasas, CA); Shankar R. Rao (Norwalk, CA)
Assignee: The Boeing Company
G01S13/9027G01S7/417G01S13/9052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,255,960
App. No.
16/752,575
Granted
Feb 22, 2022
Kind
B2
Abstract

A synthetic aperture radar (SAR) system is disclosed. The SAR comprises a memory, a convolutional neural network (CNN), a machine-readable medium on the memory, and a machine-readable medium on the memory. The machine-readable medium storing instructions that, when executed by the CNN, cause the SAR system to perform operations. The operation comprises: receiving range profile data associated with observed views of a scene; concatenating the range profile data with a template range profile data of the scene; and estimating registration parameters associated with the range profile data relative to the template range profile data to determine a deviation from the template range profile data.

Claims (71)

1. A method comprising:

receiving range profile data associated with observed views of a scene, wherein the range profile data comprises information captured via a synthetic aperture radar (SAR);

concatenating the range profile data with a template range profile data of the scene to form concatenated data; and

estimating registration parameters associated with the range profile data relative to the template range profile data with a convolutional neural network (CNN) to determine a deviation from the template range profile data.

2. The method of claim 1 , wherein estimating the registration parameters comprises regressing over the concatenated data with the CNN to predict the registration parameters, wherein the concatenated data forms an image with two channels that is regressed by the CNN.

3. The method of claim 2 , wherein the range profile data is a two-dimensional array.

4. The method of claim 3 , wherein the CNN is trained by a sub-method that comprises:

synthesizing a synthesized template range profile data of a simulated scene;

synthesizing a synthesized observed range profile data of the simulated scene with random registration parameters;

concatenating the synthesized observed range profile data with the synthesized template range profile data to form concatenated synthesized data;

feeding the concatenated synthesized data to the CNN;

estimating simulated registration parameters associated with the concatenated synthesized data;

running a backpropagation on a difference between the predicted registration parameters and the simulated parameters; and

updating the CNN with the backpropagation.

5. The method of claim 4 , wherein the predicted registration parameters are predicted based on the synthesized template range profile data and the synthesized observed range profile data of the simulated scene.

6. The method of claim 4 , further comprising:

storing the template range profile data in a memory; and

updating a synthetic aperture radar navigation based on the deviation from the template range profile data.

7. The method of claim 1 , wherein the registration parameters comprise one of a rotation angle, an x,y translation, or a scaling of the range profile data relative to the template range profile data.

8. The method of claim 1 , wherein the template range profile data comprises a plurality of projection angles of the scene, and the receiving the range profile data further comprises receiving the range profile data comprising a subset of the plurality of projection angles of the scene.

9. The method of claim 1 , further comprising:

receiving synthetic aperture radar phase history data of the observed views of the scene from a spotlight mode synthetic aperture radar sensor; and

applying a radon transform to the synthetic aperture radar phase history data to generate the range profile data.

10. An aerial vehicle configured to perform the method of claim 1 , the aerial vehicle comprising:

a memory comprising a plurality of executable instructions and adapted to store template range profile data;

the SAR; and

one or more processors configured as the CNN for executing the plurality of instructions to perform the method of claim 1 .

11. A synthetic aperture radar (SAR) system comprising:

a memory;

a convolutional neural network (CNN);

a machine-readable medium on the memory, the machine-readable medium storing instructions that, when executed by the CNN, cause the SAR system to perform operations comprising:

receiving range profile data associated with observed views of a scene;

concatenating the range profile data with a template range profile data of the scene; and

estimating registration parameters associated with the range profile data relative to the template range profile data to determine a deviation from the template range profile data.

12. The SAR of claim 11 , wherein estimating the registration parameters comprises regressing over the concatenated data with the CNN to predict the registration parameters, wherein the range profile data is a two-dimensional array and the concatenated data forms an image with two channels that is regressed by the CNN.

13. The SAR of claim 12 , wherein the CNN is trained by a sub-method that comprises:

synthesizing template range profile data of a simulated scene;

synthesizing observed range profile data of the simulated scene with random registration parameters;

concatenating the synthesized range profile data with the synthesized template range profile data to form concatenated synthesized data;

feeding the concatenated synthesized data to the CNN;

estimating simulated registration parameters associated with the concatenated synthesized data;

running a backpropagation on a difference between the predicted registration parameters and the simulated parameters; and

updating the CNN with the backpropagation.

14. The SAR system of claim 13 , wherein the registration parameters comprise one of a rotation angle, an x,y translation, or a scaling of the range profile data relative to the template range profile data.

15. The SAR system of claim 13 , wherein the template range profile data comprises a plurality of projection angles of the scene, and the receiving further comprises receiving the range profile data comprising a subset of the plurality of projection angles of the scene.

16. The SAR system of claim 13 , further comprising:

receiving synthetic aperture radar phase history data of the observed views of the scene from a spotlight mode synthetic aperture radar sensor; and

applying a radon transform to the synthetic aperture radar phase history data to generate the range profile data.

17. The SAR system of claim 16 , further comprising:

storing the template range profile data in a memory; and

updating a synthetic aperture radar navigation based on the deviation from the template range profile data.

18. A synthetic aperture radar (SAR) system on a vehicle, the SAR system comprising:

an antenna that is fixed and directed outward from a side of the vehicle;

a SAR sensor;

a storage; and

a computing device, wherein the computing device comprises

a memory;

a convolutional neural network (CNN);

a machine-readable medium on the memory, the machine-readable medium storing instructions that, when executed by the CNN, cause the SAR system to perform operations comprising:

receiving range profile data associated with observed views of a scene;

concatenating the range profile data with a temple range profile data of the scene; and

estimating registration parameters associated with the range profile data relative to the template range profile data to determine a deviation from the template range profile data.

19. The SAR of claim 18 , wherein estimating the registration parameters comprises regressing over the concatenated data with the CNN to predict the registration parameters, wherein the range profile data is a two-dimensional array and the concatenated data forms an image with two channels that is regressed by the CNN.

20. The SAR of claim 19 , wherein the CNN is trained by a sub-method that comprises:

synthesizing template range profile data of a simulated scene;

synthesizing observed range profile data of the simulated scene with random registration parameters;

concatenating the synthesized range profile data with the synthesized template range profile data to form concatenated synthesized data;

feeding the concatenated synthesized data to the CNN;

estimating simulated registration parameters associated with the concatenated synthesized data;

running a backpropagation on a difference between the predicted registration parameters and the simulated parameters; and

updating the CNN with the backpropagation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2020
From: KOLOURI, SOHEIL; RAO, SHANKAR
To: THE BOEING COMPANY
Reel/Frame 051634/0653 →
Continuity (1)
Related Publication 20210231795A1 · Jul 29, 2021
Cited By (3)
US 12,469,179 US 12,477,117 US 12,701,235