IP Library Granted Patent US 10,976,412
Granted Patent B2
US 10,976,412 · App. 16/264,807 · Granted Apr 13, 2021

Deep learning for super resolution in a radar system

Inventors: Yaron Eshet (Haifa, IL); Igal Bilik (Rehovot, IL); Oded Bialer (Petah Tivak, IL)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G01S7/417G01S13/931
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,976,412
App. No.
16/264,807
Granted
Apr 13, 2021
Kind
B2
Abstract

A system and method to use deep learning for super resolution in a radar system include obtaining first-resolution time samples from reflections based on transmissions by a first-resolution radar system of multiple frequency-modulated signals. The first-resolution radar system includes multiple transmit elements and multiple receive elements. The method also includes reducing resolution of the first-resolution time samples to obtain second-resolution time samples, implementing a matched filter on the first-resolution time samples to obtain a first-resolution data cube and on the second-resolution time samples to obtain a second-resolution data cube, processing the second-resolution data cube with a neural network to obtain a third-resolution data cube, and training the neural network based on a first loss obtained by comparing the first-resolution data cube with the third-resolution data cube. The neural network is used with a second-resolution radar system to detect one or more objects.

Claims (29)

1. A method of using deep learning for super resolution in a radar system, the method comprising:

obtaining first-resolution time samples from reflections based on transmissions by a first-resolution radar system of multiple frequency-modulated signals, wherein the first-resolution radar system includes multiple transmit elements and multiple receive elements;

reducing resolution of the first-resolution time samples to obtain second-resolution time samples;

implementing a matched filter on the first-resolution time samples to obtain a first-resolution data cube and on the second-resolution time samples to obtain a second-resolution data cube;

processing the second-resolution data cube with a neural network to obtain a third-resolution data cube;

training the neural network based on a first loss obtained by comparing the first-resolution data cube with the third-resolution data cube; and

using the neural network with a second-resolution radar system to detect one or more objects.

2. The method according to claim 1 , further comprising disposing the second-resolution radar system in a vehicle.

3. The method according to claim 1 , further comprising performing detection of the one or more objects using the first-resolution data cube and using the third-resolution data cube.

4. The method according to claim 3 , wherein the training the neural network is based on a second loss obtained by comparing a result of the detection performed using the first-resolution data cube with a result of the detection performed using the third-resolution data cube.

5. The method according to claim 1 , further comprising inverting the third-resolution data cube to obtain third-resolution time samples.

6. The method according to claim 5 , wherein the training the neural network is based on a third loss obtained by comparing the first-resolution time samples with the third-resolution time samples.

7. The method according to claim 1 , wherein the reducing the resolution includes using all the first-resolution time samples resulting from only a sub-set of the multiple frequency-modulated signals.

8. The method according to claim 1 , wherein the reducing the resolution includes using only a sub-set of the first-resolution time samples resulting from all the multiple frequency-modulated signals.

9. The method according to claim 1 , wherein the reducing the resolution includes using the first-resolution time samples resulting from only a sub-set of the multiple transmit elements and the multiple receive elements of the first-resolution radar system.

10. The method according to claim 1 , wherein the reducing the resolution includes obtaining the second-resolution time samples at a same resolution as time samples provided by the second-resolution radar system.

11. A system to use deep learning for super resolution in a radar system, the system comprising:

a first-resolution radar system configured to obtain first-resolution time samples from reflections based on transmissions of multiple frequency-modulated signals, wherein the first-resolution radar system includes multiple transmit elements and multiple receive elements;

a processor configured to reduce resolution of the first-resolution time samples to obtain second-resolution time samples, to implement a matched filter on the first-resolution time samples to obtain a first-resolution data cube and on the second-resolution time samples to obtain a second-resolution data cube, to process the second-resolution data cube with a neural network to obtain a third-resolution data cube, and to train the neural network based on a first loss obtained by comparing the first-resolution data cube with the third-resolution data cube; and

a second-resolution radar system configured to use the neural network to detect one or more objects.

12. The system according to claim 11 , wherein the second-resolution radar system is in a vehicle.

13. The system according to claim 11 , wherein the processor is further configured to perform detection of the one or more objects using the first-resolution data cube and using the third-resolution data cube.

14. The system according to claim 13 , wherein the processor is configured to train the neural network based on a second loss obtained by comparing a result of the detection performed using the first-resolution data cube with a result of the detection performed using the third-resolution data cube.

15. The system according to claim 11 , wherein the processor is further configured to invert the third-resolution data cube to obtain third-resolution time samples.

16. The system according to claim 15 , wherein the processor is configured to train the neural network based on a third loss obtained by comparing the first-resolution time samples with the third-resolution time samples.

17. The system according to claim 11 , wherein the processor is configured to reduce the resolution of the first-resolution time samples by using all the first-resolution time samples resulting from only a sub-set of the multiple frequency-modulated signals.

18. The system according to claim 11 , wherein the processor is configured to reduce the resolution of the first-resolution time samples by using only a sub-set of the first-resolution time samples resulting from all the multiple frequency-modulated signals.

19. The system according to claim 11 , wherein the processor is configured to reduce the resolution of the first-resolution time samples by using the first-resolution time samples resulting from only a sub-set of the multiple transmit elements and the multiple receive elements of the first-resolution radar system.

20. The system according to claim 11 , wherein the processor is configured to reduce the resolution to obtain the second-resolution time samples at a same resolution as time samples provided by the second-resolution radar system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2019
From: ESHET, YARON; BILIK, IGAL; BIALER, ODED
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 048216/0252 →
Continuity (1)
Related Publication 20200249314A1 · Aug 6, 2020