IP Library Granted Patent US 10,140,690
Granted Patent B2
US 10,140,690 · App. 15/424,252 · Granted Nov 27, 2018

System and method for image presentation by a vehicle driver assist module

Inventors: Pranjal Chakraborty (Bangalore, IN); Rajesh Biswal (Bangalore, IN); Debashis Mukherjee (Bangalore, IN)
Assignee: Harman International Industries, Incorporated
G06T5/003B60K35/00B60R1/00G02B27/0172G06T11/60H04N7/183B60K2350/106B60K2350/2013B60K2350/2052B60K2350/352B60R2300/205B60R2300/207B60R2300/307B60R2300/8033B60R2300/8093G02B2027/014G02B2027/0141G02B2027/0178G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/20221G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,140,690
App. No.
15/424,252
Granted
Nov 27, 2018
Kind
B2
Abstract

The present disclosure relates to systems, devices and methods for image presentation for vehicle driver assistance. In one embodiment, a method includes receiving image data representing an outside of a vehicle and enhancing the image data. Image enhancement can include inverting the image data, running a dehazing operation based on scene radiance, medium transmission and atmospheric light of the image data. The method may also include generating reconstructed image data from the enhanced image data by performing a sparse representation of the enhanced image data for denoising of the enhanced image data, and performing a learning operation to identify and enhance objects of interest in the enhanced image data with the sparse representation. The method also includes outputting the reconstructed image data to a display unit of the vehicle. Vehicle driver assist systems and devices are provided to enhance image data detected by vehicle cameras and wearable devices.

Claims (38)

1. A method for image presentation by a vehicle driver assist module, the method comprising:

receiving, by a driver assist module, image data representing an outside of a vehicle;

inverting, by the driver assist module, the image data to form inverted image data;

running, by the driver assist module, a dehazing operation on inverted image data to generate enhanced inverted image data of the outside of the vehicle, wherein the dehazing operation is based on scene radiance, medium transmission and atmospheric light of the image data;

inverting, by the driver assist module, the enhanced inverted image data to generate enhanced image data;

generating, by the driver assist module, reconstructed image data from the enhanced image data, wherein the reconstructed image data is generated by

performing a sparse representation of the enhanced image data for denoising of the enhanced image data, and

performing a learning operation to identify and enhance objects of interest in the enhanced image data with the sparse representation; and

outputting, by the driver assist module, the reconstructed image data to a display unit of the vehicle.

2. The method of claim 1 , wherein the image data representing an outside of a vehicle includes video data captured by a front facing camera of the vehicle.

3. The method of claim 1 , wherein the image data representing an outside of a vehicle includes image data captured by a wearable device associated with an operator of the vehicle.

4. The method of claim 1 , wherein inverting includes pixel-wise inversion of entire frames of the image data.

5. The method of claim 1 , wherein the dehazing operation includes determining scene radiance for the inverted video data based on an adjustment parameter to the medium transmission.

6. The method of claim 1 , wherein the sparse representation of the enhanced image data utilizes existing, or infers, a combination of basic elements for frames of the image data forming a dictionary of atoms to change noise level for basic elements of the frame.

7. The method of claim 1 , wherein performing a learning operation to identify and enhance objects of interest in the enhanced image data with the sparse representation includes identification of objects in frames, comparison and adjustment of objects in frames, and selection of one or more objects to identify in frames of the image data.

8. The method of claim 1 , wherein the sparse representation and the learning operation are performed based on comparison of a daylight image associated with the image data using position of the vehicle.

9. The method of claim 1 , wherein generating reconstructed image data based on the enhanced image data includes stitching denoised image data from the sparse representation with objects identified by the learning module.

10. The method of claim 1 , wherein outputting the reconstructed image data includes superimposing outline elements associated with objects identified for the reconstructed image data.

11. A vehicle driver assist module comprising:

an input module to receive image data representing an outside of a vehicle;

an output module; and

an image enhancer module coupled to the input module and output module, the image enhancer module including a processor configured to

invert the image data to form inverted image data;

run a dehazing operation on inverted image data to generate enhanced inverted image data of the outside of the vehicle, wherein the dehazing operation is based on scene radiance, medium transmission and atmospheric light of the image data;

invert the enhanced inverted image data to generate enhanced image data;

generate reconstructed image data from the enhanced image data, wherein the reconstructed image data is generated by

performing a sparse representation of the enhanced image data for denoising of the enhanced image data, and

performing a learning operation to identify and enhance objects of interest in the enhanced image data with the sparse representation; and

control the output module to output the reconstructed image data to a display unit of the vehicle.

12. The device of claim 11 , wherein the image data representing an outside of a vehicle includes video data captured by a front facing camera of the vehicle.

13. The device of claim 11 , wherein the image data representing an outside of a vehicle includes image data captured by a wearable device associated with an operator of the vehicle.

14. The device of claim 11 , wherein inverting includes pixel-wise inversion of entire frames of the image data.

15. The device of claim 11 , wherein the dehazing operation includes determining scene radiance for the inverted video data based on an adjustment parameter to the medium transmission.

16. The device of claim 11 , wherein the sparse representation of the enhanced image data utilizes existing, or infers, a combination of basic elements for frames of the image data forming a dictionary of atoms to change noise level for basic elements of the frame.

17. The device of claim 11 , wherein performing a learning operation to identify and enhance objects of interest in the enhanced image data with the sparse representation includes identification of objects in frames, comparison and adjustment of objects in frames, and selection of one or more objects to identify in frames of the image data.

18. The device of claim 11 , wherein the sparse representation and the learning operation are performed based on comparison of a daylight image associated with the image data using position of the vehicle.

19. The device of claim 11 , wherein generating reconstructed image data based on the enhanced image data includes stitching denoised image data from the sparse representation with objects identified by the learning module.

20. The device of claim 11 , wherein outputting the reconstructed image data includes superimposing outline elements associated with objects identified for the reconstructed image data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2017
From: CHAKRABORTY, PRANJAL; BISWAL, RAJESH; MUKHERJEE, DEBASHIS
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 042877/0357 →
Continuity (1)
Related Publication 20180225808A1 · Aug 9, 2018
Cited By (1)
US 12,418,719