IP Library › Granted Patent US 9,516,224
Granted Patent B2
US 9,516,224 · App. 13/677,128 · Granted Dec 6, 2016

Navigation device

Inventor: Wenjie Zheng (Shenzhen, CN)
Assignee: NVIDIA CORPORATION
H04N5/23238
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,516,224
App. No.
13/677,128
Granted
Dec 6, 2016
Kind
B2
Abstract

In one embodiment, a car navigation device is provided. The device comprises: at least one wide-angle camera; a video correction unit for acquiring video data from the wide-angle lens and correcting the video data; a video merging unit for acquiring corrected video data from video correction unit and merging the corrected video data; an image recognition unit for acquiring video from the video merging unit and performing image recognition to the video; and a driving assistant unit for acquiring data from the image recognition unit and assisting driving in accordance with the recognized content. The navigation device provided by various embodiments in accordance with the present invention can correct and recognize the images taken by fisheye lens in real-time so as to assist the driver for driving or drive the car automatically without a human being.

Claims (43)

1. A system comprising:

at least one wide-angle camera;

a video correction unit for acquiring video data from the at least one wide-angle camera and correcting the video data;

a video merging unit for acquiring corrected video data from the video correction unit and merging the corrected video data; and

an image recognition unit for acquiring video from the video merging unit and performing image recognition to the video to recognize a person.

2. The system of claim 1 , wherein the at least one wide-angle camera comprises:

a first fish-eye camera; and

a second fish-eye camera.

3. The system of claim 2 , wherein the first fish-eye camera and the second fish-eye camera are positioned to take a full view around a vehicle.

4. The system of claim 2 , wherein the first fish-eye camera is for taking video of at least 180 degrees.

5. The system of claim 4 , wherein the second fish-eye camera is for taking video of at least 180 degrees.

6. The system of claim 2 , wherein the video correction unit comprises:

a first video correction module for acquiring and correcting video data from the first fish-eye camera.

7. The system of claim 6 , wherein the video correction unit comprises:

a second video correction module for acquiring and correcting video data from the second fish-eye camera.

8. The system of claim 1 , wherein the image recognition unit comprises a computing ability of 100 giga floating-point operations per second (GFLOPS) and above.

9. The system of claim 1 , wherein the image recognition unit uses graphics processing units.

10. The system of claim 1 , wherein video merging unit for merging the corrected video data into a full view video around a vehicle.

11. A car navigation device comprising:

at least one wide-angle camera;

a video correction unit for acquiring video data from the at least one wide-angle camera and correcting the video data;

a video merging unit for acquiring corrected video data from the video correction unit and merging the corrected video data;

an image recognition unit for acquiring video from the video merging unit and performing image recognition to the video to recognize a barrier; and

a driving assistant unit for acquiring data from the image recognition unit and assisting driving in accordance with the recognized content.

12. The device of claim 11 , wherein the at least one wide-angle camera comprises:

a first fish-eye camera; and

a second fish-eye camera.

13. The device of claim 12 , wherein the first fish-eye camera and the second fish-eye camera are positioned to take a full view around a vehicle.

14. The device of claim 12 , wherein the first fish-eye camera is for taking video of at least 180 degrees and the second fish-eye camera is for taking video of at least 180 degrees.

15. The device of claim 14 , wherein the video correction unit comprises:

a first video correction module for acquiring and correcting video data from the first fish-eye camera; and

a second video correction module for acquiring and correcting video data from the second fish-eye camera.

16. The device of claim 11 , wherein the image recognition unit comprises a computing ability of 100 giga floating-point operations per second (GFLOPS) and above.

17. A system comprising:

at least one wide-angle camera for taking a full view around a vehicle;

a video correction unit for acquiring video data from the at least one wide-angle camera and correcting the video data;

a video merging unit for acquiring corrected video data from the video correction unit and merging the corrected video data into full view video around the vehicle; and

an image recognition unit for acquiring the full view video from the video merging unit and performing image recognition to the full view video to recognize a barrier.

18. The system of claim 17 , wherein the at least one wide-angle camera comprises:

a first fish-eye camera; and

a second fish-eye camera.

19. The system of claim 17 , wherein the first fish-eye camera is for taking video of at least 180 degrees.

20. The system of claim 17 , wherein the image recognition unit comprises a computing ability of 100 giga floating-point operations per second (GFLOPS) and above.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2012
From: ZHENG, WENJIE
To: NVIDIA CORPORATION
Reel/Frame 029299/0290 →
Priority Claims (1)
CN 2011 1 0358476 · Nov 14, 2011 · national
Continuity (1)
Related Publication 20130120524A1 · May 16, 2013