IP Library Granted Patent US 10,040,394
Granted Patent B2
US 10,040,394 · App. 14/742,331 · Granted Aug 7, 2018

Vehicle vision system

Inventors: Zorawar S. Bassi (Markham, CA); Ashkan Alavi-Harati (Richmond Hill, CA); Thushyanthan Jegatheswaran (Scarborough, CA); Edmund Tam (Markham, CA)
Assignee: GEO SEMICONDUCTOR INC.
B60R1/00G02B27/0101H04N5/23238H04N7/181H04N9/09B60R2300/105B60R2300/205B60R2300/304G02B2027/014G02B2027/0112G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,040,394
App. No.
14/742,331
Granted
Aug 7, 2018
Kind
B2
Abstract

Vehicle visual systems are disclosed to produce seamless and uniform surround-view images of the vehicle using a number of Ultra Wide-Angle (UWA) lens cameras and optionally HUD systems. A distributive system architecture wherein individual cameras are capable of performing various image transformations allows a flexible and resource efficient image processing scheme.

Claims (34)

1. A vehicle vision system comprising:

a plurality of Ultra Wide-Angle (UWA) lens cameras mounted on a plurality of sides of a vehicle, each camera providing a corresponding UWA feed, wherein each camera comprises a Geometry and Color Processing (GCP) unit that is configured to pre-process the corresponding UWA feed, by applying a plurality of geometry and color transformations to the corresponding UWA feed in preparation for a seamless surround-view image construction;

a central logic configured to combine the pre-processed plurality of UWA feeds provided by the corresponding plurality of cameras, and output a surround-view image of the vehicle; and

at least one display unit to display at least one of the surround-view output image, one or more of the UWA feeds, and one or more of the pre-processed UWA feeds;

wherein the GCP pre-processing of a UWA feed comprises selecting a viewing perspective in the corresponding UWA feed according to a display mode instruction, and applying a perspective distortion correction transformation to the selected viewing perspective.

2. The vehicle vision system of claim 1 , wherein one camera from the plurality of cameras is further configured to command other cameras and the central logic.

3. The vehicle vision system of claim 1 , wherein the central logic comprises a GCP unit.

4. The vehicle vision system of claim 3 , wherein the central logic is further configured to command the plurality of cameras.

5. The vehicle vision system of claim 1 , wherein the plurality of cameras, the central logic, and the at least one display comprise a communication means to communicate with one another via a communication network.

6. The vehicle vision system of claim 1 , wherein the GCP pre-processing of a UWA feed further comprises:

adjusting brightness of the perspective corrected UWA feed for seamless blending of overlapped image areas.

7. The vehicle vision system of claim 1 , wherein the display mode is selected automatically as triggered by changes in driving conditions.

8. The vehicle vision system of claim 1 , wherein the display modes is selected manually.

9. The vehicle vision system of claim 1 , wherein the display mode is a top-down view.

10. The vehicle vision system of claim 1 , wherein the display mode is a panoramic surround-view.

11. The vehicle vision system of claim 1 , wherein the display unit comprises at least one LCD panel.

12. The vehicle vision system of claim 1 , wherein the display unit comprises at least one projection unit to project images on a viewing surface.

13. The vehicle vision system of claim 1 , wherein the display unit comprises at least one augmented rear-view and side-view mirrors.

14. The vehicle vision system of claim 1 , wherein said system further comprises at least one Head-UP-Display (HUD) unit.

15. The vehicle vision system of claim 1 , wherein said system further comprises a user interactive medium.

16. A method for producing a surround-view image of a vehicle, said method comprising:

capturing a plurality of Ultra Wide-Angle (UWA) feeds by a corresponding plurality of UWA lens cameras mounted on sides of the vehicle, wherein each camera comprises a Geometry and Color Processing (GCP) unit;

pre-processing the plurality of Ultra Wide-Angle (UWA) feeds in preparation for a seamless surround-view image, comprising applying a plurality of geometry and color transformations by the plurality of the cameras' GCP unit to the corresponding UWA feed;

combining the pre-processed plurality of UWA feeds provided by the corresponding plurality of cameras, using a central logic to output the surround-view image of the vehicle; and

displaying at least one of the surround-view output image, one or more of the UWA feeds, and one or more of the pre-processed UWA feeds;

wherein the GCP pre-processing of a UWA feed comprises selecting a viewing perspective in the corresponding UWA feed according to a display mode instruction, and applying a perspective distortion correction transformation to the selected viewing perspective.

17. The method of claim 16 , wherein the plurality of cameras and the central logic communicate with one another via a communication network.

18. The method of claim 16 , wherein one camera from the plurality of cameras is configured to command other cameras and the central logic.

19. The method of claim 16 , wherein the GCP pre-processing of the UWA feeds further comprises:

adjusting brightness of the perspective corrected plurality of UWA feeds for seamless blending of overlapped image areas.

20. The method of claim 16 , wherein the display mode is selected automatically as triggered by changes in driving conditions.

21. The method of claim 16 , wherein the display modes is selected manually.

22. The method of claim 16 , wherein the display mode is a top-down surround-view.

23. The method of claim 16 , wherein the display mode is a panoramic surround-view.

Assignments (10)
RELEASE OF SECURITY INTEREST Recorded Mar 4, 2023
From: EAST WEST BANK
To: GEO SEMICONDUCTOR INC.
Reel/Frame 062955/0700 →
SECURITY INTEREST Recorded Jul 26, 2022
From: GEO SEMICONDUCTOR INC.
To: EAST WEST BANK
Reel/Frame 060925/0979 →
RELEASE OF SECURITY INTEREST Recorded Jul 23, 2022
From: CRESCENT COVE CAPITAL II, LP
To: GEO SEMICONDUCTOR, INC.
Reel/Frame 060840/0079 →
SECURITY INTEREST Recorded May 31, 2019
From: GEO SEMICONDUCTOR INC.
To: CRESCENT COVE CAPITAL II, LP
Reel/Frame 049337/0040 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: SCOTT LAKE HOLDINGS INC.
To: GEO SEMICONDUCTOR INC.
Reel/Frame 050340/0516 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: ROADMAP GEO LP III
To: GEO SEMICONDUCTOR INC.
Reel/Frame 049334/0793 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. FROM US12027189 TO PCTUS1227189 PREVIOUSLY RECORDED ON REEL 044958 FRAME 0828. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Mar 1, 2018
From: GEO SEMICONDUCTOR INC.
To: ROADMAP GEO LP III, AS ADMINISTRATIVE AGENT
Reel/Frame 045482/0808 →
SECURITY INTEREST Recorded Dec 26, 2017
From: GEO SEMICONDUCTOR INC.
To: ROADMAP GEO LP III, AS ADMINISTRATIVE AGENT
Reel/Frame 044958/0828 →
SECURITY INTEREST Recorded Dec 20, 2017
From: GEO SEMICONDUCTOR INC.
To: SCOTT LAKE HOLDINGS INC.
Reel/Frame 044957/0529 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2015
From: BASSI, ZORAWAR S.; ALAVI-HARATI, ASHKAN; JEGATHESWARAN, THUSHYANTHAN; TAM, EDMUND
To: GEO SEMICONDUCTOR INC.
Reel/Frame 035942/0854 →
Continuity (1)
Related Publication 20160368417A1 · Dec 22, 2016
Cited By (1)
US 12,711,774