IP Library Granted Patent US 10,137,836
Granted Patent B2
US 10,137,836 · App. 15/489,069 · Granted Nov 27, 2018

Vehicle vision system

Inventors: Zorawar S. Bassi (Markham, CA); Ashkan Alavi-Harati (Richmond Hill, CA); Thushyanthan Jegatheswaran (Scarborough, CA); Edmund Tam (Markham, CA)
Assignee: GEO SEMICONDUCTOR INC.
B60R1/00G02B27/0101H04N5/23238H04N5/247H04N5/3572H04N7/181B60K2350/106B60K2350/1072B60K2350/1084B60K2350/1088B60K2350/2013B60K2350/2017B60K2350/2052B60K2350/2065B60K2350/2095B60K2350/921B60R2300/102B60R2300/105B60R2300/205B60R2300/30B60R2300/304B60R2300/607B60R2300/802B60R2300/806B60R2300/8046B60R2300/8066G02B2027/014G02B2027/0112G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,137,836
App. No.
15/489,069
Granted
Nov 27, 2018
Kind
B2
Abstract

Vehicle visual systems are disclosed to produce seamless and uniform surround-view images of the vehicle using a number of Ultra Wide-Angle (UWA) lens cameras and optionally HUD systems. A distributive system architecture wherein individual cameras are capable of performing various image transformations allows a flexible and resource efficient image processing scheme.

Claims (46)

1. A vehicle vision system comprising:

a plurality of Ultra Wide-Angle (UWA) lens cameras mounted on a plurality of sides of a vehicle, each camera providing a corresponding UWA feed;

at least one Head-UP-Display (HUD) comprising a Geometry and Color (GCP) processing unit, wherein the at least one HUD is configured to:

receive at least one UWA feed; and

pre-process the at least one UWA feed, by applying a plurality of geometry and color transformations to the corresponding UWA feed, in preparation for a seamless surround-view image construction;

and a central logic configured to combine the pre-processed UWA feeds provided by the corresponding at least one HUD and output a surround-view image of the vehicle;

wherein at least one of the surround-view output image, one or more of the UWA feeds, and one or more of the transformed UWA feeds are projected on a virtual surface in front of windshield of the vehicle by the at least one HUD.

2. The vehicle vision system of claim 1 , wherein one HUD is further configured to command other HUDs, the plurality of cameras and the central logic.

3. The vehicle vision system of claim 1 , wherein the central logic comprises a GCP unit.

4. The vehicle vision system of claim 3 , wherein the central logic is further configured to command the plurality of cameras and the plurality of HUDs.

5. The vehicle vision system of claim 1 , wherein each of the plurality of cameras comprises a GCP unit.

6. The vehicle vision system of claim 5 , wherein one camera from the plurality of cameras is further configured to command other cameras, the plurality of HUDs and the central logic.

7. The vehicle vision system of claim 1 , wherein the plurality of cameras, the at least one HUD, and the central logic comprise a communication means to communicate with one another via a communication network.

8. The vehicle vision system of claim 1 , wherein the GCP pre-processing of the UWA feeds comprises one or more of:

selecting a viewing perspective in the corresponding UWA feed according to a viewing display mode instruction;

applying a first transformation to the selected viewing perspective to correct for perspective distortion of the UWA feed;

applying a second transformation to the perspective corrected UWA feed to correct for windshield distortion and projection geometric distortions; and

adjusting brightness of the geometric UWA feeds for seamless blending of overlapped image areas.

9. The vehicle vision system of claim 8 , wherein the display mode is selected automatically as triggered by changes in driving conditions.

10. The vehicle vision system of claim 8 , wherein the display modes is selected manually.

11. The vehicle vision system of claim 8 , wherein the display mode is a top-down view.

12. The vehicle vision system of claim 8 , wherein the display mode is a panoramic surround-view.

13. The vehicle vision system of claim 1 , wherein the virtual images corresponding to different projection units are displayed at different depths relative to windshield.

14. The vehicle vision system of claim 1 , wherein the vehicle is mirror-less.

15. The vehicle vision system of claim 1 , wherein augmented reality is enabled on the virtual display.

16. A method for displaying a surround-view image of a vehicle, said method comprising:

receiving a plurality of Ultra Wide-Angle (UWA) feeds, captured by a corresponding plurality of UWA lens cameras mounted on a plurality of sides of the vehicle, by at least one Head-UP-Display (HUD) comprising a Geometry and Color Processing (GCP) unit;

pre-processing the plurality of received Ultra Wide-Angle (UWA) feeds, by applying a plurality of geometry and color transformations to the corresponding UWA feed, in preparation for a seamless surround-view image construction by the at least one HUD;

combining the pre-processed UWA feeds, provided by the corresponding at least one HUD, using a central logic to output the surround-view image of the vehicle; and

projecting at least one of the surround-view output image, one or more of the UWA feeds, and one or more of the pre-processed UWA feeds on a virtual surface in front of windshield of the vehicle through the at least one Head-UP-Display (HUD).

17. The method of claim 16 , wherein the plurality of cameras, the at least one HUD, and the central logic comprise a communication means to communicate with one another via a communication network.

18. The method of claim 16 , wherein the at least one HUD is configured to command other HUDs, the plurality of cameras and the central logic.

19. The method of claim 16 , wherein the central logic comprises a GCP unit.

20. The method of claim 19 , wherein the central logic is further configured to command the plurality of cameras and the at least one HUD.

21. The method of claim 16 , wherein each camera of the plurality of cameras comprises a GCP unit.

22. The method system of claim 21 , wherein one camera from the plurality of cameras is further configured to command other cameras, the at least one HUD and the central logic.

23. The method of claim 16 , wherein one camera from the plurality of cameras is configured to command other cameras and the central logic.

24. The method of claim 16 , wherein the pre-processing of the UWA feeds is achieved by one or more of:

selecting a viewing perspective in the correspond UWA feed according to a display mode instruction;

applying a first transformation to the selected viewing perspective to correct for perspective distortion of the UWA feed;

applying a second transformation to the perspective corrected UWA feed to correct for windshield distortion and projection geometric distortions; and

adjusting brightness of the perspective corrected plurality of UWA feeds for seamless blending of overlapped image areas.

25. The method of claim 24 , wherein the display mode is selected automatically as triggered by changes in driving conditions.

26. The method of claim 24 , wherein the display modes is selected manually.

27. The method of claim 24 , wherein the display mode is a top-down surround-view.

28. The method of claim 24 , wherein the display mode is a panoramic surround-view.

Assignments (10)
RELEASE OF SECURITY INTEREST Recorded Mar 4, 2023
From: EAST WEST BANK
To: GEO SEMICONDUCTOR INC.
Reel/Frame 062955/0700 →
SECURITY INTEREST Recorded Jul 26, 2022
From: GEO SEMICONDUCTOR INC.
To: EAST WEST BANK
Reel/Frame 060925/0979 →
RELEASE OF SECURITY INTEREST Recorded Jul 23, 2022
From: CRESCENT COVE CAPITAL II, LP
To: GEO SEMICONDUCTOR, INC.
Reel/Frame 060840/0079 →
SECURITY INTEREST Recorded May 31, 2019
From: GEO SEMICONDUCTOR INC.
To: CRESCENT COVE CAPITAL II, LP
Reel/Frame 049337/0040 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: SCOTT LAKE HOLDINGS INC.
To: GEO SEMICONDUCTOR INC.
Reel/Frame 050340/0516 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: ROADMAP GEO LP III
To: GEO SEMICONDUCTOR INC.
Reel/Frame 049334/0793 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. FROM US12027189 TO PCTUS1227189 PREVIOUSLY RECORDED ON REEL 044958 FRAME 0828. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Mar 1, 2018
From: GEO SEMICONDUCTOR INC.
To: ROADMAP GEO LP III, AS ADMINISTRATIVE AGENT
Reel/Frame 045482/0808 →
SECURITY INTEREST Recorded Dec 26, 2017
From: GEO SEMICONDUCTOR INC.
To: ROADMAP GEO LP III, AS ADMINISTRATIVE AGENT
Reel/Frame 044958/0828 →
SECURITY INTEREST Recorded Dec 20, 2017
From: GEO SEMICONDUCTOR INC.
To: SCOTT LAKE HOLDINGS INC.
Reel/Frame 044957/0529 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2017
From: BASSI, ZORAWAR S.; ALAVI-HARATI, ASHKAN; JEGATHESWARAN, THUSHYANTHAN; TAM, EDMUND
To: GEO SEMICONDUCTOR INC.
Reel/Frame 042269/0434 →
Continuity (2)
Division 14742331 · Jun 17, 2015
Related Publication 20170232896A1 · Aug 17, 2017