IP Library Granted Patent US 9,508,189
Granted Patent B2
US 9,508,189 · App. 14/361,546 · Granted Nov 29, 2016

Method and apparatus for creating 3D image of vehicle surroundings

Inventors: Young-In Han (Yongin-si, KR); Sung-Je Cheon (Yongin-si, KR); Jong-Woon Park (Seoul, KR); Won-In Baek (Seongnam-si, KR)
Assignee: KSS-IMAGENEXT CO., LTD.
G06T15/205B60R1/00G06K9/00805G06T3/0031G06T3/4038H04N13/0007H04N13/0282B60R2300/602B60R2300/605B60R2300/607G06T2215/16G08G1/16H04N7/181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,508,189
App. No.
14/361,546
Granted
Nov 29, 2016
Kind
B2
Abstract

The present invention relates to a method and apparatus for creating a 3D image of vehicle surroundings. The method according to the present invention includes the steps of: mapping images captured by a plurality of cameras installed in a vehicle to a virtual plane defined by a 3-dimensional space model having a container shape with a flat bottom surface and a top surface which has an increasing radius; and creating a view image having a viewpoint of a virtual camera by using the image mapped to the virtual plane. According to the present invention, it is advantageous that an image of vehicle surroundings including surrounding obstacles can be expressed naturally and three-dimensionally. It is also advantageous that an optimal image of vehicle surroundings can be provided by changing the virtual viewpoint according to a traveling state of the vehicle. There is also the advantage that a user can conveniently adjust the viewpoint of the virtual camera.

Claims (18)

1. A method for creating a 3D image of vehicle surroundings, the method comprising:

mapping images captured by a plurality of cameras installed in a vehicle to a virtual plane defined by a 3D space model of a vessel shape which has a flat bottom surface and a radius increasing toward a top; and

creating a view image of a viewpoint of a virtual camera by using the images mapped to the virtual plane,

wherein a size of the bottom surface of the 3D space model is in inverse proportion to a driving speed of the vehicle.

2. The method of claim 1 , wherein the viewpoint of the virtual camera is determined according to at least one of a driving condition of the vehicle and a user selection.

3. The method of claim 1 , wherein the view image is created with reference to a lookup table in which a corresponding relationship between the image mapped to the virtual plane and the view image of the viewpoint of the virtual camera is pre-defined.

4. The method of claim 1 , wherein a center of an area where the images captured by the plurality of cameras to create the view image overlap with one another is changed according to a tilt angle of the virtual camera.

5. The method of claim 1 , wherein the plurality of cameras comprise a front camera, a right camera, a rear camera, and a left camera installed on a front, a right, a rear, and a left of the vehicle, respectively, and

wherein a center of an overlapping area where the images captured by the plurality of cameras to create the view image overlap with one another is changed to further comprise an image captured by the virtual camera according to how far the virtual camera is distanced from a center of the vehicle to the left or right.

6. The method of claim 2 , wherein the viewpoint of the virtual camera interworks with a steering angle direction or a gear location of the vehicle.

7. The method of claim 2 , further comprising:

displaying a user interface (UI) for receiving a user selection regarding the viewpoint of the virtual camera; and

displaying a change in the viewpoint of the virtual camera according to a user selection input through the UI.

8. The method of claim 2 , further comprising adding information on buildings and roads around a driving location of the vehicle to the view image according to the viewpoint of the virtual camera.

9. A system for displaying an image of vehicle surroundings, the system comprising a surrounding image creating apparatus configured to receive images captured by a plurality of cameras installed in a vehicle, map the images to a virtual plane defined by a 3D space model of a vessel shape which has a flat bottom surface and a radius increasing toward a top, and create a view image viewed from a viewpoint of a virtual camera by using the images mapped to the virtual plane,

wherein a size of the bottom surface of the 3D space model is in inverse proportion to a driving speed of the vehicle.

10. The system of claim 9 , wherein the surrounding image creating apparatus adds information on buildings and roads around a driving location of the vehicle to the view image according to the viewpoint of the virtual camera.

11. The system of claim 9 , wherein the plurality of cameras transmit the captured images to the surrounding image creating apparatus via short-range wireless communication.

Assignments (3)
CHANGE OF NAME Recorded Mar 26, 2021
From: KSS-IMAGENEXT CO., LTD.
To: BEYOND I CO., LTD.
Reel/Frame 055744/0964 →
CHANGE OF NAME Recorded Jun 7, 2016
From: IMAGENEXT CO., LTD.
To: KSS-IMAGENEXT CO., LTD.
Reel/Frame 038903/0360 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2014
From: HAN, YOUNG-IN; CHEON, SUNG-JE; PARK, JONG-WOON; BAEK, WON-IN
To: IMAGENEXT CO., LTD.
Reel/Frame 032989/0158 →
Priority Claims (1)
KR 10-2011-0127209 · Nov 30, 2011 · national
Continuity (1)
Related Publication 20140347450A1 · Nov 27, 2014