IP Library Granted Patent US 10,410,069
Granted Patent B2
US 10,410,069 · App. 15/345,933 · Granted Sep 10, 2019

Apparatus for providing around view and vehicle

Inventor: Kihoon Han (Seoul, KR)
Assignee: LG Electronics Inc.
G06K9/00798B60K35/00B60R1/00B60R11/04G06K9/52G06T3/0062G06T3/20G06T3/40G06T7/246H04N5/23238H04N5/23293H04N5/247H04N5/265B60K2350/106B60K2350/1028B60K2350/1096B60K2350/2013B60K2350/2017B60K2350/2052B60K2350/352B60R2011/004B60R2300/102B60R2300/105B60R2300/205B60R2300/301B60R2300/302B60R2300/303B60R2300/804B60R2300/806B60R2300/8033B60Y2400/92G06K2009/4666
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,410,069
App. No.
15/345,933
Filed
Nov 8, 2016
Granted
Sep 10, 2019
Kind
B2
Art Unit
2488
USPC
348/148
Abstract

An apparatus configured to provide a view around a vehicle includes a display unit; at least one omnidirectional camera module attached to the vehicle and configured to acquire images of surroundings of the vehicle; an interface unit configured to receive steering angle information and vehicle tilt information; and a processor. The processor is configured to generate an omnidirectional image based on the images of the surroundings of the vehicle acquired by the at least one omnidirectional camera module; determine a region in the omnidirectional image that corresponds to the steering angle information or the vehicle tilt information; and control the display unit to display an image of the region in the omnidirectional image that corresponds to the steering angle information or the vehicle tilt information.

Claims (49)

1. An apparatus configured to provide a view around a vehicle, the apparatus comprising:

a display unit;

at least one omnidirectional camera module attached to the vehicle and configured to acquire images of surroundings of the vehicle;

an interface unit configured to receive steering angle information and vehicle tilt information; and

a processor configured to:

generate an omnidirectional image based on the images of the surroundings of the vehicle acquired by the at least one omnidirectional camera module;

determine a region in the omnidirectional image that corresponds to the steering angle information or the vehicle tilt information; and

control the display unit to display an image of the region in the omnidirectional image that corresponds to the steering angle information or the vehicle tilt information, wherein:

the at least one omnidirectional camera module comprises a plurality of cameras,

the processor is further configured to generate the omnidirectional image based on the images of the surroundings of the vehicle by combining a plurality of images acquired by the plurality of cameras to provide the omnidirectional image of an entire area surrounding the vehicle,

the interface unit is configured to receive turn signal information of the vehicle, and

the processor is further configured to, based on the turn signal information of the vehicle, control a size of the region in the omnidirectional image displayed on the display unit to adjust a field of view of the region.

2. The apparatus of claim 1 , wherein the at least one omnidirectional camera module is configured to acquire the images of the surroundings of the vehicle by acquiring a front view image, a rear view image, a left view image, a right view image, a bottom view image, and a top view image of the vehicle.

3. The apparatus of claim 1 , wherein the at least one omnidirectional camera module comprises:

a first omnidirectional camera module attached to a front of the vehicle and configured to acquire a first omnidirectional image of a front view of the vehicle; and

a second omnidirectional camera module attached to a rear of the vehicle and configured to acquire a second omnidirectional image of a rear view of the vehicle.

4. The apparatus of claim 1 , wherein the processor is configured to:

determine that the vehicle travels in a forward direction;

determine, from among front view images included in the omnidirectional image and based on the determination that the vehicle travels in the forward direction, a front view image of a region that corresponds to the steering angle information or the vehicle tilt information; and

control the display unit to display the front view image of the region that corresponds to the steering angle information or the vehicle tilt information while the vehicle travels in the forward direction.

5. The apparatus of claim 4 , wherein the processor is configured to, based on the steering angle information, control the display unit to display an image of a left view or an image of a right view of the vehicle travelling in the forward direction.

6. The apparatus of claim 5 , wherein the processor is configured to, based on the vehicle tilt information, control the display unit to display an image of a top view or an image of a bottom view of the vehicle travelling in the forward direction.

7. The apparatus of claim 6 , wherein the processor is configured to:

determine that the vehicle travels in a first section of a road in which a flat road portion changes to an uphill road portion or in a second section of the road in which a flat road portion changes to a downhill road portion;

determine a first point at which the flat road portion changes to the uphill road portion or a second point at which the flat road portion changes to the downhill road portion; and

based on the determination that the vehicle travels in the first section or in the second section of the road, control the display unit to display the image of the top view or the image of the bottom view at a predetermined distance ahead of the first point or the second point while the vehicle travels in the first section or in the second section.

8. The apparatus of claim 1 , wherein the processor is configured to:

determine that the vehicle travels in a reverse direction;

determine, from among rear view images included in the omnidirectional image and based on the determination that the vehicle travels in the reverse direction, a rear view image of a region that corresponds to the steering angle information or the vehicle tilt information; and

control the display unit to display the rear view image of the region that corresponds to the steering angle information or the vehicle tilt information while the vehicle travels in the reverse direction.

9. The apparatus of claim 8 , wherein the processor is configured to, based on the steering angle information, control the display unit to display an image of a left view or a right view of the vehicle travelling in the reverse direction.

10. The apparatus of claim 9 , wherein the processor is configured to, based on the vehicle tilt information, control the display unit to display an image of a top view or a bottom view of the vehicle travelling in the reverse direction.

11. The apparatus of claim 10 , wherein the processor is configured to:

determine that the vehicle travels in a first section of a road in which a flat road portion changes to an uphill road portion or in a second section of the road in which a flat road portion changes to a downhill road portion;

determine a first point at which the flat road portion changes to the uphill road portion or a second point at which the flat road portion changes to the downhill road portion; and

based on the determination that the vehicle travels in the first section or in the second section of the road, control the display unit to display the image of the top view or the image of the bottom view at a predetermined distance ahead of the first point or the second point while the vehicle travels in the first section or in the second section.

12. The apparatus of claim 1 , wherein the processor is configured to:

determine that the vehicle travels along a U-turn route;

determine, from among front view images and rear view images included in the omnidirectional image and based on the determination that the vehicle travels along the U-turn route, an image of a region that corresponds to the U-turn route; and

control the display unit to display the image of the region that corresponds to the U-turn route while the vehicle travels along the U-turn route.

13. The apparatus of claim 1 , wherein:

the interface unit is configured to receive position information of the vehicle, and

the processor is configured to, based on the position information of the vehicle, control a size of the region in the omnidirectional image displayed on the display unit to adjust a field of view of the region.

14. The apparatus of claim 13 , wherein the processor is configured to:

determine that the vehicle enters an intersection, an access road, or an exit; and

control the size of the region in the omnidirectional image displayed on the display unit to expand the field of view of the region.

15. The apparatus of claim 1 , wherein:

the interface unit is configured to receive vehicle speed information, and

the processor is configured to, based on the vehicle speed information, control a size of the region in the omnidirectional image displayed on the display unit to adjust a field of view of the region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2016
From: HAN, KIHOON
To: LG ELECTRONICS INC.
Reel/Frame 040256/0033 →
Priority Claims (1)
KR 10-2015-0156695 · Nov 9, 2015 · national
Continuity (1)
Related Publication 20170132480A1 · May 11, 2017
Cited By (1)
US 12,296,751