IP Library › Granted Patent US 10,200,656
Granted Patent B2
US 10,200,656 · App. 15/050,590 · Granted Feb 5, 2019

Display apparatus and vehicle including the same

Inventors: Jaeho Lee (Seoul, KR); Kihyeon Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N7/18B60R1/00B60R2300/301B60R2300/303B60R2300/607B60R2300/804B60R2300/806B60R2300/8026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,200,656
App. No.
15/050,590
Granted
Feb 5, 2019
Kind
B2
Abstract

A display apparatus with an around-view monitor function includes a camera configured to acquire an image by capturing an image of a view around a vehicle, a memory configured to store the captured image, and a processor. The processor is configured to, based on the captured image of the view around the vehicle, fix a view point for the around-view monitor function, designate a viewing area at the fixed view point for the around-view monitor function, and generate a fixed around-view monitor image representing the viewing area at the fixed view point. The display apparatus also includes a display unit configured to display the fixed around-view monitor image.

Claims (75)

1. A display apparatus having an around-view monitor function, the display apparatus comprising:

a camera configured to acquire an image by capturing an image of a view around a vehicle;

a memory configured to store the captured image;

a distance sensor configured to measure a distance to an object or a position relative to the object;

a processor configured to:

fix a view point for the around-view monitor function;

designate a viewing area at the fixed view point for the around-view monitor function; and

generate a fixed around-view monitor image representing the viewing area at the fixed view point; and

a display unit configured to display the fixed around-view monitor image,

wherein the processor further configured to;

obtain, from the camera, a first image representing a first viewing area at a first fixed view point and store the first image in the memory;

display, based on the first image, a first fixed around-view monitor image representing the first viewing area;

measure, through the distance sensor, a first position of the vehicle relative to the object;

obtain, from the camera and as the vehicle moves, a second image representing a second viewing area;

measure, through the distance sensor, a second position of the vehicle relative to the object;

detect an overlap area overlapped with the first viewing area among the second viewing area;

match the second image for the overlap area and the first image for an area that is not overlapped with the second viewing area, to generate a second fixed around-view monitor image representing the first viewing area; and

cause the display unit to display the second fixed around-view monitor image.

2. The display apparatus according to claim 1 ,

wherein the processor is further configured to:

determine the distance to the object based on the distance sensor; and

detect a moving object based on the determined distance to the object.

3. The display apparatus according to claim 2 , wherein the processor is further configured to, based on detecting the moving object, update a motion of the moving object on the fixed around-view monitor image.

4. The display apparatus according to claim 3 , wherein the processor is further configured to:

update an image of the vehicle on the second fixed around-view monitor image according to the position change from the first position to the second position of the vehicle.

5. The display apparatus according to claim 1 , wherein the processor is further configured to:

determine a likelihood of collision according to a driving direction of the vehicle and the motion of the moving object; and

include, in the fixed around view monitor image and based on the determined likelihood of collision, an additional image that includes an indication of the moving object that is likely to collide with the vehicle.

6. The display apparatus according to claim 1 , wherein the processor is further configured to:

determine that the vehicle is parking or changing lanes;

automatically fix the view point based on the determination that the vehicle is parking or changing lanes; and

generate the fixed around view monitor image based on the automatically fixed view point.

7. The display apparatus according to claim 1 , wherein the processor is further configured to maintain the view point and the viewing area while the vehicle moves.

8. The display apparatus according to claim 7 , wherein the processor is further configured to:

detect a parking space in a vicinity of the vehicle; and

fix the view point to a point located over the vehicle based on detecting the parking space.

9. The display apparatus according to claim 8 , wherein the processor is further configured to:

determine sensor information comprising at least one of steering, acceleration pedal, or gear shift change;

determine a prediction for a movement position of the vehicle according to the determined sensor information;

determine, based on the prediction for the movement position of the vehicle, whether the vehicle is expected to park within the parking space; and

include, in the fixed around-view monitor image, an additional image according to a determination that the vehicle is expected to park within the parking space.

10. The display apparatus according to claim 7 ,

wherein the processor is further configured to include, in the fixed around-view monitor image, an additional image representing the distance between the object and the vehicle.

11. The display apparatus according to claim 7 , wherein the processor is further configured to:

determine that the image of the vehicle is not within the viewing area; and

reset the view point and the viewing area based on the determination that the image of the vehicle is not within the viewing area.

12. The display apparatus according to claim 7 , wherein the processor is further configured to:

determine an image representing a door open area of the vehicle; and

include, in the image of the vehicle, the image representing the door open area of the vehicle.

13. The display apparatus according to claim 12 , wherein the processor is further configured to:

determine an image representing a relationship between the door open area of the vehicle and an object outside of the vehicle; and

include, in the image of the vehicle, the image representing the relationship between the door open area of the vehicle and the object outside of the vehicle.

14. The display apparatus according to claim 1 , wherein the processor is further configured to:

determine a driving lane of the vehicle; and

move the view point according to the determined driving lane of the vehicle.

15. The display apparatus according to claim 14 , wherein the processor is further configured to:

fix the view point to the determined driving lane of the vehicle; and

maintain the view point and the viewing area while the vehicle changes from the driving lane to another lane.

16. The display apparatus according to claim 14 , wherein the processor is further configured to:

determine a lane change of the vehicle while providing the around-view monitor image; and

fix the view point to the driving lane of the vehicle based on sensing the lane change of the vehicle.

17. The display apparatus according to claim 16 , wherein the processor is further configured to:

determine that the lane change of the vehicle has been completed; and

update the around-view monitor image based on a determination that the lane change of the vehicle has been completed.

18. The display apparatus according to claim 14 ,

wherein the processor is further configured to:

determine a distance to another vehicle that drives in a destination lane;

determine whether the distance to the other vehicle that drives in the destination lane is smaller than a threshold distance; and

determine, from the fixed around-view monitor image and based on the determination of whether the distance to the other vehicle that drives in the destination lane is smaller than the threshold distance, a recommendation of whether to change lanes into the destination lane.

19. The display apparatus according to claim 18 , wherein the processor is further configured to:

determine an image representing the recommendation of whether to change lanes into the destination lane; and

include, in the fixed around-view monitor image, the image representing the recommendation of whether to change lanes into the destination lane.

20. The display apparatus according to claim 1 , wherein the processor is configured to display the image of the vehicle such that the image of the vehicle is located off-center in the image of the viewing area.

21. The display apparatus according to claim 1 , wherein the processor is configured to change a position of the image of the vehicle in the image of the viewing area according to movement of the vehicle.

22. A vehicle comprising the display apparatus according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2016
From: LEE, JAEHO; KIM, KIHYEON
To: LG ELECTRONICS INC.
Reel/Frame 037799/0384 →
Priority Claims (1)
KR 10-2015-0117587 · Aug 20, 2015 · national
Continuity (1)
Related Publication 20170054946A1 · Feb 23, 2017