IP Library Granted Patent US 9,952,051
Granted Patent B2
US 9,952,051 · App. 15/097,375 · Granted Apr 24, 2018

Advanced driver assistance apparatus, display apparatus for vehicle and vehicle

Inventors: Jeongsu Kim (Seoul, KR); Sanghyuk Lee (Seoul, KR)
Assignee: LG Electronics Inc.
G01C21/26B60R1/00B60T7/12G01C21/3602G01S19/13G01S19/39G01S19/48G06K9/00791G06K9/00798G08G1/056B60R2300/802
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,952,051
App. No.
15/097,375
Granted
Apr 24, 2018
Kind
B2
Abstract

A driver assistance apparatus includes an interface configured to receive first navigation information generated based on GPS information of the vehicle, a camera configured to acquire an image of a view ahead of the vehicle, and a processor. The processor is configured to detect an object in the acquired image of the view ahead of the vehicle, determine, based on the detected object, a driving situation of the vehicle, and determine whether the driving situation of the vehicle is consistent with the first navigation information. Based on a determination that the driving situation of the vehicle is not consistent with the first navigation information, the process generates, based on the driving situation of the vehicle, second navigation information of the vehicle, and provides the second navigation information to an output unit.

Claims (78)

1. A driver assistance apparatus, comprising:

an interface configured to receive first navigation information generated based on GPS information of the vehicle;

a camera configured to acquire an image of a view ahead of the vehicle; and

at least one processor configured to:

detect an object in the acquired image of the view ahead of the vehicle;

determine, based on the object detected in the acquired image, a driving situation of the vehicle;

determine whether the driving situation of the vehicle is consistent with the first navigation information that was generated based on the GPS information; and

based on a determination that the driving situation of the vehicle is not consistent with the first navigation information:

generate, based on the driving situation of the vehicle, second navigation information of the vehicle, and provide the second navigation information to an output unit,

wherein the at least one processor is configured to determine that the driving situation of the vehicle is not consistent with the first navigation information by:

determining, based on the object detected in the acquired image, that the driving situation of the vehicle corresponds to the vehicle travelling on a road with a second elevation that is different from a first elevation of a road indicated by the first navigation information.

2. The driver assistance apparatus of claim 1 , wherein the at least one processor is configured to determine the driving situation of the vehicle by:

determining, based on the object detected in the image of the view ahead of the vehicle, information regarding at least one of a traffic signal, a surface of the road on which the vehicle is travelling, a structure located around the road, or a moving object; and

determining the driving situation of the vehicle based on the determined information regarding at least one of the traffic signal, the surface of the road on which the vehicle is travelling, the structure located around the road, or the moving object.

3. The driver assistance apparatus of claim 1 , wherein the at least one processor is configured to determine that the driving situation of the vehicle is not consistent with the first navigation information by:

determining that the first navigation information indicates that the vehicle is travelling on a first type of road;

determining, based on the object detected in the acquired image, that the driving situation of the vehicle corresponds to the vehicle travelling on a second type of road; and

determining that the second type of road is not consistent with the first type of road.

4. The driver assistance apparatus of claim 3 , wherein determining that the driving situation of the vehicle corresponds to the vehicle travelling on the second type of road comprises:

detecting, in the acquired image, at least one of a traffic light, a pedestrian, a two-wheeled vehicle, a crosswalk, a curb, a road sign, a road surface, or a speed limit sign.

5. The driver assistance apparatus of claim 3 , wherein determining that the driving situation of the vehicle corresponds to the vehicle travelling on the second type of road comprises:

detecting that the vehicle is travelling on an on-ramp entering a highway; and

determining, based on detecting that the vehicle is travelling on the on-ramp entering the highway, that the driving situation of the vehicle corresponds to the vehicle travelling on a highway.

6. The driver assistance apparatus of claim 3 , wherein determining, based on the object detected in the acquired image, that the driving situation of the vehicle corresponds to the vehicle travelling on the second type of road comprises:

detecting that the vehicle is travelling on an off-ramp exiting a highway; and

determining, based on detecting that the vehicle is travelling on the off-ramp exiting the highway, that the driving situation of the vehicle corresponds to the vehicle travelling on a local road.

7. The driver assistance apparatus of claim 1 , wherein the at least one processor is configured to determine that the driving situation of the vehicle corresponds to the vehicle travelling on the road with the second elevation by:

detecting, in the acquired image, at least one of a traffic light, a pedestrian, a two-wheeled vehicle, a crosswalk, a curb, a pillar, a shadow, a road sign, or a road surface.

8. The driver assistance apparatus of claim 7 , wherein determining that the driving situation of the vehicle corresponds to the vehicle travelling on a road with a second elevation that is different from a first elevation of a road indicated by the first navigation information comprises:

detecting, based on the object detected in the acquired image, that the vehicle is travelling on an inclined road; and

determining, based on the detection that the vehicle is travelling on an inclined road, that the driving situation of the vehicle corresponds to the vehicle travelling on the road with the second elevation that is different from the first elevation of the road indicated by the first navigation information.

9. The driver assistance apparatus of claim 1 , wherein the at least one processor is configured to determine that the driving situation of the vehicle is not consistent with the first navigation information by:

determining, based on the first navigation information, that the vehicle is travelling on one of an outdoor road or a tunnel; and

determining, based on the object detected in the acquired image, that the driving situation of the vehicle corresponds to the vehicle travelling on the other of the outdoor road or the tunnel.

10. The driver assistance apparatus of claim 9 , wherein determining that the driving situation of the vehicle corresponds to the vehicle travelling on the other of the outdoor road or the tunnel comprises:

detecting, in the acquired image, at least one of a traffic light, a pedestrian, a two-wheeled vehicle, a crosswalk, a curb, lighting provided to the underground roadway, a traffic sign indicating entry into the underground roadway, an overhead clearance sign, a structure constituting the underground roadway, a road sign, or a road surface.

11. The driver assistance apparatus of claim 9 , wherein determining that the driving situation of the vehicle corresponds to the vehicle travelling on the other of the outdoor road or the tunnel comprises:

determining that the first information has not been received; and

based on the determination that first information has not been received, determining that the driving situation of the vehicle corresponds to the vehicle travelling in the tunnel.

12. The driver assistance apparatus of claim 1 , wherein the at least one processor is configured to determine that the driving situation of the vehicle is not consistent with the first navigation information by:

determining a direction of travel of the vehicle;

determining, based on the object detected in the acquired image, that the vehicle is travelling on a one-way road; and

determining, based on the direction of travel of the vehicle and the determination that the vehicle is travelling on the one-way road, that the driving situation of the vehicle corresponds to a wrong-way driving situation.

13. The driver assistance apparatus of claim 12 , wherein determining that the vehicle is travelling on a one-way road comprises detecting, in the acquired image, at least one of a traffic light, a traffic sign, a road surface, or a neighboring parked vehicle.

14. The driver assistance apparatus of claim 12 , wherein the at least one processor is further configured to, based on the determination that the driving situation of the vehicle corresponds to a wrong-way driving situation, provide a signal to perform an alarm output or a braking operation of the vehicle.

15. The driver assistance apparatus of claim 1 , wherein the at least one processor is configured to provide the second navigation information to an output unit by:

determining that the first information has not been received; and

providing, to the output unit and based on the determination that the first information has not been received, the second information.

16. The driver assistance apparatus of claim 15 , wherein the at least one processor is configured to generate second navigation information of the vehicle by:

determining that the vehicle is traveling indoors;

detecting, based on the determination that the vehicle is traveling indoors, a direction sign in the acquired image; and

generating the second navigation information based on the direction sign detected in the acquired image.

17. The driver assistance apparatus of claim 15 , wherein the at least one processor is configured to generate second navigation information of the vehicle by:

detecting that the vehicle has traveled from an indoor space to an outdoor space;

detecting, in the acquired image, at least one of a road sign, a building, or a direction sign; and

generating the second navigation information based on the detected at least one of the road sign, the building, or the direction sign.

18. A display apparatus for a vehicle, comprising:

a display;

a position information module configured to provide GPS information of the vehicle;

an interface configured to receive second navigation information indicating a position of the vehicle, the second navigation information being generated based on a driving situation of the vehicle determined from an image acquired of a view ahead of the vehicle; and

at least one processor configured to:

determine whether the second navigation information has been received;

based on a determination that the second navigation information has been received, include the second navigation information in a map and provide a navigation function with the map including the second navigation information; and

based on a determination that the second navigation information has not been received, generate first navigation information of the vehicle based on the GPS information received through the position information module, include the first navigation information in the map, and provide the navigation function with the map including the first navigation information,

wherein the at least one processor is further configured to:

determine whether the first navigation information or the second navigation information is included in the map;

based on a determination that the first navigation information is included in the map, display a first image corresponding to the first navigation information in a region of the display; and

based on a determination that the first navigation information is included in the map, display a second image corresponding to the second navigation information in the region of the display.

19. The display apparatus for a vehicle of claim 18 , wherein the at least one processor is configured to:

determine that information applied to the map is changed from the first navigation information to the second navigation information; and

based on the determination that the information applied to the map is changed from the first navigation information to the second navigation information, change a display of the first image to a display of the second image.

20. The display apparatus for a vehicle of claim 19 , wherein the at least one processor is configured to change a display of the first image to a display of the second image by:

displaying the first image to gradually become faint and displaying the second image to gradually become distinct over time.

21. The display apparatus for a vehicle of claim 18 , further comprising a display, wherein the at least one processor is configured to include the second navigation information in the map by:

determining a location on the map based on the position of the vehicle indicated by the second navigation information; and

displaying, on the display, the map including the position of the vehicle indicated by the second navigation information.

22. The display apparatus for a vehicle of claim 21 , wherein the at least one processor is further configured to display, on the display, a route generated based on the position of the vehicle indicated by the second navigation information.

23. The display apparatus for a vehicle of claim 22 , wherein the at least one processor is further configured to determine that the position of the vehicle indicated by the second navigation information is an indoor position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2018
From: KIM, JEONGSU; LEE, SANGHYUK
To: LG ELECTRONICS INC.
Reel/Frame 045254/0365 →
Priority Claims (1)
KR 10-2015-0093398 · Jun 30, 2015 · national
Continuity (1)
Related Publication 20170003134A1 · Jan 5, 2017