IP Library › Granted Patent US 10,703,271
Granted Patent B2
US 10,703,271 · App. 16/034,389 · Granted Jul 7, 2020

Vehicle display device, vehicle display method, and recording medium for displaying images

Inventor: Katsuyuki Nagai (Yokohama, JP)
Assignee: JVC KENWOOD CORPORATION
B60R1/00B60R21/00G01B17/06G01S7/4808G01S7/539G01S15/10G01S15/86G01S15/87G01S15/931G01S17/42G01S17/86G01S17/87G01S17/931G06K9/00798H04N5/23238H04N5/247H04N5/2628H04N7/18H04N7/181B60R2300/20B60R2300/30B60R2300/303B60R2300/307B60R2300/605B60R2300/607G01B11/026G01B11/24G01B17/00G01S17/36H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,703,271
App. No.
16/034,389
Granted
Jul 7, 2020
Kind
B2
Abstract

An image acquisition unit acquires an image around a vehicle. A generator generates a bird's-eye image based on the acquired image. A road surface information acquisition unit acquires information on a road surface around the vehicle. A road surface determination unit determines whether a road surface that requires attention is found by referring to the acquired information on the road surface. When it is determined that a road surface that requires attention is found, an image processor superimposes an image showing the road surface that requires attention on the bird's-eye image.

Claims (38)

1. A vehicle display device comprising:

an image acquisition unit that acquires an image around a vehicle;

a generator that subjects the image acquired by the image acquisition unit to viewpoint transform to generate a bird's-eye image as viewed from above the vehicle;

a road surface information acquisition unit that acquires information on a road surface shape or a road surface condition around the vehicle;

a road surface determination unit that determines whether a road surface shape or a road surface condition that requires attention is found by referring to the information on the road surface shape or the road surface condition acquired by the road surface information acquisition unit;

an image processor that, when the road surface determination unit determines that a road surface shape or a road surface condition that requires attention is found, superimposes an image showing the road surface shape or the road surface condition that requires attention on the bird's-eye image; and

a display controller that causes a display unit to display the bird's-eye image on which the image is superimposed by the image processor, wherein

the road surface determination unit determines whether a road surface shape that requires attention is found by determining whether a road surface shape having a step height that makes it difficult for the vehicle to travel and descending in a direction away from the vehicle is found.

2. A vehicle display device comprising:

an image acquisition unit that acquires an image around a vehicle;

a generator that subjects the image acquired by the image acquisition unit to viewpoint transform to generate a bird's-eye image as viewed from above the vehicle;

a road surface information acquisition unit that acquires information on a road surface shape or a road surface condition around the vehicle;

a road surface determination unit that determines whether a road surface shape or a road surface condition that requires attention is found by referring to the information on the road surface shape or the road surface condition acquired by the road surface information acquisition unit;

an image processor that, when the road surface determination unit determines that a road surface shape or a road surface condition that requires attention is found, superimposes an image showing the road surface shape or the road surface condition that requires attention on the bird's-eye image; and

a display controller that causes a display unit to display the bird's-eye image on which the image is superimposed by the image processor;

a stop determination unit that determines that the vehicle is at a stop when the vehicle comes to a stop or when the speed of the vehicle drops below a predetermined speed; and

a relative position determination unit that determines, when the road surface determination unit determines that a road surface condition that requires attention is found, determines whether the road surface condition that requires attention is positioned near a door of the vehicle by referring to relative positions of the road surface condition that requires attention and the door of the vehicle, wherein

the generator adds a driver's vehicle icon indicating a position of the vehicle to the bird's-eye image, and

the image processor superimposes an image showing a road surface condition that requires attention on a position of the door of the vehicle in the driver's vehicle icon in the bird's-eye image when the stop determination unit determines that the vehicle is at a stop, when the road surface determination unit determines that a road surface condition that requires attention is found, and when the relative position determination unit determines that the road surface condition that requires attention is positioned near the door of the vehicle.

3. A vehicle display device comprising:

an image acquisition unit that acquires an image around a vehicle;

a generator that subjects the image acquired by the image acquisition unit to viewpoint transform to generate a bird's-eye image as viewed from above the vehicle;

a road surface information acquisition unit that acquires information on a road surface shape or a road surface condition around the vehicle;

a road surface determination unit that determines whether a road surface shape or a road surface condition that requires attention is found by referring to the information on the road surface shape or the road surface condition acquired by the road surface information acquisition unit;

an image processor that, when the road surface determination unit determines that a road surface shape or a road surface condition that requires attention is found, superimposes an image showing the road surface shape or the road surface condition that requires attention on the bird's-eye image;

a display controller that causes a display unit to display the bird's-eye image on which the image is superimposed by the image processor; and

a seating information acquisition unit that acquires seated/non-seated information on a plurality of seats in the vehicle, wherein

the road surface determination unit determines whether a road surface shape that requires attention is found by determining whether a road surface shape that requires attention is found at a position of a door of the vehicle associated with the seat that is acquired by the seating information acquisition unit as being occupied.

4. The vehicle display device according to claim 3 , wherein

the road surface determination unit determines whether a road surface shape that requires attention is found by determining whether a road surface shape having a step height that makes it difficult to open a door of the vehicle associated with the seat that is acquired by the seating information acquisition unit as being occupied is found.

5. The vehicle display device according to claim 3 , further comprising:

a stop determination unit that determines that the vehicle is at a stop when the vehicle comes to a stop or when the speed of the vehicle drops below a predetermined speed, wherein

the image processor superimposes an image showing a road surface condition that requires attention on the bird's eye image at a position of the door of the vehicle associated with the seat that is occupied, when the stop determination unit determines that the vehicle is at a stop and when the road surface determination unit determines that a road surface condition that requires attention is found.

6. The vehicle display device according to claim 5 , wherein the road surface information acquisition unit acquires a condition of ultrasonic reflection on a road surface to identify the road surface condition, and

the road surface determination unit determines whether the road surface is wet by referring to the condition of ultrasonic reflection on the road surface acquired by the road surface information acquisition unit.

7. The vehicle display device according to claim 5 , wherein

the road surface information acquisition unit acquires shade change in the bird's-eye image to identify the road surface condition, and

the road surface determination unit determines whether the road surface is wet by referring to the shade change acquired by the road surface information acquisition unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2018
From: NAGAI, KATSUYUKI
To: JVC KENWOOD CORPORATION
Reel/Frame 046355/0640 →
Priority Claims (2)
JP 2016-094626 · May 10, 2016 · national
JP 2016-127890 · Jun 28, 2016 · national
Continuity (2)
Continuation PCTJP2017001313 · Jan 17, 2017
Related Publication 20180319337A1 · Nov 8, 2018