IP Library Granted Patent US 10,737,726
Granted Patent B2
US 10,737,726 · App. 16/714,508 · Granted Aug 11, 2020

Display control device, display control system, display control method, and display control program

Inventors: Hideyuki Matsumoto (Yokohama, JP); Mitsugu Oba (Yokohama, JP); Fumio Tsukamoto (Yokohama, JP); Ichiro Ishida (Yokohama, JP); Tetsu Yamada (Yokohama, JP)
Assignee: JVCKENWOOD Corporation
B62D15/0295B60R1/00B62D15/028B62D15/0275G06K9/00671G06K9/00805G06T7/20G06T11/203G08G1/168B60R2300/301B60R2300/305B60R2300/806B60R2300/8086G06K9/00798G06T2207/10016G06T2207/30256G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,737,726
App. No.
16/714,508
Granted
Aug 11, 2020
Kind
B2
Abstract

A display control device includes a video data acquisition unit that acquires video data from a camera that captures a video image in a moving direction of a vehicle, a vehicle motion detection unit that detects motion information containing a steering angle of the vehicle, an expected path line generation unit that generates a main expected path line extending along a planned moving path in accordance with the steering angle from a center part of a width of the vehicle, a superimposed video generation unit that generates superimposed data, the superimposed data being video data where the main expected path line is superimposed on the video data, and a display control unit that transmits the superimposed data to a display unit so as to display a video related to the superimposed data on the display unit.

Claims (41)

1. A display control device comprising:

a video data acquisition unit configured to acquire video data from a camera that captures a video image in a moving direction of a vehicle;

a vehicle motion detection unit configured to detect motion information containing a steering angle of the vehicle;

an expected path line generation unit configured to generate a first expected path line extending along a planned moving path in accordance with the steering angle from a center part along a width of the vehicle and a third expected path line including a pair of lines extending along a planned moving path of the vehicle from both ends of the vehicle in the width direction;

a parking line recognition unit configured to recognize a parking line from the video data;

a detection unit configured to detect a nearby object around the vehicle;

a determination unit configured to determine to superimpose the first expected path line on the video data when a distance between the nearby object detected by the detection unit and the parking line is larger than a predetermined value, and the parking line and the third expected path line are to be displayed in close proximity to each other;

a superimposed video generation unit configured to generate superimposed data, the superimposed data being video data where the first expected path line or the third expected path line is superimposed on the video data in accordance with a determination by the determination unit; and

a display control unit configured to transmit the superimposed data to a display unit so as to display a video related to the superimposed data on the display unit.

2. The display control device according to claim 1 , wherein the first expected path line generated by the expected path line generation unit is displayed on the display unit as a straight line extending from the center part along the width of the vehicle.

3. The display control device according to claim 2 , wherein the expected path line generation unit further generates a pair of second expected path lines extending along a planned moving path of the vehicle from both ends of the vehicle in the width direction and having higher transparency than that of the first expected path line on the video data.

4. The display control device according to claim 3 , wherein the second expected path line generated by the expected path line generation unit is displayed as a straight line extending in a straight moving direction of the vehicle from both ends of the vehicle in the width direction.

5. The display control device according to claim 1 , wherein the determination unit determines to superimpose the first expected path line on the video data when the parking line and the third expected path line are to be displayed in close proximity to each other.

6. The display control device according to claim 5 , wherein, when the determination unit determines to superimpose the first expected path line on the video data, the superimposed video generation unit generates superimposed data, the superimposed data being video data where a second expected path line having higher transparency than that of the first expected path line is additionally superimposed.

7. The display control device according to claim 6 , wherein the second expected path line includes a pair of lines extending in a straight moving direction of the vehicle.

8. The display control device according to claim 1 , wherein the determination unit determines that the parking line and the third expected path line are to be displayed in close proximity to each other when the steering angle of the vehicle is smaller than a predetermined angle.

9. The display control device according to claim 1 , further comprising:

a parking line recognition unit configured to recognize a parking line from the video data,

wherein the determination unit determines that the parking line and the third expected path line are to be displayed in close proximity to each other when a distance between the third expected path line and the parking line is within a predetermined range.

10. The display control device according to claim 1 , wherein the expected path line generation unit further generates a vehicle width guide line, the line being a line extending along the width of the vehicle and coinciding with the width of the vehicle in the moving direction.

11. A display control system comprising:

the display control device according to claim 1 ; and

at least one of a camera configured to capture the video data and a display unit configured to display the video data.

12. A display control method comprising:

acquiring video data from a camera that captures a video image in a moving direction of a vehicle;

detecting motion information containing a steering angle of the vehicle;

generating a first expected path line extending along a planned moving path in accordance with the steering angle from a center part along a width of the vehicle and a third expected path line including a pair of lines extending along a planned moving path of the vehicle from both ends of the vehicle in the width direction;

recognizing a parking line from the video data;

detecting a nearby object around the vehicle;

determining to superimpose the first expected path line on the video data when a distance between the nearby object detected by the detection unit and the parking line is larger than a predetermined value, and the parking line and the third expected path line are to be displayed in close proximity to each other;

generating superimposed data, the superimposed data being video data where the first expected path line or the third expected path line is superimposed on the video data in accordance with a determination; and

transmitting the superimposed data to a display unit so as to display a video related to the superimposed data on the display unit.

13. A computer readable non-transitory storage medium storing a display control program causing a computer to execute:

acquiring video data from a camera that captures a video image in a moving direction of a vehicle;

detecting motion information containing a steering angle of the vehicle;

generating a first expected path line extending along a planned moving path in accordance with the steering angle from a center part along a width of the vehicle and a third expected path line including a pair of lines extending along a planned moving path of the vehicle from both ends of the vehicle in the width direction;

recognizing a parking line from the video data;

detecting a nearby object around the vehicle;

determining to superimpose the first expected path line on the video data when a distance between the nearby object detected by the detection unit and the parking line is larger than a predetermined value, and the parking line and the third expected path line are to be displayed in close proximity to each other;

generating superimposed data, the superimposed data being video data where the first expected path line or the third expected path line is superimposed on the video data in accordance with a determination; and

transmitting the superimposed data to a display unit so as to display a video related to the superimposed data on the display unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2019
From: MATSUMOTO, HIDEYUKI; OBA, MITSUGU; TSUKAMOTO, FUMIO; ISHIDA, ICHIRO; YAMADA, TETSU
To: JVCKENWOOD CORPORATION
Reel/Frame 051282/0510 →
Priority Claims (2)
JP 2017-118401 · Jun 16, 2017 · national
JP 2017-118402 · Jun 16, 2017 · national
Continuity (2)
Continuation PCTJP2018000367 · Jan 10, 2018
Related Publication 20200118310A1 · Apr 16, 2020