IP Library Granted Patent US 10,699,486
Granted Patent B2
US 10,699,486 · App. 16/016,695 · Granted Jun 30, 2020

Display system, information presentation system, control method of display system, storage medium, and mobile body

Inventors: Akira Tanaka (Osaka, JP); Tadashi Shibata (Osaka, JP); Nobuyuki Nakano (Osaka, JP); Masanaga Tsuji (Osaka, JP); Shohei Hayashi (Kyoto, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06T19/006G06K9/00362G06K9/00671G06K9/00798G06K9/00805G06K9/00818G09G3/02G09G2354/00G09G2380/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,699,486
App. No.
16/016,695
Granted
Jun 30, 2020
Kind
B2
Abstract

A display system includes a projector that projects a virtual image onto a target space to allow a target person to visibly recognize the virtual image and a controller that controls display of the virtual image. When the projector projects a virtual image corresponding to a caution object, the controller selects at least one reference point from one or more candidate points existing around the caution object and associates the virtual image with the at least one reference point.

Claims (48)

1. A display system that projects a projected image onto a reflection member and displays the projected image reflected by the reflection member as a virtual image on a target space in front to allow a user that drives a vehicle to visually recognize the virtual image, the display system comprising:

a projector that projects the projected image;

a processor; and

a memory including a program that, when executed, causes the processor to perform operations including:

acquiring a captured image which includes a caution object and a distance from the vehicle to the caution object;

extracting a plurality of candidate points existing around the caution object in the captured image according to the distance from the vehicle to the caution object;

selecting at least one reference point from the plurality of candidate points existing around the caution object; and

projecting the projected image so that the virtual image is displayed at the at least one reference point,

wherein, in the target space in the front, portions of a plurality of white lines existing on a road surface are extracted as the plurality of candidate points, and one of the plurality of candidate points is selected as the at least one reference point, and the projected image is projected such that the virtual image is visually recognized on a virtual line connecting the caution object and the at least one reference point.

2. The display system according to claim 1 , wherein the at least one reference point is two reference points, and

wherein, two of the plurality of candidate points are selected as the at least one reference point, and the projected image is projected such that a first end of the virtual image is associated with a first one of the two reference points and a second end of the virtual image opposite to the first end of the virtual image is associated with a second one of the two reference points.

3. The display system according to claim 1 , wherein a mode of the display of the projected image is changed according to the distance from the vehicle to the caution object.

4. The display system according to claim 1 , wherein the at least one reference point, which exists around the caution object in the captured image, corresponds to a position of a physical object in the captured image.

5. The display system according to claim 4 , wherein a vertical distance from the vehicle to the position of the physical object is same as a vertical distance from the vehicle to the caution object.

6. The display system according to claim 1 , wherein each of the plurality of candidate points corresponds to a position of a physical object in the captured image.

7. An information presentation system comprising:

the display system according to claim 1 ; and

a detection system that detects the caution object.

8. A vehicle, comprising:

the display system according to claim 1 ; and

the reflection member that has light permeability and reflects light emitted from the projector to allow the user to visually recognize the virtual image.

9. A control method of a display system, the display system including a projector that projects a projected image onto a reflection member, displaying the projected image reflected by the reflection member as a virtual image on a target space in front to allow a user that drives a vehicle to visually recognize the virtual image, and further including a processor that controls display of the projected image, the control method comprising:

acquiring a captured image which includes a caution object and a distance from the vehicle to the caution object;

extracting a plurality of candidate points existing around the caution object in the captured image according to the distance from the vehicle to the caution object;

selecting at least one reference point from the plurality of candidate points existing around the caution object; and

projecting the projected image so that the virtual image is displayed at the at least one reference point,

wherein, in the target space in the front, portions of a plurality of white lines existing on a road surface are extracted as the plurality of candidate points, and one of the plurality of candidate points is selected as the at least one reference point, and the projected image is projected such that the virtual image is visually recognized on a virtual line connecting the caution object and the at least one reference point.

10. A non-transitory recording medium storing a program for causing a computer to execute the control method according to claim 9 .

11. A display system that projects a projected image onto a reflection member and displays the projected image reflected by the reflection member as a virtual image on a target space in front to allow a user that drives a vehicle to visually recognize the virtual image, the display system comprising:

a projector that projects the projected image;

a processor; and

a memory including a program that, when executed, causes the processor to perform operations including:

acquiring a captured image which includes a caution object and a distance from the vehicle to the caution object;

extracting a plurality of candidate points existing around the caution object in the captured image according to the distance from the vehicle to the caution object;

selecting at least one reference point from the plurality of candidate points existing around the caution object; and

projecting the projected image so that the virtual image is displayed at the at least one reference point,

wherein each of the plurality of candidate points corresponds to a position of a physical object in the captured image, and

the plurality of candidate points each exist on a virtual line connecting the caution object and the plurality of candidate points.

12. The display system according to claim 11 , wherein a vertical distance from the vehicle to the position of the physical object corresponding to each of the plurality of candidate points is same as a vertical distance from the vehicle to the caution object.

13. The display system according to claim 11 , wherein the at least one reference point corresponds to the position of the physical object of at least one of the plurality of candidate points in the captured image.

14. A display system that projects a projected image onto a reflection member and superimposes the projected image reflected by the reflection member as a virtual image on a target space in front to allow a target person to visually recognize the virtual image, the display system comprising:

a projector that projects the projected image; and

a processor that controls display of the projected image,

wherein,

when the projector projects the projected image corresponding to a caution object, the processor selects at least one reference point from one or more candidate points existing around the caution object and associates the virtual image with the at least one reference point,

the one or more candidate points are a plurality of candidate points,

in the target space in the front, the processor extracts portions of a plurality of white lines existing on a road surface as the plurality of candidate points, and selects one of the plurality of candidate points as the at least one reference point, and

when the projector projects the projected image, the processor associates the at least one reference point with the virtual image such that the virtual image is visually recognized on a virtual line connecting the caution object and the at least one reference point.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 066703/0177 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2018
From: TANAKA, AKIRA; SHIBATA, TADASHI; NAKANO, NOBUYUKI; TSUJI, MASANAGA; HAYASHI, SHOHEI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 047285/0690 →
Priority Claims (1)
JP 2017-129897 · Jun 30, 2017 · national
Continuity (1)
Related Publication 20190005727A1 · Jan 3, 2019