IP Library Granted Patent US 11,983,856
Granted Patent B2
US 11,983,856 · App. 17/994,158 · Granted May 14, 2024

Image display system, image display method, storage medium, and moving vehicle including the image display system

Inventors: Shohei Hayashi (Kyoto, JP); Toshiya Mori (Osaka, JP); Tadashi Shibata (Osaka, JP); Nobuyuki Nakano (Osaka, JP); Akira Tanaka (Osaka, JP); Masanaga Tsuji (Osaka, JP)
Assignee: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
G06T5/80B60K35/00G02B27/0101G02B27/0179G09G5/14G09G5/38B60K35/23B60K2360/23G02B2027/011G09G2380/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,983,856
App. No.
17/994,158
Granted
May 14, 2024
Kind
B2
Abstract

An image display system includes a body, a first correction unit, and a second correction unit. The body houses a display unit to display an image and projects a virtual image, corresponding to the image, onto a target space using outgoing light of the display unit. The first correction unit corrects for distortion of the image. The second correction unit corrects a display location of the image on the display unit in accordance with an orientation signal representing a change in orientation of the body. Each of divisional areas of a display screen of the display unit is assigned with a distortion correction parameter for correcting for the distortion of the virtual image. The first correction unit applies distortion correction to each of the image regions of the image on the display screen based on a distortion correction parameter assigned to a divisional area where the image region is displayed.

Claims (82)

1. An image display system comprising:

a body in which a display displays an image thereon is provided, the body projecting a virtual image, corresponding to the image, onto a target space using outgoing light of the display, and the body installed in a moving vehicle body; and

an image forming unit that forms the image to be displayed on the display, wherein:

the image forming unit includes:

a processor; and

a memory including at least one set of instructions that causes the processor to perform operations when executed by the processor, the operations including:

correcting for distortion of the image; and

correcting a display location of the image on the display in accordance with an orientation signal representing a change in orientation of the moving vehicle body,

the image has a plurality of image regions,

the plurality of image regions include:

a first region to be subjected to the correcting the display location; and

a second region not to be subjected to correcting the display location;

the first region is an image region where a first corresponding image corresponding to a first virtual image is displayed, the first virtual image indicating which way to go at a nearest crossroad in front of the moving vehicle body,

when the moving vehicle body reaches a given distance from the nearest crossroad, the image forming unit forms the first corresponding image,

the correcting the display location is applied to the image that has been subjected to the correcting for distortion,

the correcting for distortion:

predicts a magnitude of correction to be made when the display location of the image is corrected,

reassigns, on the display screen, the distortion correction parameter to the divisional area shifted by the magnitude of correction predicted, and

applies the distortion correction to the image region of the image based on the distortion correction parameter reassigned, and

the predicted magnitude of the correction is nonlinear with respect to a variation in the orientation of the moving vehicle body.

2. The image display system of claim 1 , wherein

the first virtual image is superimposed at a particular location on a user's view of a real-world environment in front of the moving vehicle body.

3. The image display system of claim 1 , wherein

the second region is an image region where a second corresponding image corresponding to a second virtual image is displayed, the second virtual image indicating a distance to the nearest crossroad, and

when the moving vehicle body reaches the given distance from the nearest crossroad, the image forming unit forms the second corresponding image indicating the distance to the nearest crossroad.

4. The image display system of claim 3 , wherein

the second virtual image further indicates a current vehicle velocity of the moving vehicle body.

5. The image display system of claim 1 , wherein

the second region is located below the first region.

6. The image display system of claim 1 , wherein

the correcting the display location is applied in accordance with the orientation signal representing the change in orientation of the moving vehicle body while the moving vehicle body is traveling.

7. The image display system of claim 1 , wherein

the display screen of the display has a plurality of divisional areas,

each of the plurality of divisional areas of the display screen is assigned with a distortion correction parameter for use to correct for the distortion of the virtual image, and

the correcting for distortion is applied to the image region of the image based on the distortion correction parameter assigned.

8. The image display system of claim 7 , wherein

the outgoing light of the display is projected onto, and reflected from, a projection area of a reflective member to produce the virtual image in the target space,

the divisional areas of the display screen are used as a plurality of first divisional areas,

the projection area includes a plurality of second divisional areas,

the plurality of second divisional areas of the projection area correspond one to one to the plurality of first divisional areas of the display screen,

in each of the plurality of first divisional areas of the display screen, the distortion correction parameter assigned to the first divisional area is also applicable to a corresponding one of the plurality of second divisional areas for the first divisional area, and

in each of the plurality of first divisional areas, the correcting for distortion is applied, using the distortion correction parameter, when the outgoing light is reflected from the corresponding second divisional area.

9. The image display system of claim 1 , wherein

the correcting for distortion is applied to the image that has been subjected to the correcting the display location.

10. The image display system of claim 1 , wherein

the orientation signal is an output signal of a gyrosensor that detects a change in the orientation of the moving vehicle body.

11. The image display system of claim 1 , further comprising a sensor that outputs the orientation signal.

12. The image display system of claim 1 , wherein

a magnitude of the correction applied in the correcting the display location is nonlinear with respect to a variation in the orientation of the body.

13. A method for displaying an image using an image display system, the image display system including a body installed in moving vehicle body and in which a display that displays an image thereon is provided, the body projecting a virtual image corresponding to the image onto a target space using outgoing light of the display, the method comprising:

image forming processing to form the image to be displayed on the display, the image forming processing including:

a first correction process of correcting for distortion of the image; and

a second correction process of correcting a display location of the image on the display in accordance with an orientation signal representing a change in orientation of the moving vehicle body, wherein:

the image having a plurality of image regions,

the plurality of image regions include:

a first region to be subjected to the correcting the display location; and

a second region not to be subjected to the correcting the display location;

the first region is an image region where a first corresponding image corresponding to a first virtual image is displayed, the first virtual image indicating which way to go at a nearest crossroad in front of the moving vehicle body,

when the moving vehicle body reaches a given distance from the nearest crossroad, the image forming process forms the first corresponding image,

the correcting the display location is applied to the image that has been subjected to the correcting for distortion,

the correcting for distortion:

predicts a magnitude of correction to be made when the display location of the image is corrected,

reassigns, on the display screen, the distortion correction parameter to the divisional area shifted by the magnitude of correction predicted, and

applies the distortion correction to the image region of the image based on the distortion correction parameter reassigned, and

the predicted magnitude of the correction is nonlinear with respect to a variation in the orientation of the moving vehicle body.

14. A non-transitory computer-readable storage medium that stores an executable program designed to cause a computer to carry out the image display method of claim 13 .

15. An image display system comprising:

a body in which a display displays an image thereon is provided, the body projecting a virtual image, corresponding to the image, onto a target space using outgoing light of the display, and the body installed in a moving vehicle body; and

an image forming unit that forms the image to be displayed on the display, wherein:

the image forming unit includes:

a processor; and

a memory including at least one set of instructions that causes the processor to perform operations when executed by the processor, the operations including:

correcting for distortion of the image, and

correcting a display location of the image on the display in accordance with an orientation signal representing a change in orientation of the moving vehicle body,

the image has a plurality of image regions,

the plurality of image regions include:

a first region to be subjected to the correcting the display location; and

a second region not to be subjected to correcting the display location,

the first region is an image region where a first corresponding image corresponding to a first virtual image is displayed, the first virtual image indicating which way to go at a nearest crossroad in front of the moving vehicle body,

when the moving vehicle body reaches a given distance from the nearest crossroad, the image forming unit forms the first corresponding image,

the operations including predicting a magnitude of correction to be made when the display location of the image is corrected, and

the predicted magnitude of the correction is nonlinear with respect to a variation in the orientation of the moving vehicle body.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2024
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 066709/0745 →
Priority Claims (1)
JP 2018-069740 · Mar 30, 2018 · national
Continuity (3)
Continuation 17030621 · Sep 24, 2020
Continuation PCTJP2019013091 · Mar 27, 2019
Related Publication 20230086164A1 · Mar 23, 2023