IP Library Granted Patent US 9,772,496
Granted Patent B2
US 9,772,496 · App. 15/263,993 · Granted Sep 26, 2017

Position adjustment method of vehicle display device

Inventor: Masayuki Kimura (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G02B27/0179B60K35/00B60R1/00B60R11/02G02B27/01G02B27/0101G06K9/00832G06K9/00845G06T3/0068G06T7/73B60R11/04B60R2300/205G02B2027/0138G02B2027/0181G02B2027/0187G06T2207/10004G06T2207/10024G06T2207/30204G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,772,496
App. No.
15/263,993
Granted
Sep 26, 2017
Kind
B2
Abstract

In a vehicle display device including a HUD that displays a virtual image on a front field of a view of a driver and a viewpoint detecting camera that captures an image of the driver, a measuring camera is capable of capturing the virtual image. A calibration pattern is at a predetermined position with respect to a viewing angle of the virtual image and angles of view of the viewpoint detecting and measuring cameras. The calibration pattern is captured by the viewpoint detecting and measuring cameras, and the virtual image is captured by the measuring camera. The relative position and orientation between the viewpoint detecting camera and HUD are calculated as orientation information using an image captured by the viewpoint detecting camera and an image captured by the measuring camera. In addition, the position of the virtual image displayed by the HUD is adjusted using the calculated orientation information.

Claims (35)

1. A position adjustment method of a vehicle display device including:

a display device configured to display a virtual image on a front field of view of a driver, and

a viewpoint detecting camera configured to capture an image of the driver, the method comprising:

installing a measuring camera in a position at which a calibration pattern for acquiring information for the virtual image and position adjustment can be captured, and disposing the calibration pattern in a predetermined position with respect to a viewing angle of the virtual image, an angle of view of the viewpoint detecting camera, and an angle of view of the measuring camera;

capturing the calibration pattern by the viewpoint detecting camera and the measuring camera;

capturing the virtual image by the measuring camera;

calculating a relative position and a relative orientation between the measuring camera and the viewpoint detecting camera, and calculating a relative position and a relative orientation between the measuring camera and the display device by using an image captured by the viewpoint detecting camera and an image captured by the measuring camera, and calculating a relative position and a relative orientation between the viewpoint detecting camera and the display device from the two relative positions and orientations as orientation information; and

adjusting a position of the virtual image displayed by the display device by using the orientation information.

2. The position adjustment method of a vehicle display device according to claim 1 , further comprising disposing the calibration pattern within a range where the viewing angle of the virtual image, the angle of view of the viewpoint detecting camera, and the angle of view of the measuring camera overlap.

3. The position adjustment method of a vehicle display device according to claim 2 ,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

4. The position adjustment method of a vehicle display device according to claim 3 , wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

5. The position adjustment method of a vehicle display device according to claim 2 , wherein the calibration pattern is translucent.

6. The position adjustment method of a vehicle display device according to claim 5 ,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

7. The position adjustment method of a vehicle display device according to claim 6 , wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

8. The position adjustment method of a vehicle display device according to claim 1 , further comprising disposing the calibration pattern extending across a region within a range where the viewing angle of the virtual image and the angle of view of the measuring camera overlap, the region being outside the angle of view of the viewpoint detecting camera and a region within a range where the angle of view of the viewpoint detecting camera and the angle of view of the measuring camera overlap, the region being outside a range of the viewing angle of the virtual image.

9. The position adjustment method of a vehicle display device according to claim 8 , wherein the calibration pattern is translucent.

10. The position adjustment method of a vehicle display device according to claim 8 ,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

11. The position adjustment method of a vehicle display device according to claim 10 , wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

12. The position adjustment method of a vehicle display device according to claim 8 ,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

13. The position adjustment method of a vehicle display device according to claim 12 , wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

14. The position adjustment method of a vehicle display device according to claim 1 ,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

15. The position adjustment method of a vehicle display device according to claim 14 , wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

16. A position adjustment method of a vehicle display device including:

a display device configured to display a virtual image on a front field of view of a driver, and

a viewpoint detecting camera configured to capture an image of the driver, the method comprising:

installing a measuring camera configured to capture the virtual image, and

capturing by the viewpoint detecting camera a calibration pattern for acquiring information for position adjustment, the calibration pattern being attached to a predetermined position with respect to the measuring camera;

capturing the virtual image by the measuring camera;

calculating a relative position and a relative orientation between the measuring camera and the viewpoint detecting camera, and calculating a relative position and a relative orientation between the measuring camera and the display device by using an image captured by the viewpoint detecting camera and an image captured by the measuring camera, and calculating a relative position and a relative orientation between the viewpoint detecting camera and the display device from the two relative positions and orientations as orientation information; and

adjusting a position of the virtual image displayed by the display device by using the orientation information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 066703/0139 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2017
From: KIMURA, MASAYUKI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 041012/0446 →
Priority Claims (1)
JP 2015-065879 · Mar 27, 2015 · national
Continuity (2)
Continuation PCTJP2016001577 · Mar 18, 2016
Related Publication 20160377873A1 · Dec 29, 2016