IP Library Granted Patent US 11,222,476
Granted Patent B2
US 11,222,476 · App. 16/925,873 · Granted Jan 11, 2022

System to add parallax to video for augmented reality head up display

Inventors: David Kay Lambert (Sterling Heights, MI); Derek Louis Didier (Fayetteville, GA)
Assignee: Panasonic Automotive Systems Company of America, Division of Panasonic Corporation of North America
G06T19/006H04N13/128H04N13/383
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,222,476
App. No.
16/925,873
Granted
Jan 11, 2022
Kind
B2
Abstract

A head up display arrangement for a motor vehicle includes a source of a first video signal. A driver monitor system detects a location of at least a portion of a human driver of the motor vehicle. An electronic processor is communicatively coupled to the first video signal source and to the driver monitor system. The electronic processor produces a second video signal that is dependent upon the first video signal and that includes parallax information. The parallax information is based on the detected location of the portion of the driver. A head up display projection device produces a virtual image that is visible to the driver and that is based upon the second video signal.

Claims (37)

1. A head up display arrangement for a motor vehicle, comprising:

a source of a first video signal;

a driver monitor system configured to detect a location of at least a portion of a human driver of the motor vehicle;

an electronic processor communicatively coupled to the first video signal source and to the driver monitor system, the electronic processor being configured to produce a second video signal that is dependent upon the first video signal and that includes parallax information, the parallax information being based on the detected location of the portion of the driver, wherein the parallax information is dependent upon an estimate of where the portion of the human driver will be at a future point in time; and

a head up display projection device configured to produce a virtual image that is visible to the driver and that is based upon the second video signal.

2. The arrangement of claim 1 , wherein the first video signal lacks parallax information.

3. The arrangement of claim 1 , wherein the driver monitor system transmits infrared energy toward the driver and detects the infrared energy after the infrared energy has been reflected off of the driver.

4. The arrangement of claim 1 , wherein the driver monitor system is configured to detect a location of an eye of a human driver.

5. The arrangement of claim 1 , wherein the virtual image includes a plurality of zones, the parallax information being different for each of the zones.

6. The arrangement of claim 5 , wherein the second video signal is dependent upon a plurality of perceived distances between the driver and respective virtual objects in respective ones of the zones.

7. The arrangement of claim 6 , wherein a respective position of each of the virtual objects in the virtual image that is based upon the second video signal is translated relative to a corresponding position of the virtual object in a hypothetical virtual image that is based upon the first video signal.

8. The arrangement of claim 1 , wherein the parallax information is dependent upon a perceived position of the virtual image.

9. A method for presenting visual information to a human driver in a motor vehicle, the method comprising:

transmitting a first video signal;

detecting a location of at least a portion of the human driver of the motor vehicle;

predicting where the portion of the human driver will be at a future point in time;

transmitting a second video signal that is dependent upon the first video signal and that includes parallax information, the parallax information being based on the detected location of the portion of the driver and the prediction of where the portion of the human driver will be at a future point in time; and

producing a virtual image that is visible to the driver and that is based upon the second video signal.

10. The method of claim 9 , wherein the first video signal lacks parallax information.

11. The method of claim 9 , wherein the detecting step includes transmitting infrared energy toward the driver and sensing the infrared energy after the infrared energy has been reflected off of the driver.

12. The method of claim 9 , wherein the detecting step includes detecting a location of an eye of the human driver.

13. The method of claim 9 , wherein the virtual image includes a plurality of zones, the parallax information being different for each of the zones.

14. The method of claim 13 , wherein the second video signal is dependent upon a plurality of perceived distances between the driver and respective virtual objects in respective ones of the zones.

15. The method of claim 14 , wherein a respective position of each of the virtual objects in the virtual image that is based upon the second video signal is translated relative to a corresponding position of the virtual object in a hypothetical virtual image that is based upon the first video signal.

16. The method of claim 9 , wherein the parallax information is dependent upon a position of the virtual image as perceived by the driver.

17. The method of claim 9 , wherein the parallax information is dependent upon an estimate of where a portion of a head of the human driver will be at a future point in time.

18. A head up display arrangement for a motor vehicle, comprising:

a source of a first video signal;

a dichroic mirror;

a driver monitor system configured to:

emit infrared energy through the dichroic mirror such that the infrared energy is reflected off of a human driver of the motor vehicle;

receive the reflected infrared energy after the infrared energy is reflected off of a human driver; and

detect a location of at least a portion of a human driver of the motor vehicle based upon the received infrared energy;

an electronic processor communicatively coupled to the first video signal source and to the driver monitor system, the electronic processor being configured to produce a second video signal that is dependent upon the first video signal and that includes parallax information, the parallax information being based on the detected location of the portion of the driver and an estimate of where the portion of the human driver will be at a future point in time; and

a head up display projection device configured to emit a light field that is reflected off of the dichroic mirror to thereby produce a virtual image that is visible to the driver and that is based upon the second video signal.

19. The arrangement of claim 18 , wherein the first video signal lacks parallax information.

20. The arrangement of claim 18 , wherein the driver monitor system is configured to detect a location of an eye of a human driver.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE SUPPORTIVE DOCUMENTS PREVIOUSLY RECORDED ON REEL 72222 FRAME 267. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 23, 2025
From: PANASONIC CORPORATION OF NORTH AMERICA
To: PANASONIC AUTOMOTIVE SYSTEMS AMERICA, LLC.
Reel/Frame 072930/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2025
From: PANASONIC CORPORATION OF NORTH AMERICA
To: PANASONIC AUTOMOTIVE SYSTEMS AMERICA, LLC
Reel/Frame 072222/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2020
From: LAMBERT, DAVID KAY; DIDIER, DEREK LOUIS
To: PANASONIC AUTOMOTIVE SYSTEMS COMPANY OF AMERICA, DIVISION OF PANASONIC CORPORATION OF NORTH AMERICA
Reel/Frame 053175/0323 →
Continuity (2)
Provisional Application 62847537 · May 14, 2019
Related Publication 20200388079A1 · Dec 10, 2020