IP Library Granted Patent US 8,704,653
Granted Patent B2
US 8,704,653 · App. 12/487,926 · Granted Apr 22, 2014

Enhanced road vision on full windshield head-up display

Inventors: Thomas A. Seder (Northville, MI); Joseph F. Szczerba (Grand Blanc, MI); Dehua Cui (Northville, MI)
Assignee: GM Global Technology Operations LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,704,653
App. No.
12/487,926
Granted
Apr 22, 2014
Kind
B2
Abstract

A method to selectively project graphical images upon a transparent windscreen head up display of a vehicle based upon a need for enhanced vision includes monitoring informational inputs describing an operational environment for the vehicle, processing the informational inputs to generate display requirements, generating the graphical images to be projected based upon the display requirements, and projecting the graphical images upon the transparent windscreen head up display. Processing of the informational inputs can include determining the need for enhanced vision based upon the informational inputs and generating the display requirements based upon the informational inputs and the need for enhanced vision.

Claims (60)

1. Method to selectively project graphical images upon a transparent windscreen head up display of a vehicle based upon a need for enhanced vision, the method comprising:

monitoring informational inputs corresponding to features of a roadway needed for travel, critical information perceived as a threat to the vehicle and an operational environment for the vehicle;

determining a degree of importance of the critical information;

determining a measure of visual conditions based on the operational environment for the vehicle;

comparing the measure of visual conditions to a threshold visual condition, said threshold visual condition adjustable based on the degree of importance of the critical information;

determining the need for enhanced vision based on the measure of visual conditions violating the threshold visual condition;

generating display requirements for the features of the roadway based on the need for enhanced vision;

generating the graphical images corresponding to the features of the roadway to be projected based upon the display requirements; and

projecting the graphical images upon the transparent windscreen head up display.

2. The method of claim 1 , wherein monitoring informational inputs corresponding to the features of the roadway comprises monitoring sensor inputs corresponding to the features of the roadway; and

wherein the generating the graphical images comprises generating lines indicating lane boundaries based upon the monitored sensor inputs corresponding to the features of the roadway.

3. The method of claim 2 , wherein monitoring sensor inputs corresponding to the features of the roadway comprises:

monitoring a vehicle coordinate position through a GPS device;

utilizing the monitored vehicle coordinate position to locate the vehicle with a map database; and

determining the features of the roadway based upon the location of the vehicle.

4. The method of claim 2 , wherein monitoring sensor inputs corresponding to the features of the roadway comprises:

monitoring sensor inputs corresponding to a view in front of the vehicle; and

determining the features of the roadway based upon the monitored sensor inputs.

5. The method of claim 4 , wherein monitoring sensor inputs comprises

monitoring visual images from a camera device.

6. The method of claim 4 , wherein monitoring sensor inputs comprises

monitoring infrared images from an infrared sensor device.

7. The method of claim 1 , further comprising:

monitoring data related to an occupant eye location;

analyzing the monitored data to identify a pattern consistent with trying to find obscured lane markers; and

determining the need for enhanced vision based upon identifying the pattern consistent with trying to find obscured lane markers; and

wherein generating the graphical images corresponding to the features of the roadway comprises generating lines indicating lane boundaries.

8. The method of claim 1 , further comprising:

analyzing the monitored informational inputs to identify a situation likely to surprise; and

indicating the need for enhanced vision based upon identifying the situation likely to surprise.

9. The method of claim 1 , further comprising

monitoring data related to an occupant eye location; and

wherein generating the graphical images corresponding to the features of the roadway to be projected based upon the display requirements includes registering the graphical images based upon the monitored data related to the occupant eye location.

10. System to display graphical images upon a windscreen of a vehicle, selectively enhancing a view through the windscreen, the system comprising:

the windscreen comprising a transparent windscreen head up display;

a device monitoring a measure of visual conditions;

a device monitoring informational inputs corresponding to features of a roadway needed for travel, critical information perceived as a threat to the vehicle and an operational environment for the vehicle;

an enhanced vision system system manager configured to:

determine a degree of importance of the critical information;

compare the measure of visual conditions to a threshold visual condition, wherein the threshold visual condition is adjustable based on the degree of importance of the critical information; and

when the comparison of the measure of visual conditions to the threshold visual condition indicates impaired visual conditions, generate display requirements for the features of the roadway;

a graphics system generating the graphical images corresponding to the features of the roadway to be displayed based upon the display requirements; and

a graphics projection system communicating with the graphics system and displaying the graphical images.

11. The system of claim 10 , wherein the graphical images corresponding to the features of the roadway comprise a lane boundary.

12. The system of claim 10 , wherein the graphical images corresponding to the features of the roadway comprise a road edge.

13. The system of claim 10 , wherein the graphical images corresponding to the features of the roadway comprise an indication of a target vehicle position.

14. The system of claim 10 , wherein the graphical images corresponding to the features of the roadway comprise an indication of a pedestrian position.

15. The system of claim 10 , wherein the enhanced vision system system manager is further configured to determine an importance of the generated display requirements; and

wherein the graphical images include a description of determined importance.

16. The system of claim 10 , further comprising an occupant eye location sensing system; and

wherein the graphics system generating the graphical images corresponding to the features of the roadway to be displayed based upon the display requirements includes registration of the graphical images to the windscreen based upon data from the occupant eye location sensing system.

17. An apparatus to selectively display registered graphics upon a substantially transparent head up display of a vehicle enhancing a view through the substantially transparent head up display, the apparatus comprising:

a system manager configured to:

monitor sensor inputs corresponding to a road surface in front of the vehicle and critical information perceived as a threat to the vehicle;

monitor a measure of visual conditions;

determine a degree of importance of the critical information;

compare the measure of visual conditions to a threshold visual condition, the threshold visual condition adjustable based on the degree of importance of the critical information;

determine a need for enhancing the view based upon the measure of visual conditions violating the threshold visual condition; and

when the need for enhancing the view is determined, generate display requirements for the road surface based upon the monitored sensor inputs; and

a graphics system generating the registered graphical images corresponding to the road surface based upon the display requirements.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034185/0789 →
CHANGE OF NAME Recorded Feb 10, 2011
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 025781/0299 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: WILMINGTON TRUST COMPANY
Reel/Frame 025324/0555 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025315/0091 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025246/0056 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2010
From: SEDER, THOMAS A.; SZCZERBA, JOSEPH F.; CUI, DEHUA
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 024070/0497 →
SECURITY AGREEMENT Recorded Aug 28, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023162/0048 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023201/0118 →
Continuity (2)
Continuation In Part 12417077 · Apr 2, 2009
Related Publication 20100253540A1 · Oct 7, 2010