IP Library Granted Patent US 9,057,874
Granted Patent B2
US 9,057,874 · App. 12/982,478 · Granted Jun 16, 2015

Virtual cursor for road scene object selection on full windshield head-up display

Inventors: Thomas A. Seder (Northville, MI); Joseph F. Szczerba (Grand Blanc, MI); Dehua Cui (Northville, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G02B27/01G02B2027/014G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,057,874
App. No.
12/982,478
Granted
Jun 16, 2015
Kind
B2
Abstract

A method to select a feature in a view in front of a vehicle includes monitoring the view in front of the vehicle visible through a graphic projection display, monitoring a user input to the graphic projection display, determining the selected feature based upon the monitored view and the monitored user input, determining a registered graphic representing the selected feature for display upon the graphic projection display, and displaying the registered graphic upon the graphic projection display.

Claims (33)

1. Method to select a feature in a view in front of a vehicle, the method comprising:

monitoring the view in front of the vehicle visible through a graphic projection display, the graphic projection display always remaining static with respect to the view in front of the vehicle;

monitoring a user input to the graphic projection display, the user input corresponding to a first viewer and indicated to a portion of the graphic projection display corresponding to a portion of the view in front of the vehicle that includes the feature;

monitoring an eye location of the user;

estimating a gaze location of the user based on the monitored eye location, the gaze location of the user describing a point on a transparent windscreen where eyes of the user are focused;

selecting the feature based upon the monitored view, the gaze location of the user, and the monitored user input, wherein the feature is represented as viewed in the real environment in front of the vehicle;

only after the feature is selected, ascertaining information related to the selected feature;

determining a first registered graphic representing the ascertained information related to the selected feature for display upon the graphic projection display; and

displaying the first registered graphic upon the graphic projection display, wherein displaying the first registered graphic upon the graphic projection display comprises projecting the first registered graphic and a second registered graphic upon a pixelated field of view limited architecture, comprising:

monitoring a first location corresponding to the first viewer;

monitoring a second location corresponding to a second viewer, wherein the first and second locations are configured on the interior of the vehicle;

determining the second graphic representing the ascertained information related to the selected feature, wherein the first graphic is respective to the first location corresponding to the first viewer and the second graphic is respective to the second location corresponding to the second viewer;

dynamically registering first and second viewer-defined locations of respective ones of the first and second graphics upon an interior side of the graphic projection display corresponding to the driving scene of the vehicle, comprising

the first graphic dynamically registered at the first viewer-defined location upon the interior side of the graphic projection display to enable view of the first graphic only from a first limited direction oriented toward the first viewer location corresponding to the first viewer, and

the second graphic dynamically registered at the second viewer-defined location upon the interior side of the graphic projection display to enable view of the second graphic only from a second limited direction oriented toward the second viewer location corresponding to the second viewer; and

projecting the first and second graphics upon the interior side of the graphic projection display.

2. The method of claim 1 , further comprising identifying the selected feature.

3. The method of claim 2 , wherein identifying the selected feature comprises identifying the selected feature as a road feature.

4. The method of claim 2 , wherein identifying the selected feature comprises identifying the selected feature as another vehicle.

5. The method of claim 2 , wherein identifying the selected feature comprises identifying the selected feature as a building.

6. The method of claim 2 , wherein identifying the selected feature comprises identifying the selected feature as a parking lot.

7. The method of claim 2 , wherein identifying the selected feature comprises identifying the selected feature as an advertising sign.

8. The method of claim 2 , wherein identifying the selected feature comprises identifying the selected feature as a sign indicating a potential navigation destination.

9. The method of claim 1 , wherein the graphic projection display is a transparent windscreen head-up display.

10. The method of claim 9 , wherein monitoring the user input to the graphic projection display comprises monitoring a hand gesture indicated to the graphic projection display;

wherein determining the registered graphic representing the selected feature is further based upon the monitored hand gesture.

11. The method of claim 10 , wherein monitoring the hand gesture comprises utilizing an imaging device to generate a three-dimensional mapping of the hand gesture.

12. The method of claim 11 , wherein utilizing the imaging device to generate the three-dimensional mapping of the hand gesture comprises capturing images with a device utilizing one of infrared light, ultraviolet light, and a combination of infrared and ultraviolet light.

13. The method of claim 11 , wherein utilizing the imaging device to generate the three-dimensional mapping of the hand gesture comprises utilizing a laser speckle pattern.

14. The method of claim 11 , wherein utilizing the imaging device to generate the three-dimensional mapping of the hand gesture comprises utilizing pulsed modulation.

15. The method of claim 11 , wherein utilizing the imaging device to generate the three-dimensional mapping of the hand gesture comprises illuminating the hand gesture with beams of radiation and generating the three-dimensional mapping based upon intensity-based mapping.

16. The method of claim 1 , wherein the graphic projection display comprises a touch screen device displaying the view in front of the vehicle.

17. The method of claim 1 , wherein the graphic projection display comprises a non-transparent surface comprising luminescent materials.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034287/0159 →
SECURITY AGREEMENT Recorded Jun 24, 2011
From: GM GLOBAL TECHNOLOGY OPERATIONS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 026499/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2010
From: SEDER, THOMAS A.; SZCZERBA, JOSEPH F.; CUI, DEHUA
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 025564/0151 →
Continuity (1)
Related Publication 20120174004A1 · Jul 5, 2012