IP Library Granted Patent US 9,752,889
Granted Patent B2
US 9,752,889 · App. 14/210,587 · Granted Sep 5, 2017

Time and environment aware graphical displays for driver information and driver assistance systems

Inventors: Liu Ren (Cupertino, CA); Lei Yang (Cupertino, CA)
Assignee: Robert Bosch GmbH
G01C21/3638
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,752,889
App. No.
14/210,587
Granted
Sep 5, 2017
Kind
B2
Abstract

A graphics display system for driver information and driver assistance applications generates controllable and dynamic graphical effects in conjunction with 3D visualization of maps. The system generates a display of a map in a 3D virtual environment that responds to the environment changes in a dynamic and visually intuitive manner for a vehicle operator. The system processes environment information, including lighting condition, weather condition, and other data acquired from different sensors in the vehicle such as cameras and lighting sensors, or through networked information services. The graphics display can be integrated with different driver information and driver assistance system embodiments including mobile platforms, in-vehicle information systems, web platforms, and PC systems.

Claims (73)

1. An in-vehicle information system within a vehicle comprising:

a memory in the vehicle configured to store:

map data corresponding to a plurality of objects in a virtual environment corresponding to a physical environment external to a vehicle;

rendering parameter data including a plurality of rendering parameters corresponding to graphical effects to modify a visual representation of the plurality of objects in the map data; and

control parameter data including a plurality of control parameters, each control parameter including an association between a predetermined environmental condition in the physical environment external to the vehicle and at least one rendering parameter in the plurality of rendering parameters;

a network device in the vehicle configured to receive first environment data corresponding to at least one environmental condition in the physical environment external to the vehicle from an online information source that is external to the vehicle;

a vehicle sensor in the vehicle configured to generate second environment data corresponding to the at least one environmental condition in the physical environment external to the vehicle;

a display device in the vehicle configured to generate a graphical depiction of the plurality of objects in the virtual environment; and

a controller in the vehicle operatively connected to the memory, the network device, the vehicle sensor, and the display device, the controller being configured to:

receive the first environment data corresponding to the physical environment external to the vehicle with the network device from the online information source;

receive the second environment data corresponding to the physical environment external to the vehicle from the vehicle sensor;

identify a first rendering parameter in the plurality of rendering parameters with reference to the plurality of control parameters and the first environment data;

identify a second rendering parameter in the plurality of rendering parameters with reference to the plurality of control parameters and the first environment data;

identify a third rendering parameter in the plurality of rendering parameters with reference to the plurality of control parameters and the second environment data;

generate a first visual depiction of the virtual environment using the display device in response to the second environment data from the vehicle sensor corresponding to the first environment data from the online information source, the first visual depiction including at least one object in the map data, a first graphical effect corresponding to the first rendering parameter being applied to the at least one object in the virtual environment, and a second graphical effect corresponding to the second rendering parameter being applied to the at least one object in the virtual environment; and

generate a second visual depiction of the virtual environment using the display device in response to the second environment data from the vehicle sensor being different than the first environment data from the online information source, the second visual depiction including the at least one object in the map data, the first graphical effect corresponding to the first rendering parameter being applied to the at least one object in the virtual environment, and a third graphical effect corresponding to the third rendering parameter being applied to the at least one object in the virtual environment instead of the second graphical effect to override the second graphical effect based on the second environment data from the vehicle sensor being different than the first environment data from the online information source.

2. The in-vehicle information system of claim 1 , the controller being further configured to:

identify the third rendering parameter in the plurality of rendering parameters corresponding to at least one weather condition in the physical environment that is external to the vehicle with reference to the plurality of control parameters and the second environment data; and

applying the third graphical effect corresponding to the third rendering parameter to the at least one object to depict the at least one weather condition in the virtual environment with the display device in addition to the first graphical effect.

3. The in-vehicle information system of claim 2 , the controller being further configured to:

identify that the at least one weather condition corresponds to rain; and

apply the third graphical effect corresponding to the rain to the at least one object in the virtual environment in response to the at least one weather condition in the weather condition data corresponding to rain.

4. The in-vehicle information system of claim 2 , the controller being further configured to:

identify that the at least one weather condition corresponds to snow; and

apply the third graphical effect corresponding to accumulated snow on a surface of the at least one object in the virtual environment in response to the at least one weather condition in the weather condition data corresponding to snow.

5. The in-vehicle information system of claim 1 , the data stored in the memory further comprising:

a first texture;

a second texture; and

the controller being further configured to:

receive the first environment data including first weather condition data from the online information source indicating sunny weather in the physical environment external to the vehicle;

receive the second environment data including second weather condition data indicating shadow around the vehicle from the vehicle sensor;

identify the second rendering parameter in the plurality of rendering parameters corresponding to the first texture with reference to the plurality of control parameters and the first weather condition data;

identify the third rendering parameter in the plurality of rendering parameters corresponding to the second texture with reference to the plurality of control parameters and the second weather condition data; and

generate the second visual depiction of the virtual environment with only the second texture being applied to the surface of the at least one object in the virtual environment.

6. The in-vehicle information system of claim 1 , the data stored in the memory further comprising:

a first shader program configured to generate a first graphical effect for an object in the virtual environment;

a second shader program configured to generate a second graphical effect for the object in the virtual environment; and

the controller being further configured to:

receive the first environment data including first weather condition data from the online information source for the physical environment external to the vehicle;

receive the second environment data including second weather condition data from the vehicle sensor for the physical environment external to the vehicle;

identify the second rendering parameter in the plurality of rendering parameters corresponding to the first shader program with reference to the plurality of control parameters and the first weather condition data;

identify the third rendering parameter in the plurality of rendering parameters corresponding to the second shader program with reference to the plurality of control parameters and the second weather condition data; and

generate the second visual depiction of the virtual environment with execution of only the second shader program to generate the third graphical effect applied to the at least one object in the virtual environment.

7. A method of generating a display of a virtual environment corresponding to a physical environment external to a vehicle comprising:

receiving with a network device in the vehicle first environment data corresponding to at least one environmental condition in the physical environment external to the vehicle from an online information source that is external to the vehicle;

generating with a vehicle sensor in the vehicle second environment data corresponding to at least one environmental condition in the physical environment external to the vehicle;

receiving with a controller in the vehicle the first environment data from the online information source and the second environment data from the vehicle sensor corresponding to the physical environment external to the vehicle;

identifying with the controller a first rendering parameter in a plurality of rendering parameters stored in a memory with reference to a plurality of control parameters stored in the memory and the first environment data;

identifying, with the controller a second rendering parameter in the plurality of rendering parameters with reference to the plurality of control parameters stored in the memory and the first environment data;

identifying with the controller a third rendering parameter in a plurality of rendering parameters stored in the memory with reference to the plurality of control parameters stored in the memory and the second environment data;

generating with the controller and a display device in the vehicle a first visual depiction of the virtual environment in response to the second environment data from the vehicle sensor corresponding to the first environment data from the online information source, the first visual depiction including at least one object in map data stored in the memory, a first graphical effect corresponding to the first rendering parameter being applied to the at least one object in the virtual environment, and a second graphical effect corresponding to the second rendering parameter being applied to the at least one object in the virtual environment; and

generating with the controller and the display device a second visual depiction of the virtual environment in response to the second environment data from the vehicle sensor being different than the first environment data from the online information source, the second visual depiction including the at least one object in the map data, the first graphical effect corresponding to the first rendering parameter being applied to the at least one object in the virtual environment, and a third graphical effect corresponding to the third rendering parameter being applied to the at least one object in the virtual environment instead of the second graphical effect to override the second graphical effect based on the second environment data from the vehicle sensor being different than the first environment data from the online information source.

8. The method of claim 7 further comprising:

identifying with the controller the third rendering parameter in the plurality of rendering parameters corresponding to at least one weather condition in the physical environment that is external to the vehicle with reference to the plurality of control parameters and the second environment data; and

applying with the controller the third graphical effect corresponding to the third rendering parameter to the at least one object to depict the at least one weather condition in the virtual environment with the display device in addition to the first graphical effect.

9. The method of claim 8 , the application of the graphical effect further comprising:

identifying with the controller that the at least one weather condition corresponds to rain; and

applying with the controller the third graphical effect corresponding to rain to the at least one object in the virtual environment in response to the at least one weather condition in the weather condition data corresponding to rain.

10. The method of claim 8 , the application of the graphical effect further comprising:

identifying with the controller that the at least one weather condition corresponds to snow; and

applying with the controller the third graphical effect corresponding to accumulated snow on a surface of the at least one object in the virtual environment in response to the at least one weather condition in the weather condition data corresponding to snow.

11. The method of claim 7 further comprising:

receiving with the controller the first environment data including first weather condition data from the online information source indicating sunny weather in the physical environment external to the vehicle;

receiving with the controller the second environment data including second weather condition data from the vehicle sensor indicating shadow around the vehicle in the physical environment external to the vehicle;

identifying with the controller the second rendering parameter in the plurality of rendering parameters corresponding to a first texture stored in the memory with reference to the plurality of control parameters and the first weather condition data;

identifying with the controller the third rendering parameter in the plurality of rendering parameters corresponding to a second texture stored in the memory with reference to the plurality of control parameters and the second weather condition data; and

generating with the controller and the display device the second visual depiction of the virtual environment with only the second texture being applied to the surface of the at least one object in the virtual environment.

12. The method of claim 7 further comprising:

receiving with the controller the first environment data from the online information source as first weather condition data in the physical environment external to the vehicle;

receiving with the controller the second environment data from the vehicle sensor as second weather condition data in the physical environment external to the vehicle;

identifying with the controller the second rendering parameter in the plurality of rendering parameters corresponding to a first shader program stored in the memory with reference to the plurality of control parameters and the first weather condition data;

identifying with the controller the third rendering parameter in the plurality of rendering parameters corresponding to a second shader program stored in the memory with reference to the plurality of control parameters and the second weather condition data; and

generating with the controller and the visual display device the second visual depiction of the virtual environment with execution of only the second shader program to generate the third graphical effect applied to the at least one object in the virtual environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2015
From: REN, LIU; YANG, LEI
To: ROBERT BOSCH GMBH
Reel/Frame 036186/0395 →
Continuity (2)
Provisional Application 61785006 · Mar 14, 2013
Related Publication 20140277939A1 · Sep 18, 2014