IP Library › Granted Patent US 11,351,917
Granted Patent B2
US 11,351,917 · App. 16/275,230 · Granted Jun 7, 2022

Vehicle-rendering generation for vehicle display based on short-range communication

Inventor: David Michael Herman (Oak Park, MI)
Assignee: Ford Global Technologies, LLC
B60R1/00G06K9/6289G06V20/56H04N5/23203H04N7/188H04W4/40B60R2300/105B60R2300/30B60R2300/607B60R2300/806B60R2300/8066
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,351,917
App. No.
16/275,230
Granted
Jun 7, 2022
Kind
B2
Abstract

Method and apparatus are disclosed for vehicle-rendering generation for vehicle display based on short-range communication. An example vehicle includes a communication module configured to wirelessly communicate with remote sensing devices, a display configured to present a vehicle rendering of the vehicle, and a controller. The controller is configured to, in response to detecting an activation event, collect sensing data via the communication module. The controller also is configured to determine whether an object is coupled to the vehicle based on the sensing data and, in response to detecting an object coupled to the vehicle, modify the vehicle rendering to include an object rendering of the object.

Claims (31)

1. A vehicle comprising:

a communication module configured to wirelessly communicate with remote sensing devices, wherein at least one of the remote sensing devices comprises at least one roadside unit and is external to the vehicle, and the at least one of the remote sensing devices and the vehicle are separate;

a display configured to present a vehicle rendering of the vehicle;

a controller configured to:

in response to detecting an activation event, collect sensing data from the at least one roadside unit and the vehicle via the communication module;

determine whether an object is coupled to the vehicle based on the sensing data; and

in response to detecting an object coupled to the vehicle, modify the vehicle rendering to include an object rendering of the object based at least in part on the sensing data, wherein the vehicle rendering is modified based at least in part on a color balance and a white balance; and

an onboard database of renderings, and wherein the controller is configured to retrieve the object rendering from the onboard database upon identifying the object based on the sensing data and upon determining that the controller is unable to generate the object rendering utilizing the sensing data.

2. The vehicle of claim 1 , wherein the communication module is a dedicated short-range communication (DSRC) module.

3. The vehicle of claim 1 , wherein the communication module is configured to collect the sensing data via vehicle-to-vehicle (V2V) communication or vehicle-to-infrastructure (V2I) communication.

4. The vehicle of claim 1 , wherein the sensing data collected via the communication module includes an image captured by a camera at the roadside unit.

5. The vehicle of claim 1 , wherein, in response to detecting the activation event, the controller is configured to cause the communication module to transmit a request for the sensing data.

6. The vehicle of claim 1 , wherein the display is configured to present at least one of a bird's-eye and a side view of the vehicle rendering.

7. The vehicle of claim 1 , wherein the activation event includes activation of at least one of an engine and a motor of the vehicle.

8. The vehicle of claim 1 , further including a camera, and wherein the activation event includes activation of the camera.

9. The vehicle of claim 8 , wherein the display is a touchscreen and the controller activates the camera in response to receiving a request via the touchscreen.

10. The vehicle of claim 8 , wherein the camera is a rearview camera, and wherein the controller activates the rearview camera in response to detecting that a transmission of the vehicle is in reverse.

11. The vehicle of claim 1 , wherein the activation event includes a passive-entry passive-start (PEPS) event.

12. The vehicle of claim 1 , further including an autonomy unit configured for park-assist, and wherein the activation event includes a park-assist event.

13. The vehicle of claim 1 , wherein the controller is configured to fuse the sensing data collected from a plurality of remote sensing devices and determine whether an object is coupled to the vehicle based on the fused sensing data.

14. The vehicle of claim 1 , wherein the controller configured to detect a lighting condition based on the sensing data and modify the vehicle rendering based on the lighting condition.

15. The vehicle of claim 1 , wherein communication between the communication module and the at least one of the remote sensing devices includes location data, and wherein the controller is configured to identify a location of the vehicle within the sensing data based on the location data.

16. The vehicle of claim 1 , wherein the object rendering includes a three-dimensional rendering, and wherein the controller is configured to generate the object rendering utilizing the sensing data.

17. The vehicle of claim 1 , further including a second communication module configured to communicate with a remote server, and wherein the controller is configured to retrieve the object rendering from the remote server via the second communication module in response to determining that the onboard database does not include the object rendering.

18. The vehicle of claim 1 , wherein the vehicle rendering is further modified based at least in part on at least one of: a direction of light, a color temperature, an intensity histogram, a color histogram, or a hue.

19. A method for a vehicle, comprising:

detecting, via a processor, an activation event;

in response to detecting the activation event, generating a vehicle rendering of the vehicle and collecting sensing data from the vehicle and one or more remote sensing devices comprising at least one roadside unit via a communication module, wherein at least one of the one or more remote sensing devices is external to the vehicle, and the at least one of the one or more remote sensing devices and the vehicle are separate;

determining, via the processor, whether an object is coupled to the vehicle based on the sensing data;

in response to detecting an object coupled to the vehicle, modifying the vehicle rendering to include an object rendering of the object based at least in part on the sensing data, wherein the vehicle rendering is modified based at least in part on a color balance and a white balance, and wherein a controller is configured to retrieve the object rendering from an onboard database of renderings upon identifying the object based at least in part on the sensing data and upon determining that the controller is unable to generate the object rendering utilizing the sensing data; and

presenting the vehicle rendering via a display of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2019
From: HERMAN, DAVID MICHAEL
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 049134/0208 →
Continuity (1)
Related Publication 20200254931A1 · Aug 13, 2020