IP Library › Granted Patent US 10,609,340
Granted Patent B2
US 10,609,340 · App. 15/805,918 · Granted Mar 31, 2020

Display system utilizing vehicle and trailer dynamics

Inventors: Sudipto Aich (Palo Alto, CA); Roger Arnold Trombley (Ann Arbor, MI); John Shutko (Ann Arbor, MI); Alex Maurice Miller (Canton, MI)
Assignee: Ford Global Technologies, LLC
H04N7/181B60D1/245B60D1/62B60R1/003B60W30/00B62D13/06B62D15/027H04N7/183B60R2300/70B60R2300/808G01B7/30G01B11/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,609,340
App. No.
15/805,918
Granted
Mar 31, 2020
Kind
B2
Abstract

A vehicle and trailer display system is disclosed. The display system includes a plurality of imaging devices disposed on the vehicle, each having a field of view. The display system further includes a screen disposed in the vehicle operable to display images from the imaging devices. A controller is in communication with the imaging devices and the screen and is operable to receive a hitch angle corresponding to the angle between the vehicle and the trailer. Based on the hitch angle, the controller is operable to select a field of view of an imaging device to display on the screen.

Claims (40)

1. A vehicle and trailer monitoring system comprising:

a controller in communication with a screen and a plurality of imaging devices configured to capture image data disposed on the vehicle and the trailer, the controller operable to:

receive a hitch angle corresponding to a connection between the vehicle and the trailer;

display a combined image on the screen corresponding to a first and a second field of view of the plurality of imaging devices based on the hitch angle; and

identify an occluded portion of the image data, wherein the occluded portion indicates a region of the image data occluded by the trailer; and

identify at least one feature located in the occluded portion based on a position identified from a global positioning system (GPS).

2. The monitoring system according to claim 1 , wherein the combined image comprises a fused image combining the first field of view and the second field of view to generate an expanded field of view.

3. The monitoring system according to claim 2 , wherein the first field of view corresponds to a first imaging device disposed on the vehicle and the second field of view corresponds to a second imaging device disposed on the trailer.

4. The monitoring system according to claim 1 , wherein the controller is further operable to:

receive a wheel steer angle of the vehicle.

5. The monitoring system according to claim 1 , wherein the controller is further operable to incorporate a representation of the at least one feature in the image data demonstrating the location of the at least one feature relative to the vehicle.

6. A display system comprising:

a plurality of imaging devices disposed on a vehicle and a trailer, each comprising a field of view; and

a screen disposed in the vehicle;

a controller in communication with the imaging devices and the screen and operable to:

receive a hitch angle corresponding to the angle between the vehicle and the trailer;

identify an occluded portion of at least one of the fields of view;

generate an aerial view of the vehicle and the trailer based on the hitch angle, wherein the aerial view demonstrates the occluded portion; and

utilize GPS data to identify at least one feature in the occluded portion.

7. The display system according to claim 6 , wherein the aerial view is generated by combining the fields of view of the plurality of imaging devices.

8. The display system according to claim 6 , wherein the aerial view of the vehicle and the trailer is simulated as graphics on the screen demonstrating the hitch angle between the vehicle and the trailer.

9. The display system according to claim 6 , wherein the aerial view of the trailer is simulated based on at least one of a plurality of trailer dimensions determined from a relationship among the fields of view of the plurality of imaging devices and the hitch angle, and at least one manually input trailer dimension.

10. The display system according to claim 6 , wherein the controller is further operable to:

overlay graphical data from a satellite image located in the aerial view based on a GPS location of the vehicle.

11. The display system according to claim 10 , wherein the controller is configured to orient the graphic in response to a navigation bearing of the vehicle.

12. The display system according to claim 6 , wherein the occluded portion corresponds to a portion of the environment proximate the trailer that is not visible in the plurality of fields of view.

13. The display system according to claim 6 , wherein the controller is further operable to display the at least one feature in the aerial view demonstrating composite image data identifying a position of the at least one feature relative to the trailer.

14. A method for controlling a vehicle and trailer monitoring system, the method comprising:

capturing image data from a plurality of imaging devices disposed on the vehicle and the trailer;

receiving a hitch angle corresponding to a connection between the vehicle and the trailer;

displaying a combined image corresponding to a first and a second field of view of the plurality of imaging devices based on the hitch angle;

identifying an occluded portion of at least one of the first field of view and the second field of view;

utilizing GPS data to identify at least one feature in the occluded portion; and

displaying the at least one feature in at least one of the first field of view and the second field of view demonstrating composite image data identifying a position of the at least one feature relative to the trailer.

15. The method according to claim 14 , further comprising:

fusing the first field of view and the second field of view generating an expanded field of view comprising a fused image.

16. The method according to claim 15 , wherein the first field of view is captured via a first imaging device disposed on the vehicle and the second field of view is captured by a second imaging device disposed on the trailer.

17. The method according to claim 14 , further comprising:

receiving a wheel steer angle of the vehicle; and

demonstrating a future position of the trailer with the simulated graphic based on the wheel steer angle and the hitch angle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2017
From: AICH, SUDIPTO; TROMBLEY, ROGER ARNOLD; SHUTKO, JOHN; MILLER, ALEX MAURICE
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 044065/0567 →
Continuity (15)
Division 14289888 · May 29, 2014
Continuation In Part 14256427 · Apr 18, 2014
Continuation In Part 14249781 · Apr 10, 2014
Continuation In Part 14188213 · Feb 24, 2014
Continuation In Part 13847508 · Mar 20, 2013
Continuation In Part 14068387 · Oct 31, 2013
Continuation In Part 14059835 · Oct 22, 2013
Continuation In Part 13443743 · Apr 10, 2012
Continuation In Part 13336060 · Dec 23, 2011
Continuation In Part 14161832 · Jan 23, 2014
Continuation In Part 14059835 · Oct 22, 2013
Continuation In Part 14201130 · Mar 7, 2014
Continuation In Part 14068387 · Oct 31, 2013
Provisional Application 61477132 · Apr 19, 2011
Related Publication 20180109762A1 · Apr 19, 2018
Cited By (1)
US 12,578,724