IP Library › Granted Patent US 10,744,943
Granted Patent B1
US 10,744,943 · App. 16/377,388 · Granted Aug 18, 2020

System and method for trailer alignment

Inventors: Bruno Sielly Jales Costa (Santa Clara, CA); Nikhil Nagraj Rao (Sunnyvale, CA); Vidya Nariyambut Murali (Sunnyvale, CA); Luke Niewiadomski (Dearborn, MI)
Assignee: Ford Global Technologies, LLC
B60R1/003B60D1/065B60D1/363G06K9/00791G06T7/70B60R2300/105B60R2300/30B60R2300/808B60Y2300/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,744,943
App. No.
16/377,388
Granted
Aug 18, 2020
Kind
B1
Abstract

A vehicle maneuvering system comprises at least one image device configured to capture image data and a controller. The controller is configured to identify a coupler position of a trailer in the image data and control motion of the vehicle navigating a hitch ball of the vehicle toward the coupler position. The controller is further configured to monitor a coupler distance extending from the coupler position and the hitch ball. In response to the coupler distance being less than or equal to the distance threshold, the controller is configured to classify a plurality of portions of the image data as trailer portions and non-trailer portions and identify the coupler position by processing the image via a feature extraction operation.

Claims (48)

1. A vehicle maneuvering control system, comprising:

at least one image device configured to capture image data; and

a controller configured to:

identify a coupler position of a trailer in the image data;

control motion of the vehicle navigating a hitch of the vehicle toward the coupler position;

monitor a coupler distance extending from the coupler position to the hitch; and

in response to the coupler distance being less than or equal to a distance threshold:

classify a plurality of portions of the image data as trailer portions and non-trailer portions;

identify a trailer heading direction based on the trailer portions;

filter a plurality of the trailer portions of the image data to determine a plurality of nearest trailer portions from the trailer portions, wherein the nearest portions are filtered based on a minimum distance between the trailer portions as detected in the image data and the hitch;

identify the coupler position by processing the image data via a feature extraction operation, wherein the feature extraction operation processes the nearest trailer portions to identify the coupler position; and

in response to the feature extraction operation detecting the coupler position with a predetermined confidence level, control the navigation of the vehicle to the coupler position identified based on the feature extraction operation.

2. The system according to claim 1 , wherein the controller is further configured to:

in response to the feature extraction operation failing to achieve the predetermined confidence level, detect the coupler position, based on the trailer heading direction and the trailer portions nearest the vehicle.

3. The system according to claim 1 , wherein the coupler position is approximated when beyond the distance threshold by processing the image data via a trailer pattern processing method.

4. The system according to claim 1 , wherein the coupler position is detected via the feature extraction operation in the form of a Hough transform in response to the coupler position within the distance threshold.

5. The system according to claim 1 , wherein the nearest trailer portions are filtered by a Kalman filter.

6. The system according to claim 1 , wherein the non-trailer portions are further classified as ground portions and object portions.

7. The system according to claim 6 , wherein the object portions are tracked in relation to a ground plane identified based on the ground portions.

8. The system according to claim 6 , wherein the trailer portions are classified as trailer tongue portions, and wherein the controller is further configured to:

receive motion data for the vehicle via at least one motion sensor; and

track the tongue portions relative to the ground plane based on the motion data.

9. The system according to claim 1 , wherein the classification of the plurality of portions of the image data is processed by comparing pixel values in image data to identify a plurality of edges corresponding to objects.

10. A method for controlling an alignment between a hitch of a vehicle and a coupler of a trailer comprising:

identifying a coupler position of the coupler in image data;

controlling a motion of the vehicle navigating the hitch of the vehicle toward the coupler position;

monitoring a coupler distance between the coupler position and the hitch to a distance threshold; and

in response to the coupler distance being less than or equal to the distance threshold:

classifying a plurality of pixels of the image data as trailer pixels and non-trailer pixels;

identifying a trailer heading direction based on the trailer pixels;

filtering the trailer pixels of the image data to determine a plurality of nearest trailer portions from the trailer pixels, wherein the nearest trailer portions are filtered based on a minimum distance between the trailer pixels as detected in the image data and the hitch,

identifying the coupler position of the coupler via a feature extraction operation, wherein the feature extraction operation processes the nearest trailer portions to identify the coupled position; and

in response to the feature extraction operation detecting the coupler position at a predetermined confidence level, navigating to the coupler position identified based on the feature extraction operation.

11. The method according to claim 10 , wherein in response to the feature extraction operation failing to achieve the predetermined confidence level, detecting the coupler position, based on the trailer heading direction and the trailer pixels nearest the vehicle.

12. The method according to claim 10 , wherein the coupler position is first approximated by processing the image data via a trailer pattern processing method.

13. The method according to claim 10 , wherein the coupler position is detected via the feature extraction operation in the form of a Hough transform.

14. The method according to claim 10 , wherein the nearest trailer portions are filtered by a Kalman filter.

15. A control system for vehicle navigation comprising:

a controller in communication with at least one imaging device configured to capture image data, wherein the controller is configured to:

monitor a coupler distance between a hitch of the vehicle and a coupler of a trailer; and

in response to the coupler distance being less than or equal to a distance threshold:

classify a plurality of portions of the image data as trailer portions and non-trailer portions;

identify a trailer heading direction based on the trailer portions;

process the image data via a Kalman filter identifying a plurality of nearest trailer portions from the trailer portions, wherein the nearest portions are identified based on a nearest distance between the trailer portions as detected in the image data and the hitch;

identify the coupler position via a Hough transform, wherein the Hough transition processes the nearest trailer portions to identify the coupler position;

in response to detecting the coupler position via the Hough transform at a predetermined confidence level, control a navigation to the coupler position identified via the Hough transform; and

in response to the Hough transform failing to achieve the predetermined confidence level, detect the coupler position, based on the heading direction and the trailer portions nearest the vehicle.

16. The system according to claim 15 , wherein the coupler distance is first approximated by processing the image data via a trailer pattern processing method when the vehicle is outside the distance threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2019
From: JALES COSTA, BRUNO SIELLY; NAGRAJ RAO, NIKHIL; NARIYAMBUT MURALI, VIDYA; NIEWIADOMSKI, LUKE
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 048816/0973 →
Cited By (4)
US 12,344,166 US 12,361,589 US 12,594,884 US 12,595,141