IP Library Granted Patent US 10,987,984
Granted Patent B2
US 10,987,984 · App. 16/139,531 · Granted Apr 27, 2021

Automated trailer hitching using image coordinates

Inventor: Kyle P Carpenter (Rochester, MI)
Assignee: Continental Automotive Systems, Inc.
B60D1/36B60D1/62B62D6/001B62D15/0285G05D1/0088G05D1/0221G05D1/0223G06K9/00791G06N3/08G06N20/00G06T7/74G05D2201/0213G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,987,984
App. No.
16/139,531
Granted
Apr 27, 2021
Kind
B2
Abstract

A method of maneuvering a vehicle in reverse for attachment to a trailer, includes receiving a trailer hitch receiver image location shown within one or more images from at least one vehicle camera. The method also includes determining, a pixel angular difference in the image between a tow vehicle fore-aft axis and a trailer fore-aft axis, determining a pixel distance between a tow vehicle hitch ball and a hitch receiver, and determining a vehicle path from an initial position to a final position adjacent the trailer. The vehicle path includes maneuvers configured to move the vehicle along the vehicle path from the initial position to the final position. Then autonomously following, at a drive system in communication with the computing device, the vehicle path from the initial position to the final position.

Claims (38)

1. A method of maneuvering a tow vehicle in reverse for attachment to a trailer, the method comprising:

detecting, by a neural network of the tow vehicle, one or more trailers within one or more images;

detecting, by the neural network, a trailer hitch receiver in the image;

determining, at a computing device in communication with the neural network, a pixel angular difference in the image between a tow vehicle fore-aft axis in the image and a trailer fore-aft axis in the image;

determining, at the computing device, a pixel distance in the image between a first image coordinate of a location of a tow vehicle hitch and a second image coordinate of a location of a hitch receiver;

determining, at the computing device, a vehicle path based on the pixel angular difference and the pixel distance from an initial position to a final position adjacent the trailer, the vehicle path comprising maneuvers configured to move the tow vehicle along the vehicle path from the initial position to the final position; and

autonomously following, at a drive system in communication with the computing device, the vehicle path from the initial position to the final position.

2. The method of claim 1 , further comprising stopping or halting, at the drive system, the tow vehicle at an intermediate position before reaching the final position, the intermediate position being closer to the final position than the initial position;

modifying, at the drive system, one or more vehicle suspensions associated with the tow vehicle to align a vehicle hitch with a trailer hitch;

autonomously following, at the drive system, the vehicle path from the intermediate position to the final position; and

connecting, at the drive system, the vehicle hitch with the trailer hitch.

3. The method of claim 1 , wherein connecting the tow vehicle hitch with the trailer hitch receiver comprises modifying one or more vehicle suspensions associated with the tow vehicle to align a vehicle hitch with a trailer hitch.

4. The method of claim 1 , wherein the maneuvers include, steering, braking, and speeding.

5. The method of claim 1 , further comprising:

continuously detecting, at the neural network, one or more objects within the vehicle path as the tow vehicle is moving along the vehicle path; and

when detecting an object, altering the vehicle path at the computing device.

6. The method of claim 1 , wherein detecting one or more trailers comprises:

capturing, at one or more imaging devices in communication with the neural network, one or more images, at least one of the one or more imaging devices positioned on a back side of the trailer facing a rearward direction; and

determining, at the neural network, the trailer hitch receiver within the one or more images.

7. The method of claim 1 , wherein the final position places the tow vehicle hitch within a distance from a center of a trailer hitch coupler that is less than or equal to a diameter of the trailer hitch coupler.

8. The method of claim 7 , wherein the final position places the tow vehicle hitch within a distance from the center of the trailer hitch coupler that is less than or equal to half the diameter of the trailer hitch coupler.

9. The method of claim 1 , wherein the final position places the tow vehicle hitch within a distance from a center of a trailer hitch coupler is sufficiently close to couple the tow vehicle hitch and the trailer hitch coupler without further maneuvers of the tow vehicle.

10. A method of maneuvering a tow vehicle in reverse for attachment to a trailer positioned behind the tow vehicle, the method comprising:

receiving, at a user interface, a trailer hitch receiver image location of a trailer hitch receiver selected by a driver within one or more images from at least one vehicle camera;

determining, at a computing device in communication with the user interface, a pixel angular difference in the image between a tow vehicle fore-aft axis in the image and a trailer fore-aft axis in the image;

determining, at the computing device, a pixel distance in the image between a first image coordinate of a location of a tow vehicle hitch and a second image coordinate of a location of a trailer hitch receiver;

determining, at the computing device, a vehicle path based on the pixel angular difference and the pixel distance from an initial position to a final position adjacent the trailer, the vehicle path comprising maneuvers configured to move the tow vehicle along the vehicle path from the initial position to the final position; and

autonomously following, at a drive system in communication with the computing device, the vehicle path from the initial position.

11. The method of claim 10 , further comprising:

stopping or halting, at the drive system, the tow vehicle at an intermediate position before reaching the final position, the intermediate position being closer to the final position than the initial position;

modifying, at the drive system, one or more vehicle suspensions associated with the tow vehicle to align a vehicle hitch with a trailer hitch;

autonomously following, at the drive system, the vehicle path from the intermediate position to the final position; and

connecting, at the drive system, the vehicle hitch with the trailer hitch.

12. The method of claim 10 , wherein the maneuvers include, steering, braking, and speeding.

13. The method of claim 10 , wherein connecting the tow vehicle hitch with the trailer hitch receiver comprises modifying one or more vehicle suspensions associated with the tow vehicle to align a vehicle hitch with a trailer hitch.

14. The method of claim 10 , wherein the final position places the tow vehicle hitch within a distance from a center of a trailer hitch coupler that is less than or equal to a diameter of the trailer hitch coupler.

15. The method of claim 14 , wherein the final position places the tow vehicle hitch within a distance from the center of the trailer hitch coupler that is less than or equal to half the diameter of the trailer hitch coupler.

16. The method of claim 10 , wherein the final position places the tow vehicle hitch within a distance from a center of a trailer hitch coupler is sufficiently close to couple the tow vehicle hitch and the trailer hitch coupler without further maneuvers of the tow vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2022
From: CONTINENTAL AUTOMOTIVE SYSTEMS, INC.
To: CONTINENTAL AUTONOMOUS MOBILITY US, LLC.
Reel/Frame 061100/0217 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2021
From: CARPENTER, KYLE P
To: CONTINENTAL AUTOMOTIVE SYSTEMS, INC.
Reel/Frame 055177/0077 →
Continuity (2)
Provisional Application 62562751 · Sep 25, 2017
Related Publication 20190092109A1 · Mar 28, 2019
Cited By (1)
US 12,400,448