IP Library Granted Patent US 11,148,667
Granted Patent B2
US 11,148,667 · App. 16/530,933 · Granted Oct 19, 2021

Automated reversing by choice of target location

Inventors: Matthew Donald Berkemeier (Beverly Hills, MI); Xin Yu (Wuhu -Jiujiang, CN); Danny Bynum (Lake Orion, MI); Julien Ip (Madison Heights, MI); Kyle P Carpenter (Rochester, MI); Eduardo Llanos (Auburn Hills, MI); Dhiren Verma (Farmington Hills, MI)
Assignee: Continental Automotive Systems, Inc.
B60W30/18036G05D1/0231B60D1/36B60W2420/42B60W2540/18B60W2540/215B60W2554/801G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,148,667
App. No.
16/530,933
Granted
Oct 19, 2021
Kind
B2
Abstract

A method of autonomously maneuvering a tow vehicle towards a trailer positioned behind the tow vehicle is provided. The method includes receiving one or more images from a camera positioned on a back portion of the tow vehicle. The method also includes receiving, at the data processing hardware, a first user selection of a trailer representation within the one or more images. The method includes sending first instructions to a drive system causing the tow vehicle to autonomously maneuver towards the trailer associated with the first user selection of the trailer representation. The method also includes receiving a second user selection of a coupler representation within the one or more images. The coupler representation associated with a trailer coupler of the trailer. The method also includes sending second instructions to the drive system causing the tow vehicle to autonomously maneuver towards the trailer coupler associated with the second user selection.

Claims (48)

1. A method of autonomously maneuvering a tow vehicle towards a trailer positioned behind the tow vehicle, the method comprising:

receiving, at data processing hardware, one or more images from a camera positioned on a back portion of the tow vehicle and in communication with the data processing hardware;

receiving, at the data processing hardware, a first user selection of a trailer representation within the one or more images;

sending, from the data processing hardware to a drive system in communication with the data processing hardware, first instructions causing the tow vehicle to autonomously maneuver in a rearward direction towards the trailer associated with the first user selection of the trailer representation;

receiving, at the data processing hardware, a second user selection of a coupler representation within the one or more images, the coupler representation associated with a trailer coupler of the trailer; and

sending, from the data processing hardware to the drive system, second instructions causing the tow vehicle to autonomously maneuver in the rearward direction towards the trailer coupler associated with the second user selection of the coupler representation,

wherein the second user selection includes a coupler bounding box surrounding the coupler representation, and receiving the second user selection of the coupler representation comprises receiving, from a display screen of the tow vehicle, the bounding box that is received at the display screen as input from a vehicle occupant.

2. The method of claim 1 , wherein the first user selection includes a trailer bounding box surrounding the trailer representation.

3. The method of claim 1 , further comprising:

tracking the first user selection within the one or more images as the tow vehicle autonomously maneuvers in the rearward direction towards the trailer associated with the first user selection of the trailer representation; and

tracking the second user selection within the one or more images as the tow vehicle autonomously maneuvers in the rearward direction towards the trailer coupler associated with the second user selection of the coupler representation.

4. The method of claim 3 , further comprising:

receiving wheel tick sensor data and steering wheel angle data from a sensor system in communication with the data processing hardware; and

determining a vehicle position based on the wheel tick sensor data and the steering wheel angle data; and

adjusting the first and/or second instructions based on the tow vehicle position relative to the trailer and the trailer coupler respectively.

5. The method of claim 1 , further comprising:

determining a tow ball position of a tow ball of the tow vehicle;

during autonomous maneuver of the tow vehicle in the rearward direction, determining a longitudinal distance and a lateral distance between the tow ball position and a center of a trailer bounding box or the coupler bounding box, where the center is a center of a bottom of the trailer bounding box or the coupler bounding box.

6. The method of claim 5 , wherein the first and second instructions cause the longitudinal distance and the lateral distance to be decreased.

7. The method of claim 1 , further comprising:

prior to receiving the second user selection of the coupler representation, sending, by the data processing hardware to the display screen of the tow vehicle, instructions to display the one or more images;

receiving, by the data processing hardware, user instructions to change a magnification level of the one or more images displayed by the display screen; and

sending, by the data processing hardware, instructions to display one or more modified versions of the one or more images on the display screen based upon the user instructions to change a magnification level of the one or more images.

8. A system for autonomously maneuvering a tow vehicle towards a trailer positioned behind the tow vehicle, the system comprising:

data processing hardware in communication; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving one or more images from a camera positioned on a back portion of the tow vehicle and in communication with the data processing hardware;

receiving a first user selection of a trailer representation within the one or more images;

sending first instructions to a drive system causing the tow vehicle to autonomously maneuver in a rearward direction towards the trailer associated with the first user selection of the trailer representation;

receiving a second user selection of a coupler representation within the one or more images, the coupler representation associated with a trailer coupler of the trailer; and

sending second instructions to the drive system causing the tow vehicle to autonomously maneuver in the rearward direction towards the trailer coupler associated with the second user selection of the coupler representation;

determining a tow ball position of a tow ball of the tow vehicle; and

during autonomous maneuver of the tow vehicle in the rearward direction, determining a longitudinal distance and a lateral distance between the tow ball position and a center of a trailer bounding box or a coupler bounding box, where the center is a center of a bottom of the trailer bounding box or the coupler bounding box.

9. The system of claim 8 , wherein the first user selection includes a trailer bounding box surrounding the trailer representation.

10. The system of claim 8 , wherein the second user selection includes a coupler bounding box surrounding the coupler representation.

11. The system of claim 8 , wherein the operations further include:

tracking the first user selection within the one or more images as the tow vehicle autonomously maneuvers in the rearward direction towards the trailer associated with the first user selection of the trailer representation; and

tracking the second user selection within the one or more images as the tow vehicle autonomously maneuvers in the rearward direction towards the trailer coupler associated with the second user selection of the coupler representation.

12. The system of claim 11 , wherein the operations further include:

receiving wheel tick sensor data and steering wheel angle data from a sensor system in communication with the data processing hardware; and

determining a vehicle position based on the wheel tick sensor data and the steering wheel angle data; and

adjusting the first and/or second instructions based on the tow vehicle position relative to the trailer and the trailer coupler respectively.

13. The system of claim 8 , wherein the first and second instructions cause the longitudinal distance and the lateral distance to be decreased.

14. The system of claim 8 , wherein the operations further include:

prior to receiving the second user selection of the coupler representation, sending, by the data processing hardware to a display screen of the tow vehicle, instructions to display the one or more images;

receiving, by the data processing hardware, user instructions to change a magnification level of the one or more images displayed by the display screen; and

sending, by the data processing hardware, instructions to display one or more modified versions of the one or more images on the display screen based upon the user instructions to change a magnification level of the one or more images.

15. The system of claim 8 , wherein the second user selection includes the coupler bounding box surrounding the coupler representation, and receiving the second user selection of the coupler representation comprises receiving, from a display screen of the tow vehicle, the bounding box that is received at the display screen as input from a vehicle occupant.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2022
From: CONTINENTAL AUTOMOTIVE SYSTEMS, INC.
To: CONTINENTAL AUTONOMOUS MOBILITY US, LLC.
Reel/Frame 061100/0217 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: BERKEMEIER, MATTHEW DONALD; YU, XIN; BYNUM, DANNY; IP, JULIEN; CARPENTER, KYLE P; LLANOS, EDUARDO; VERMA, DHIREN
To: CONTINENTAL AUTOMOTIVE SYSTEMS, INC.
Reel/Frame 050256/0737 →
Continuity (2)
Provisional Application 62714419 · Aug 3, 2018
Related Publication 20200039517A1 · Feb 6, 2020
Cited By (1)
US 12,528,321