IP Library Granted Patent US 11,050,933
Granted Patent B2
US 11,050,933 · App. 16/395,190 · Granted Jun 29, 2021

Device and method for determining a center of a trailer tow coupler

Inventors: Joyce Chen (West Bloomfield, MI); Xin Yu (Troy, MI); Julien Ip (Madison Heights, MI)
Assignee: Continenal Automotive Systems, Inc.
H04N5/23238G06K9/00791G06K9/4609G06K9/6256G06T7/74G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,050,933
App. No.
16/395,190
Granted
Jun 29, 2021
Kind
B2
Abstract

A method for determining a location of a target positioned behind a tow vehicle is provided. The method includes receiving images from a camera positioned on a back portion of the tow vehicle. The images include the target. The method includes applying one or more filter banks to the images. The method also includes determining a region of interest within each image based on the applied filter banks. The region of interest includes the target. The method also includes identifying the target within the region of interest and determining a target location of the target including a location in a real-world coordinate system. The method also includes transmitting instructions to a drive system supported by the vehicle. The instructions cause the tow vehicle to autonomously maneuver towards the location in the real-world coordinate system.

Claims (48)

1. A method for determining a location of a target positioned behind a tow vehicle, the method comprising:

receiving, at data processing hardware, images from a camera positioned on a back portion of the tow vehicle and in communication with the data processing hardware, the images including the target;

adjusting, by the data processing hardware, the received images such that an appearance of the target within the image matches an orientation of a training target within a training region of interest;

applying, by the data processing hardware, one or more filter banks to the adjusted images, the one or more filter banks including characteristics of the target that are learned during a learning phase by analyzing one or more training images, each training image including at least one training region of interest;

determining, by the data processing hardware, a region of interest within each image based on the applied filter banks, the region of interest including the target;

identifying, by the data processing hardware, the target within the region of interest;

determining, by the data processing hardware, a target location of the target identified within the region of interest, the target location including a location of the target in a real-world coordinate system; and

transmitting, from the data processing hardware, instructions to a drive system supported by the vehicle and in communication with the data processing hardware, the instructions causing the tow vehicle to autonomously maneuver towards the location of the target in the real-world coordinate system.

2. The method of claim 1 , further comprising:

tracking, by the data processing hardware, the target while the tow vehicle autonomously maneuvers towards the identified target;

determining, by the data processing hardware, an updated target location; and

transmitting, from the data processing hardware, updated instructions to the drive system, the updated instructions causing the tow vehicle to autonomously maneuver towards the updated target location.

3. The method of claim 1 , wherein the camera includes a fisheye camera capturing fisheye images.

4. The method of claim 3 , further comprising rectifying, by the data processing hardware, the fisheye images before applying the one or more filter banks.

5. The method of claim 1 , further comprising:

receiving, at the data processing hardware, training images stored in hardware memory in communication with the data processing hardware;

determining, by the data processing hardware, a training region of interest within each received image, the training region of interest including a target; and

determining, by the data processing hardware, the one or more filter banks within each training region of interest.

6. The method of claim 5 , further comprising: identifying, by the data processing hardware, a center of the target, wherein the target location includes a location of the center of the target.

7. The method of claim 1 , wherein the target is a coupler of a tow-bar-coupler supported by a trailer.

8. The method of claim 7 , wherein the images are a top-down view of the tow-bar-coupler.

9. The method of claim 1 , wherein the target is a trailer positioned behind the tow vehicle and the target location is a location of a trailer bottom center at a tow-bar.

10. The method of claim 9 , wherein the images are a perspective view of the trailer.

11. A system for determining a location of a target positioned behind a tow vehicle, the system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving images from a camera positioned on a back portion of the tow vehicle and in communication with the data processing hardware, the images including the target;

adjusting the received images such that an appearance of the target within the image matches an orientation of a training target within a training region of interest;

applying one or more filter banks to the adjusted images, the one or more filter banks include characteristics of the target that are learned during a learning phase by analyzing one or more training images, each training image including at least one training region of interest;

determining a region of interest within each image based on the applied filter banks, the region of interest including the target;

identifying the target within the region of interest;

determining a target location of the target identified within the region of interest, the target location including a location in a real-world coordinate system; and

transmitting instructions to a drive system supported by the vehicle and in communication with the data processing hardware, the instructions causing the tow vehicle to autonomously maneuver towards the location of the target in the real-world coordinate system.

12. The system of claim 11 , wherein the operations further comprise:

tracking the target while the tow vehicle autonomously maneuvers towards the identified target;

determining an updated target location; and

transmitting updated instructions to the drive system, the updated instructions causing the tow vehicle to autonomously maneuver towards the updated target location.

13. The system of claim 11 , wherein the camera includes a fisheye camera capturing fisheye images.

14. The system of claim 13 , wherein the operations further comprise rectifying the fisheye images before applying the one or more filter banks.

15. The system of claim 11 , wherein the operations further comprise:

receiving training images stored in hardware memory in communication with the data processing hardware;

determining a training region of interest within each received image, the training region of interest including a target; and

determining the one or more filter banks within each training region of interest.

16. The system of claim 15 , wherein the operations further comprise identifying a center of the target, wherein the target location includes a location of the center of the target.

17. The system of claim 11 , wherein the target is a coupler of a tow-bar-coupler supported by a trailer.

18. The system of claim 17 , wherein the images are a top-down view of the tow-bar-coupler.

19. The system of claim 11 , wherein the target is a trailer positioned behind the tow vehicle and the target location is a location of a trailer bottom center at a tow-bar.

20. The system of claim 19 , wherein the images are a perspective view of the trailer.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2022
From: CONTINENTAL AUTOMOTIVE SYSTEMS, INC.
To: CONTINENTAL AUTONOMOUS MOBILITY US, LLC.
Reel/Frame 061100/0217 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2021
From: CHEN, JOYCE; YU, XIN; IP, JULIEN
To: CONTINENTAL AUTOMOTIVE SYSTEMS, INC.
Reel/Frame 056696/0772 →
Continuity (2)
Provisional Application 62663354 · Apr 27, 2018
Related Publication 20190335100A1 · Oct 31, 2019
Cited By (2)
US 12,361,589 US 12,400,448