IP Library › Granted Patent US 11,279,282
Granted Patent B2
US 11,279,282 · App. 16/500,739 · Granted Mar 22, 2022

Methods and systems for aligning a vehicle with a trailer

Inventor: James Stephen Miller (Dexter, MI)
Assignee: Robert Bosch GmbH
B60R1/00B60Q9/008B60W30/18036B60W50/14G06T7/579G06T7/75G06T11/00B60D1/36B60R2300/308B60R2300/808B60W2050/146B60W2420/42G06T2207/10028G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,279,282
App. No.
16/500,739
Granted
Mar 22, 2022
Kind
B2
Abstract

Methods and systems for aligning a vehicle with a trailer. One system includes an image sensor configured to collect a plurality of images. The system also includes an electronic processor configured to receive the plurality of images from the image sensor. The electronic processor is also configured to determine a three-dimensional model of an area surrounding the vehicle using the plurality of images. The electronic processor is also configured to control the vehicle to automatically perform a vehicle maneuver to align the vehicle with the trailer based on the three-dimensional model of the area surrounding the vehicle. The electronic processor is also configured to determine when the vehicle is aligned with the trailer and stop the vehicle from automatically performing the vehicle maneuver when the vehicle is aligned with the trailer.

Claims (41)

1. A system for aligning a vehicle with a trailer, the system comprising:

an image sensor configured to collect a plurality of images; and

an electronic processor configured to

receive the plurality of images from the image sensor,

determine a three-dimensional model of an area surrounding the vehicle using the plurality of images by analyzing the plurality of images using a structure from motion technique, each of the plurality of images being taken from different locations,

control the vehicle to automatically perform a vehicle maneuver to align the vehicle with the trailer based on the three-dimensional model of the area surrounding the vehicle,

determine when the vehicle is aligned with the trailer, and

stop the vehicle from automatically performing the vehicle maneuver when the vehicle is aligned with the trailer.

2. The system of claim 1 , wherein the electronic processor is further configured to determine whether the vehicle is within a starting region with respect to the trailer.

3. The system of claim 2 , wherein the electronic processor is further configured to generate a visual representation of the starting region for display to a user of the vehicle via a human machine interface, wherein the visual representation is a highlighted area overlaid on the plurality of images.

4. The system of claim 3 , wherein the electronic processor is configured to modify the visual representation to indicate whether the vehicle is within the starting region.

5. The system of claim 2 , wherein, when the vehicle is not within the starting region with respect to the trailer, the electronic processor is configured to generate instructions for display to a user of the vehicle via a human machine interface for positioning the vehicle within the starting region.

6. The system of claim 1 , wherein the electronic processor is configured to control the vehicle by controlling at least one selected from a group consisting of steering, acceleration, and braking of the vehicle to align the vehicle with the trailer.

7. The system of claim 1 , wherein the three-dimensional model of the area surrounding the vehicle is a three-dimensional point cloud.

8. The system of claim 1 , wherein the electronic processor is further configured to identify one or more objects within the plurality of images based on the three-dimensional model and vehicle odometry information.

9. The system of claim 1 , wherein the electronic processor is further configured to continuously update the three-dimensional model while the vehicle is controlled to automatically perform the vehicle maneuver.

10. A method for aligning a vehicle with a trailer, the method comprising:

receiving, with an electronic processor, a plurality of images from an image sensor;

determining, with the electronic processor, whether the vehicle is within a starting region with respect to the trailer;

determining, with the electronic processor, a three-dimensional model of an area surrounding the vehicle using the plurality of images by analyzing the plurality of images using a structure from motion technique, each of the plurality of images being taken from different locations;

controlling, with the electronic processor, the vehicle to automatically perform a vehicle maneuver based on the three-dimensional model of the area surrounding the vehicle;

determining, with the electronic processor, when the vehicle is aligned with the trailer; and

stopping, with the electronic processor, the vehicle from automatically performing the vehicle maneuver when the vehicle is aligned with the trailer.

11. The method of claim 10 , further comprising:

receiving, from a human machine interface, a user input initiating the alignment of the vehicle with the trailer; and

providing, to the human machine interface, an indication that an alignment of the vehicle with the trailer is initiated.

12. The method of claim 10 , further comprising:

continuously updating the three-dimensional model while the vehicle is controlled to automatically perform the vehicle maneuver.

13. The method of claim 12 , further comprising:

detecting when a new object is present in the plurality of images based on the continuously updated three-dimensional model.

14. The method of claim 13 , further comprising:

generating a new object warning for a user of the vehicle when the new object is identified in the plurality of images.

15. The method of claim 13 , further comprising:

automatically stopping the vehicle from automatically performing the vehicle maneuver when the new object is identified in the plurality of images.

16. The method of claim 10 , further comprising:

receiving a manual alignment input from a user of the vehicle, wherein the manual alignment input includes at least one input selected from a group consisting of a manual steering input, a manual acceleration input, and a manual braking input.

17. The method of claim 16 , wherein controlling the vehicle to automatically perform the vehicle maneuver includes controlling the vehicle to automatically perform the vehicle maneuver based on the three-dimensional model and the manual alignment input.

18. The method of claim 10 , further comprising:

determining a height of a trailer coupler of the trailer and a height of a hitch of the vehicle;

determining whether the hitch will collide with the trailer coupler based on the height of the trailer coupler and the height of the hitch; and

generating a collision warning for a user of the vehicle when the hitch will collide with the trailer coupler.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2019
From: MILLER, JAMES STEPHEN
To: ROBERT BOSCH GMBH
Reel/Frame 050621/0437 →
Continuity (2)
Provisional Application 62487387 · Apr 19, 2017
Related Publication 20200101897A1 · Apr 2, 2020