Granted Patent B2

US 12,561,835 · App. 17/907,691 · Granted Feb 24, 2026

Inventors: Robin Plowman (Southwick, GB); Alexander Kadyrov (Eastbourne, GB)

G06T7/74G06T7/60G06T2207/30252

Abstract

Claims (45)

1 . A method for determining the yaw angle of a trailer with respect to a longitudinal axis of a towing vehicle comprising a towball, the method comprising:

operating a trailer assist system with the trailer and the towing vehicle,

aligning a camera along the longitudinal axis, and arranging the camera so as to point backwards towards the trailer so as to include at least some of the trailer in a field of view of the camera;

by the camera, obtaining multiple images that include at least some portion of the trailer,

capturing the images including at least a first and a second image of the trailer using a camera of the towing vehicle, an orientation of the trailer with respect to the vehicle being different on the at least two images;

determining at least a first feature of the trailer which is visible on the first and second images;

calculating a first angle estimation, the first angle estimation characterizing a pivot angle in a horizontal plane between the first feature on the first image and the first feature on the second image with respect to a position of the camera of the towing vehicle;

providing one or more angle coefficients, the one or more angle coefficients providing scaling information for the first angle estimation;

calculating the yaw angle based on the first angle estimation and based on the one or more angle coefficients by scaling the first angle estimation by the one or more angle coefficients; and

using the calculated yaw angle by the trailer assist system in a trailer assist operation of the towing vehicle;

wherein the one or more angle coefficients are established by a distance between the camera and a towball of the towing vehicle divided by a distance between the camera and one or more features, including the first feature, of the trailer.

2 . The method according to claim 1 , wherein the one or more angle coefficients is a single coefficient being tailored for the towing vehicle.

3 . The method according to claim 2 , wherein the single coefficient is applied to the first angle estimation or to a median value or average value established based on at least two angle estimations including the first angle estimation.

4 . The method according to claim 1 , wherein the one or more angle coefficients is dynamically adapted for the trailer.

5 . The method according to claim 4 , wherein the dynamic adaption of the one or more angle coefficients is performed by using a reference algorithm for determining the yaw angle and adapting the one or more angle coefficients by comparing at least one angle estimation, including the first angle estimate, with yaw angle reference information provided by the reference algorithm.

6 . The method according to claim 5 , wherein the reference algorithm is configured forte:

projecting a ray between the camera and the first feature on the first image onto a horizontal plane thereby obtaining a first projected feature position and projecting a ray between the camera and the first feature on the second image onto the horizontal plane thereby obtaining a second projected feature position;

establishing a first perpendicular bisector between a location of the first projected feature position and a location of the second projected feature position;

determining a first intersection point of the first perpendicular bisector with a reference axis or a further perpendicular bisector; and

providing yaw angle reference information based on a first reference angle estimation, the first reference angle estimation referring to an angle between a first line running from the first projected feature position to the first intersection point and a second line running from the second projected feature position to the first intersection point in the horizontal plane.

7 . The method according to claim 5 , wherein multiple yaw angle reference information referring to different yaw angles are developed based on the reference algorithm and the one or more angle coefficients is determined by developing an average value of the multiple yaw angle reference information.

8 . The method according to claim 1 , wherein, the one or more features comprises a plurality of features, for each feature, an angle coefficient is provided or established that is different from the angle coefficient that is provided or established for other of the plurality of features.

9 . The method according to claim 8 , wherein each angle coefficient is established by considering a relationship of a distance between the camera and the towball and a distance between the camera and a feature of the trailer which corresponds to the angle coefficient.

10 . The method according to claim 1 , wherein calculating the first angle estimation comprises determining optical rays between a position of the camera and the at least one feature at the first and second images.

11 . The method according to claim 10 , wherein camera calibration information is used for converting the position of the at least one feature from a local domain of the image into a local domain of the towing vehicle in order to determine the optical rays.

12 . The method according to claim 1 , wherein in addition to the first feature, one or more further features of the trailer are used for calculating the yaw angle.

13 . A system for determining the yaw angle of a trailer with respect to a longitudinal axis of a towing vehicle, the system comprising a camera for capturing images of the trailer, the system further being configured to execute a method comprising:

operating a trailer assist system with the trailer and the towing vehicle,

aligning a camera along the longitudinal axis, and arranging the camera so as to point backwards towards the trailer so as to include at least some of the trailer in a field of view of the camera;

by the camera, obtaining multiple images that include at least some portion of the trailer,

capturing the images including at least a first and a second image of the trailer using a camera, an orientation of the trailer with respect to the towing vehicle being different on the at least two images;

determining at least a first feature of the trailer which is visible on the first and second images;

calculating a first angle estimation, the first angle estimation characterizing a pivot angle in a horizontal plane between the first feature on the first image and the first feature on the second image with respect to a position of the camera of the towing vehicle;

providing one or more angle coefficients, the one or more angle coefficients providing scaling information for the first angle estimation;

calculating the yaw angle based on the first angle estimation and based on the one or more angle coefficients;

using the calculated yaw angle by the trailer assist system in a trailer assist operation of the towing vehicle;

wherein the one or more angle coefficients are established by a distance between the camera and a towball of the towing vehicle divided by a distance between the camera and one or more features, including the first feature, of the trailer.

14 . The system according to claim 13 , wherein the one or more angle coefficients is dynamically adapted for the trailer.

15 . The system according to claim 14 , wherein the dynamic adaption of the one or more angle coefficients is performed by using a reference process for determining the yaw angle and adapting the one or more angle coefficients by comparing at least one angle estimation, including the first angle estimate, with yaw angle reference information provided by the reference process.

16 . The system according to claim 15 , wherein the reference process comprises:

projecting a ray between the camera and the first feature on the first image onto a horizontal plane thereby obtaining a first projected feature position and projecting a ray between the camera and the first feature on the second image onto the horizontal plane thereby obtaining a second projected feature position;

establishing a first perpendicular bisector between a location of the first projected feature position and a location of the second projected feature position;

determining a first intersection point of the first perpendicular bisector with a reference axis or a further perpendicular bisector; and

providing yaw angle reference information based on a first reference angle estimation, the first reference angle estimation referring to an angle between a first line running from the first projected feature position to the first intersection point and a second line running from the second projected feature position to the first intersection point in the horizontal plane.

17 . The system according to claim 15 , wherein multiple yaw angle reference information referring to different yaw angles are developed based on the reference process and the one or more angle coefficients is determined by developing an average value of the multiple yaw angle reference information.

Priority Claims (1)

Continuity (1)

References Cited (94)