IP Library Granted Patent US 11,780,371
Granted Patent B2
US 11,780,371 · App. 17/723,775 · Granted Oct 10, 2023

Auto panning camera mirror system including weighted trailer angle estimation

Inventors: Utkarsh Sharma (Troy, MI); Liang Ma (Rochester, MI); Troy Otis Cooprider (White Lake, MI)
Assignee: Stoneridge, Inc.
B60R1/26B60R1/002G06V10/803G06V20/58H04N23/695B60R2001/1215B60R2001/1253B60R2300/30B60R2300/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,780,371
App. No.
17/723,775
Granted
Oct 10, 2023
Kind
B2
Abstract

A method for automatically panning a view for a commercial vehicle includes determining a plurality of estimated trailer angles. Each estimated trailer angle is determined using a distinct estimation method, and method assigns a confidence value to each estimated trailer angle in the plurality of estimated trailer angles. The method determines a weighted sum of the plurality of estimate trailer angles, and automatically pans the view based at least in part on the weighted sum and a current vehicle operation.

Claims (26)

1. A method for automatically panning a view for a commercial vehicle comprising:

determining a plurality of estimated trailer angles between a central longitudinal axis of a tractor and a central longitudinal axis of a trailer, each estimated trailer angle being determined using a distinct estimation method;

assigning a confidence value to each estimated trailer angle in the plurality of estimated trailer angles;

determining a weighted sum of the plurality of estimate trailer angles; and

automatically panning a view of a camera mirror system on an electronic display based at least in part on the weighted sum and a current vehicle operation.

2. The method of claim 1 , further comprising adding the determined weighted sum to an ordered list of historical weighted sums and low pass filtering the ordered list.

3. The method of claim 2 , wherein automatically panning the view is based on the filtered ordered list.

4. The method of claim 1 , further comprising discarding any estimated trailer angles with a confidence value below a predetermined threshold after assigning the confidence value to each estimate trailer angle and before determining the weighted sum.

5. The method of claim 4 , wherein the predetermined threshold is at least 85%.

6. The method of claim 1 , wherein the weighted sum is determined by multiplying each trailer angle estimate by the corresponding confidence value to determine weighted estimates, summing the weighted estimates, and dividing the summed weighted estimates by a sum of the confidence values.

7. The method of claim 1 , wherein the distinct estimation methods include at least two of an image-based wheel detection, an image-based trailer rear edge angle detection, an image-based trailer marking angle detection, an image based wheel angle detection, a road edge deviation detection, a lane marker deviation detection, and a hitch angle sensor.

8. The method of claim 1 , wherein automatically panning the view comprises adjusting a class II view within a class IV view.

9. The method of claim 8 , wherein automatically panning the view comprises maintaining a rear edge of the trailer within the class II view.

10. The method of claim 1 , further comprising continuously iterating the method, thereby generating real time trailer angle monitoring.

11. The method of claim 1 , wherein determining the plurality of estimated trailer angles, assigning the confidence value to each estimated trailer angle in the plurality of estimated trailer angles, and determining a weighted average of the plurality of estimated trailer angles is performed within a camera mirror system controller of the vehicle.

12. The method of claim 1 , wherein at least one of determining the plurality of estimated trailer angles, assigning the confidence value to each estimated trailer angle in the plurality of estimated trailer angles, and determining a weighted average of the plurality of estimated trailer angles is performed remote from a camera mirror system controller and transmitted to the camera mirror system controller.

13. A camera mirror system for a vehicle comprising;

a first camera having a first field of view;

a controller configured to receive the first field of view and output a subset of the first field of view to a first display;

the controller including a trailer angle detection module configured to determine a plurality of trailer angle estimates for trailer angles between a central longitudinal axis of a tractor and a central longitudinal axis of a trailer, a confidence value module configured to determine a confidence value of each trailer angle estimate, and a fusion module configured to fuse the plurality of trailer angle estimates and the confidence values into a single trailer angle estimate; and

automatically panning at least one view of the camera mirror system based at least in part on the single trailer angle estimate such that a feature of the trailer is maintained within the at least one view.

14. The camera mirror system of claim 13 , wherein the fusion module is configured to determine a weighted sum trailer angle based on the plurality of trailer angle estimates and the corresponding confidence values.

15. The camera mirror system of claim 14 , wherein the fusion module is further configured to add the weighted sum trailer angle to a historical weighted sum trailer angle data set and low pass filter the historical weighted sum trailer angle data set.

16. The camera mirror system of claim 13 wherein each trailer angle estimate in the plurality of trailer angle estimates is determined via a distinct angle estimation method.

17. The camera mirror system of claim 13 , wherein the controller is further configured to add the single trailer estimate to an ordered list of historical trailer angle estimates and low pass filter the ordered list.

18. The camera mirror system of claim 17 , wherein the automatic panning is based at least in part on the low pass filtered ordered list.

Assignments (3)
SECURITY INTEREST Recorded Feb 13, 2024
From: STONERIDGE, INC.; STONERIDGE CONTROL DEVICES, INC.
To: PNC BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 066455/0374 →
SECURITY INTEREST Recorded Nov 2, 2023
From: STONERIDGE, INC.; STONERIDGE ELECTRONICS, INC.; STONERIDGE CONTROL DEVICES, INC.; STONERIDGE FLEET SOLUTIONS, INC.; SRI HOLDINGS US LLC; SRI DELAWARE HOLDINGS LLC
To: PNC BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 065447/0664 →
SECURITY INTEREST Recorded Dec 27, 2022
From: STONERIDGE, INC.; STONERIDGE CONTROL DEVICES, INC.
To: PNC BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 062214/0167 →
Continuity (2)
Provisional Application 63209006 · Jun 10, 2021
Related Publication 20220396209A1 · Dec 15, 2022
Cited By (1)
US 12,466,323