Granted Patent B2

US 12,214,725 · App. 17/753,485 · Granted Feb 4, 2025

Inventor: Aranza Hinojosa Castro (Libert Hill, TX)

Assignee: Continental Autonomous Mobility US, LLC

B60R1/003B60R1/26H04N5/265H04N7/183H04N23/698B60R2300/105B60R2300/303B60R2300/304B60R2300/60B60R2300/802

Abstract

Claims (53)

1. A method of determining a panoramic view of an environment behind a trailer of a vehicle-trailer system, the method comprising:

receiving, at data processing hardware, a first image from a rear trailer camera positioned on a rear portion of the trailer;

receiving, at the data processing hardware, a second image from a right-side trailer camera positioned on a right-side portion of the trailer;

receiving, at the data processing hardware, a third image from a left-side trailer camera positioned on a left-side portion of the trailer;

determining, at the data processing hardware, a panoramic view based on the first image, the second image, and the third image;

determining, at the data processing hardware, a trailer angle based on sensor system data received from a sensor system;

determining, at the data processing hardware, a viewing area within the panoramic view based on the trailer angle;

sending, from the data processing hardware to a display in communication with the data processing hardware, instructions to display the viewing area;

receiving a fourth image from a rear vehicle camera positioned on a rear portion of a vehicle of the vehicle-trailer system, the fourth image including a trailer representation of the trailer; and

forming a fifth image by projecting at least the viewing area of the panoramic view only within a boundary of the trailer representation of the fourth image such that no part of the viewing area is projected outside of the boundary of the trailer representation;

wherein the instructions to display the viewing area of the panoramic view comprises instructions for displaying the fifth image.

2. The method of claim 1 , wherein determining the panoramic view based on the first image, the second image, and the third image comprises:

stitching the first image, the second image, and the third image.

3. The method of claim 1 , wherein the rear trailer camera, the right-side trailer camera, the left-side trailer camera each includes a fisheye lens.

4. The method of claim 1 , further comprising receiving, at the data processing hardware, a driver input via a user interface; and adjusting the viewing area of the panoramic view displayed on the display based on the driver input so as to include in the viewing area an increased amount of the second image and a decreased amount of at least one of the first image and the third image.

5. The method of claim 1 , further comprising receiving, at the data processing hardware, a driver input via a user interface indicative of a driver request to view the panoramic view; and adjusting, at the data processing hardware, the viewing area to include the panoramic view based on the driver input so as to include in the viewing area an increased amount of the third image and a decreased amount of at least one of the first image and the second image.

6. A system for providing a panoramic view of an environment behind a trailer of a vehicle-trailer system, the system comprising:

a display;

data processing hardware in communication with the display;

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving a first image from a rear trailer camera positioned on a rear portion of the trailer;

receiving a second image from a right-side trailer camera positioned on a right-side portion of the trailer;

receiving a third image from a left-side trailer camera positioned on a left-side portion of the trailer;

determining a panoramic view based on the first image, the second image, and the third image;

determining a trailer angle based on sensor system data received from a sensor system;

determining a viewing area within the panoramic view based on the trailer angle;

sending instructions to the display to display the viewing area;

receiving a fourth image from a rear vehicle camera positioned on a rear portion of a vehicle of the vehicle-trailer system, the fourth image including a trailer representation of the trailer; and

generating a fifth image by projecting at least the viewing area of the panoramic view only within a boundary of the trailer representation of the fourth image such that no part of the viewing area is projected outside of the boundary of the trailer representation,

wherein the instructions to display the viewing area of the panoramic view include instructions for displaying the fifth image.

7. The system of claim 6 , wherein determining the panoramic view based on the first image, the second image, and the third image comprises:

stitching the first image, the second image, and the third image.

8. The system of claim 6 , wherein the rear trailer camera, the right-side trailer camera, the left-side trailer camera each includes a fisheye lens.

9. The system of claim 6 , wherein the operations further comprise receiving a driver input via a user interface; and adjusting the viewing area of the panoramic view displayed on the display based on the driver input so as to include in the viewing area an increased amount of the second image and a decreased amount of at least one of the first image and the third image.

10. The system of claim 6 , wherein the operations further comprise receiving a driver input via a user interface indicative of a driver request to view the panoramic view; and adjusting the viewing area to include the panoramic view based on the driver input so as to include in the viewing area an increased amount of the third image and a decreased amount of at least one of the first image and the second image.

11. A computer program product comprising a non-transitory computer-readable medium having program code instructions which, when executed by data processing hardware, cause the data processing hardware to perform operations comprising:

receiving a first image from a rear trailer camera positioned on a rear portion of the trailer;

receiving a second image from a right-side trailer camera positioned on a right-side portion of the trailer;

receiving a third image from a left-side trailer camera positioned on a left-side portion of the trailer;

determining a panoramic view based on the first image, the second image, and the third image;

determining a trailer angle based on sensor system data received from a sensor system;

determining a viewing area within the panoramic view based on the trailer angle;

sending instructions to the display to display the viewing area;

receiving a fourth image from a rear vehicle camera positioned on a rear portion of a vehicle of the vehicle-trailer system, the fourth image including a trailer representation of the trailer; and

generating a fifth image by projecting at least the viewing area of the panoramic view only within a boundary of the trailer representation of the fourth image;

wherein the instructions to display the viewing area of the panoramic view include instructions for displaying the fifth image.

12. The computer program product of claim 11 , wherein the operations further comprise:

receiving a driver input via a user interface; and

adjusting the viewing area of the panoramic view displayed on the display based on the driver input so as to include in the viewing area an increased amount of the second image and a decreased amount of at least one of the first image and the third image.

13. The computer program product of claim 11 , wherein the operations further comprise:

receiving, at the data processing hardware, a driver input via a user interface indicative of a driver request to view the panoramic view; and

adjusting, at the data processing hardware, the viewing area to include the panoramic view based on the driver input so as to include in the viewing area an increased amount of the third image and a decreased amount of at least one of the first image and the second image.

14. The computer program product of claim 11 , wherein in generating the fifth image, no part of the panoramic view is projected outside of the trailer representation.

Assignments (3)

Continuity (2)

References Cited (18)