IP Library Granted Patent US 11,443,413
Granted Patent B2
US 11,443,413 · App. 17/116,476 · Granted Sep 13, 2022

Vehicle camera system for outside view and trailer aid

Inventors: Masashi Nakagawa (Sunnyvale, CA); Katsumi Nagata (Foster City, CA)
Assignee: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
G06T5/50B60R1/002B60R11/04G06T2207/20221G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,413
App. No.
17/116,476
Granted
Sep 13, 2022
Kind
B2
Abstract

Methods and systems for detecting a surrounding environment around a vehicle and a trailer coupled to the vehicle. The system includes a plurality of cameras attached to and configured to detect image data. The system also includes an electronic control unit (ECU) of the vehicle communicatively coupled to the plurality of cameras and configured to combine the image data from the plurality of cameras.

Claims (47)

1. A system for detecting a surrounding environment around a vehicle and a trailer coupled to the vehicle, the system comprising:

a plurality of cameras integrated on an exterior surface of the vehicle and configured to detect image data;

a remote device in data communication with the plurality of cameras and configured to identify at least one blind spot of the surrounding environment around the vehicle and the trailer in the image data; and

an electronic control unit (ECU) communicatively coupled to the plurality of cameras and the remote device and configured to:

detect, based on the identified at least one blind spot, at least one add-on camera attached to the exterior surface of the vehicle or an exterior surface of the trailer and configured to detect additional image data related to the identified at least one blind spot, and

combine the image data from at least some of the plurality of cameras and the additional image data from the at least one add-on camera and generate combined image data corresponding to a complete view of the surrounding environment around the vehicle and the trailer.

2. The system of claim 1 , wherein the at least one add-on camera include at least one of a front vehicle camera, a left side vehicle camera, a right side vehicle camera, a rear trailer camera, a left side trailer camera, a right side trailer camera, a rear vehicle camera, or a front trailer camera.

3. The system of claim 1 , wherein at least one of (i) the plurality of cameras or (ii) the at least one add-on camera are configured to communicate with the ECU wirelessly.

4. The system of claim 1 , wherein the at least one add-on camera include a plurality of vehicle cameras and a plurality of trailer cameras, wherein the plurality of trailer cameras are configured to communicate with the ECU directly or via a transceiver on or within the trailer.

5. The system of claim 1 , further comprising trailer brakes configured to slow one or more wheels of the trailer,

wherein the ECU is further configured to detect a collision based on at least one of the image data from the plurality of cameras or the additional image data from the at least one add-on camera and communicate an instruction to the trailer to engage the trailer brakes.

6. The system of claim 1 , wherein the ECU is further configured to render, on a graphical user interface, a top-down view of the vehicle and the trailer based on at least one of the image data from the plurality of cameras or the additional image data from the at least one add-on camera.

7. The system of claim 1 , further comprising a mobile device communicatively coupled to at least one of (i) the plurality of cameras or (ii) the at least one add-on camera and configured to combine at least one of the image data from the plurality of cameras or the additional image data from the at least one add-on camera.

8. The system of claim 7 , wherein the mobile device is further configured to determine an orientation or placement of the at least one add-on camera and provide instructions related to the determined orientation or placement of the at least one add-on camera to a user for adjusting one or more of the at least one add-on camera to improve coverage of the surrounding environment around the vehicle and the trailer.

9. The system of claim 7 , wherein the mobile device is further configured to identify a location of the at least one add-on camera on the exterior surface of the vehicle or the exterior surface of the trailer based on a user input identifying the location of the at least one add-on camera on the exterior surface of the vehicle or the exterior surface of the trailer.

10. The system of claim 7 , wherein the mobile device is further configured to identify a location of the at least one add-on camera on the exterior surface of the vehicle or the exterior surface of the trailer based on automatic detection of the at least one add-on camera based on image data of the vehicle and the trailer detected by a camera of the mobile device.

11. The system of claim 7 , wherein the mobile device or the ECU is further configured to automatically adjust one or more cameras of the at least one add-on camera to improve a field of view coverage by the one or more cameras.

12. A vehicle coupled to a trailer, the vehicle comprising:

a plurality of vehicle cameras integrated on an exterior surface of the vehicle and configured to detect image data;

a transceiver configured to:

receive, from a remote device in data communication with the plurality of vehicle cameras and configured to identify at least one blind spot of a surrounding environment around the vehicle and the trailer in the detected image data, data corresponding to the at least one blind spot, and

receive the image data from the plurality of vehicle cameras and additional image data from at least one of (i) a plurality of add-on vehicle cameras or (ii) a plurality of add-on trailer cameras; and

an electronic control unit (ECU) coupled to the transceiver and configured to:

detect, based on the at least one blind spot, at least one add-on camera of the plurality of add-on vehicle cameras or the plurality of add-on trailer cameras, the at least one add-on camera being configured to detect at least one portion of the additional image data related to the at least one blind spot, and

combine the image data from at least one of the plurality of vehicle cameras and the at least one portion of the additional image data from the at least one add-on camera and generate combined image data corresponding to a complete view of the surrounding environment around the vehicle and the trailer.

13. The vehicle of claim 12 , wherein the ECU is further configured to:

detect a collision based on at least one of the image data from the at least one of the plurality of vehicle cameras and the at least one portion of the additional image data from the at least one add-on camera, and

communicate an instruction to the trailer to engage trailer brakes.

14. The vehicle of claim 12 , wherein the ECU is further configured to render, on a graphical user interface, a top-down view of the vehicle and the trailer based on at least one of the image data from the at least one of the plurality of vehicle cameras and the at least one portion of the additional image data from the at least one add-on camera.

15. A method for detecting a surrounding environment around a vehicle and a trailer coupled to the vehicle, the method comprising:

detecting, by an electronic control unit (ECU) and using a plurality of cameras integrated on an exterior surface of the vehicle, image data;

receiving, by a transceiver and from a remote device in data communication with the plurality of cameras and configured to identify at least one blind spot of the surrounding environment around the vehicle and the trailer in the image data, data corresponding to the at least one blind spot;

detecting, by the ECU and based on the at least one blind spot, at least one add-on camera attached to the exterior surface of the vehicle or an exterior surface of the trailer and configured to detect additional image data related to the at least one blind spot;

receiving, by the transceiver, the image data from at least some of the plurality of cameras and the additional image data from the at least one add-on camera; and

combining, by the ECU, the image data and the additional image data and generating, by the ECU, combined image data corresponding to a complete view of the surrounding environment around the vehicle and the trailer.

16. The method of claim 15 , further comprising:

detecting, by the ECU and based on at least one of the image data or the additional image data, a collision; and

communicating an instruction to the trailer to engage trailer brakes to slow one or more wheels of the trailer.

17. The method of claim 15 , further comprising:

rendering, by the ECU and on a graphical user interface, a top-down view of the vehicle and the trailer based on at least one of the image data or the additional image data; and

displaying, by a display, the rendered top-down view.

18. The method of claim 15 , further comprising:

transmitting the image data and the additional image data to a mobile device configured to combine the image data and the additional image data.

19. The method of claim 18 , wherein the mobile device is further configured to:

determine an orientation or placement of the at least one add-on camera; and

provide instructions to a user for adjusting one or more of the at least one add-on camera to improve coverage of the surrounding environment around the vehicle and the trailer.

20. The method of claim 19 , wherein the mobile device is further configured to determine the orientation or placement of the at least one add-on camera based on identification of location of the at least one add-on camera on the vehicle or the trailer.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2022
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 061081/0849 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2020
From: NAKAGAWA, MASASHI; NAGATA, KATSUMI
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 054610/0992 →
Continuity (1)
Related Publication 20220180488A1 · Jun 9, 2022
Cited By (1)
US 12,412,295