IP Library Granted Patent US 10,274,965
Granted Patent B2
US 10,274,965 · App. 15/295,221 · Granted Apr 30, 2019

Sensor system for vehicle

Inventors: Trong Duy Nguyen (Novi, MI); Lorraine Novak (Troy, MI)
Assignees: DENSO International America, Inc.; DENSO CORPORATION
G05D1/0251B60W30/09G01C11/02G01C21/3407G05D1/0094G05D1/0278G06K9/00805G08G1/166H04N13/239G05D2201/0213H04N2213/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,274,965
App. No.
15/295,221
Granted
Apr 30, 2019
Kind
B2
Abstract

A sensor system for a vehicle including a first camera sensor and a second camera sensor configured to be mounted spaced apart from one another on a vehicle. A sensor module of the sensor system is configured to generate a three-dimensional image of an environment about the vehicle based on data collected by the first camera sensor and the second camera sensor.

Claims (36)

1. A sensor system for a vehicle comprising:

a first camera sensor and a second camera sensor configured to be mounted spaced apart from one another on a vehicle such that the first camera sensor is on a left side of the vehicle and the second camera sensor is on a right side of the vehicle;

a first camera mount for the first camera sensor, the first camera mount configured to move the first camera sensor left, right, up, and down;

a second camera mount for the second camera sensor, the second camera mount configured to move the second camera sensor left, right, up, and down;

a control module that moves the first camera mount and the second camera mount in unison such that the first camera sensor and the second camera sensor face the same direction; and

a sensor module configured to generate a three-dimensional image of an environment about the vehicle based on data collected by the first camera sensor and the second camera sensor by fusing a first image from the first camera sensor with a second image from the second camera sensor.

2. The sensor system of claim 1 , wherein the sensor system consists of only two sensor cameras.

3. The sensor system of claim 1 , wherein the sensor module is further configured to identify objects in the three-dimensional image including pedestrians, vehicles, buildings, and obstacles.

4. The sensor system of claim 1 , further comprising a mapping and localization module configured to generate a map of the environment based on the three-dimensional image generated by the sensor module, and identify position of the vehicle on the map.

5. The sensor system of claim 4 , further comprising a path planning module configured to plan a route for the vehicle based on the map generated by the mapping and localization module.

6. The sensor system of claim 5 , wherein the control module is configured to control at least one of the following based on the route planned for the vehicle by the path planning module: steering angle of the vehicle; vehicle throttle; vehicle braking; and vehicle gear shift.

7. The sensor system of claim 1 , wherein the control module is configured to control movement of the first camera mount and the second camera mount based on at least one of location of an object identified by the sensor module, a steering angle of the vehicle, and an anticipated route of the vehicle.

8. The sensor system of claim 1 , wherein the control module is configured to control at least one of the following based on location of an object identified by the sensor module: steering angle of the vehicle; vehicle throttle; vehicle braking; and vehicle gear shift.

9. A sensor system for a vehicle comprising:

a first camera sensor mounted to a left side of a vehicle;

a first camera mount for mounting the first camera sensor to the left side of the vehicle, the first camera mount configured to move the first camera sensor left, right, up, and down;

a second camera mounted to a right side of a vehicle;

a second camera mount for mounting the second camera sensor to the right side of the vehicle, the second camera mount configured to move the second camera sensor left, right, up, and down;

a sensor module configured to generate a three-dimensional image of an environment about the vehicle by combining a first image collected by the first camera sensor and a second image collected by the second camera sensor, the sensor module further configured to identify objects in the three-dimensional image including pedestrians, vehicles, buildings, and obstacles; and

a control module configured to control rotation of the first camera mount and the second camera mount in unison such that the first camera mount and the second camera mount face the same direction based on at least one of location of an object identified by the sensor module, a steering angle of the vehicle, and an anticipated route of the vehicle.

10. The sensor system of claim 9 , wherein the sensor system consists of only two sensor cameras.

11. The sensor system of claim 9 , the control module is further configured to control at least one of the following based on location of an object identified by the sensor module: steering angle of the vehicle; vehicle throttle; vehicle braking; and vehicle gear shift.

12. The sensor system of claim 9 , further comprising a mapping and localization module configured to generate a map of the environment based on the three-dimensional image generated by the sensor module, and identify position of the vehicle on the map.

13. The sensor system of claim 12 , further comprising a path planning module configured to plan a route for the vehicle based on the map generated by the mapping and localization module.

14. The sensor system of claim 13 , further comprising a control module configured to control at least one of the following based on the route planned for the vehicle by the path planning module: steering angle of the vehicle; vehicle throttle; vehicle braking; and vehicle gear shift.

15. A method for tracking objects with a vehicle sensor system comprising:

capturing images of an environment about the vehicle with a first camera sensor mounted to a left side of a vehicle with a first camera mount configured to move the first camera sensor left, right, up, and down;

capturing images of the environment about the vehicle with a second camera sensor mounted to a right side of the vehicle with a second camera mount configured to move the second camera sensor left, right, up, and down;

combining images captured by the first camera sensor and the second camera sensor to generate three-dimensional fused images of the environment;

identifying an object in the three-dimensional images, the object including at least one of a pedestrian, vehicle, building, and obstacle; and

moving the first camera sensor and the second camera sensor in unison such that the first camera sensor and the second camera sensor face the same direction based on at least one of location of the object identified in the three-dimensional images, a steering angle of the vehicle, and an anticipated route of the vehicle.

16. The method of claim 15 , further comprising:

generating a map of the environment about the vehicle based on the generated three-dimensional images, and identifying position of the vehicle on the map; and

planning a route for the vehicle based on the map.

17. The method of claim 16 , further comprising modifying at least one of the following based on the route planned for the vehicle: steering angle of the vehicle, vehicle throttle, vehicle braking, and vehicle gear shift.

18. The method of claim 15 , further comprising modifying at least one of the following based on location of the object identified by the sensor module: steering angle of the vehicle; vehicle throttle; vehicle braking; and vehicle gear shift.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2016
From: NGUYEN, TRONG DUY; NOVAK, LORRAINE
To: DENSO INTERNATIONAL AMERICA, INC.; DENSO CORPORATION
Reel/Frame 040032/0250 →
Continuity (1)
Related Publication 20180107225A1 · Apr 19, 2018
Cited By (1)
US 12,524,013