IP Library › Granted Patent US 11,142,192
Granted Patent B2
US 11,142,192 · App. 16/327,011 · Granted Oct 12, 2021

Imaging device, signal processing device, and vehicle control system

Inventors: Shinnosuke Hayamizu (Kanagawa, JP); Kazuyuki Marukawa (Kanagawa, JP); Itaru Shimizu (Tokyo, JP); Noriko Tanaka (Tokyo, JP); Asako Kaneko (Tokyo, JP)
Assignee: SONY CORPORATION
B60W30/09B60R11/02B60R21/00B60W10/04B60W10/18B60W10/20B60W30/08B60W30/14B60W40/04B60W50/14G06K9/00805G06T7/70G08G1/16G08G1/166B60W2050/146G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,142,192
App. No.
16/327,011
Granted
Oct 12, 2021
Kind
B2
Abstract

The present technology relates to an imaging device, a signal processing device, and a vehicle control system enabling proper driving support when a vehicle enters a road from the outside of the road. An imaging device includes: an imaging unit that captures an image of a front of a vehicle; and an object detection unit that performs object detection processing on the basis of the image captured by the imaging unit, wherein the object detection unit changes an object detection method on the basis of a positional relationship between the vehicle and a road where the vehicle enters from an outside. The present technology can be applied to an imaging device installed in, for example, various vehicles that perform driving support.

Claims (58)

1. An imaging device, comprising:

a plurality of cameras, wherein the plurality of cameras is configured to capture a plurality of images of an area of a front of a first vehicle; and

a processing unit configured to:

receive sensor data from a set of sensors, wherein the sensor data includes information associated with a distance between the front of the first vehicle and an object on a road;

perform an object detection process based on the sensor data and at least one image of the plurality of images, wherein

in the object detection process, the processing unit is further configured to:

set a preferential detection range in which the object is detected; and

set the object as a preferential detection target based on the distance between the front of the first vehicle and the object; and

control the set of sensors to change at least one of the preferential detection target or the preferential detection range, wherein

the set of sensors is controlled based on a positional relationship between the first vehicle and the road, and

the first vehicle enters from an outside of the road.

2. The imaging device according to claim 1 , wherein the preferential detection range is a roadway and the preferential detection target is a second vehicle before the first vehicle enters the roadway inside the road.

3. The imaging device according to claim 2 , wherein the processing unit is further configured to perform the object detection process to detect the second vehicle that approaches a position at which the first vehicle merges with a first lane in the roadway before the first vehicle enters the roadway.

4. The imaging device according to claim 3 , wherein the processing unit is further configured to perform the object detection process to detect the second vehicle that approaches a position at which the first vehicle crosses a second lane in the roadway before merging with the first lane.

5. The imaging device according to claim 2 , wherein the processing unit is further configured to perform the object detection process to detect a situation of a merge destination at which the first vehicle merges with the roadway based on absence of an obstacle on the roadway.

6. The imaging device according to claim 1 , wherein the processing unit is further configured to perform the object detection process to detect at least one of a sidewalk as the preferential detection range or a pedestrian as the preferential detection target.

7. The imaging device according to claim 1 , wherein

each camera of the plurality of cameras is associated with a different imaging range, and

the processing unit is further configured to switch between the plurality of cameras to perform the object detection process.

8. A signal processing device, comprising:

a processing unit configured to:

receive sensor data from a set of sensors, wherein the sensor data includes information associated with a distance between a front of a vehicle and an object on a road;

perform an object detection process based on the sensor data and at least one image of a plurality of images of an area of the front of the vehicle, wherein the plurality of images is captured by a plurality of cameras, wherein

in the object detection process, the processing unit is further configured to:

set a preferential detection range in which the object is detected; and

set the object as a preferential detection target based on the distance between the front of the vehicle and the object; and

control the set of sensors to change at least one of the preferential detection target or the preferential detection range, wherein

the set of sensors is controlled based on a positional relationship between the vehicle and the road, and

the vehicle enters from an outside of the road.

9. A vehicle control system, comprising:

a plurality of cameras, wherein the plurality of cameras is configured to capture a plurality of images of an area of a front of a first vehicle; and

a plurality of object detection sensors configured to generate sensor data that includes information associated with a distance between the front of the first vehicle and an object on a road; and

a processing unit configured to:

perform an object detection process based on the sensor data and at least one image of the plurality of images, wherein

in the object detection process, the processing unit is further configured to:

set a preferential detection range in which the object is detected; and

set the object as a preferential detection target based on the distance between the front of the first vehicle and the object;

control the first vehicle based on a result of the object detection process; and

control the plurality of object detection sensors to change the object detection process based on a positional relationship between the first vehicle and the road, wherein the first vehicle enters from an outside of the road.

10. The vehicle control system according to claim 9 , wherein

the preferential detection range is a roadway and the preferential detection target is a second vehicle before the first vehicle enters the roadway inside the road, and

the processing unit is further configured to control the first vehicle to at least one of prohibit entrance of the first vehicle into the roadway or issue an alert to a driver when an obstacle is detected on the roadway.

11. The vehicle control system according to claim 10 , wherein the processing unit is further configured to control the first vehicle to show guidance to merge the first vehicle with the roadway based on absence of the obstacle on the roadway.

12. The vehicle control system according to claim 11 , wherein the processing unit is further configured to change content of the guidance based on a driving skill of the driver.

13. The vehicle control system according to claim 10 , wherein the processing unit is further configured to:

perform the object detection process to detect a situation of a merge destination at which the first vehicle merges with the roadway based on absence of the obstacle on the roadway; and

control the first vehicle to perform at least one of control of travel of the first vehicle or the issuance of the alert to the driver, wherein the first vehicle is controlled based on the situation of the merge destination.

14. The vehicle control system according to claim 9 , wherein the processing unit is further configured to:

perform the object detection process to detect at least one of a sidewalk as the preferential detection range or a pedestrian as the preferential detection target;

detect an obstacle on the sidewalk based on the object detection process; and

control the first vehicle to perform at least one of prohibition of entrance of the first vehicle into the sidewalk or issuance of an alert to a driver of the first vehicle based on the detected obstacle.

15. The vehicle control system according to claim 9 , wherein

each camera of the plurality of cameras is associated with a different imaging range, and

the processing unit is further configured to switch between the plurality of cameras to perform the object detection process.

16. The vehicle control system according to claim 9 , wherein

each object detection sensor of the plurality of object detection sensors is associated with a different detection range,

the processing unit is further configured to

switch between the plurality of object detection sensors based on the positional relationship between the first vehicle and the road.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2019
From: HAYAMIZU, SHINNOSUKE; MARUKAWA, KAZUYUKI; SHIMIZU, ITARU; TANAKA, NORIKO; KANEKO, ASAKO
To: SONY CORPORATION
Reel/Frame 048394/0835 →
Priority Claims (1)
JP JP2016-180208 · Sep 15, 2016 · national
Continuity (1)
Related Publication 20190202451A1 · Jul 4, 2019
Cited By (1)
US 12,674,677