IP Library Granted Patent US 11,961,306
Granted Patent B2
US 11,961,306 · App. 17/486,224 · Granted Apr 16, 2024

Object detection device

Inventor: Kazuki Kato (Kariya, JP)
Assignee: DENSO CORPORATION
G06V20/56G01S7/4802G01S7/4863G01S17/894G01S17/931G06F18/23G06V10/507G06V10/60G06V10/751
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,961,306
App. No.
17/486,224
Granted
Apr 16, 2024
Kind
B2
Abstract

In an object detection device for detecting an object, a single sensor unit includes a light emitting unit and a light receiving unit. The light receiving unit includes a two-dimensional array of light receiving elements and outputs a light reception signal in response to a light reception state of a set of the light receiving elements for each pixel. The sensor unit is configured to, based on the light reception signals, acquire first information indicating reception intensity of the reflected light at each pixel, second information indicating reception intensity of background light that is light other than the reflected light, at each pixel, and third information indicating a distance to the object at each pixel as a pixel value of the pixel. A detection unit is configured to use all of the first to third information included in the pixel values of the respective pixels to detect the object.

Claims (31)

1. An object detection device for detecting an object, comprising:

a single sensor unit including a light emitting unit configured to emit illumination light, and a light receiving unit including a two-dimensional array of a plurality of light receiving elements on a light receiving surface for receiving light including reflected light of the illumination light, the light receiving unit being configured to output a light reception signal in response to a light reception state of a set of the light receiving elements in each pixel, the set of the light receiving elements within each predefined pixel region forming one pixel, the sensor unit being configured to, based on the light reception signals, acquire first information indicating reception intensity of the reflected light at each pixel, second information indicating reception intensity of background light that is light other than the reflected light, at each pixel, and third information indicating a distance to the object at each pixel as a pixel value of the pixel; and

a detection unit configured to use the pixel value of each pixel to detect the object, the detection unit being configured to use all of the first to third information included in the acquired pixel values of the respective pixels to detect the object.

2. The object detection device according to claim 1 , wherein

the detection unit is configured to detect the object by contrasting the first to third information with model information that represents models of the first to third information in the presence of the object.

3. The object detection device according to claim 2 , wherein

the detection unit is configured to contrast the first information with the model information for the first information to acquire, for each pixel, a first likelihood indicating a likelihood of the object being present, contrast the second information with the model information for the second information to acquire, for each pixel, a second likelihood indicating a likelihood of the object being present, contrast the third information with the model information for the third information to acquire, for each pixel, a third likelihood indicating a likelihood of the object being present, acquire a total likelihood by calculating a weighted sum of the first to third likelihoods for each pixel, and uses the acquired total likelihood to detect the object.

4. The object detection device according to claim 3 , wherein

the detection unit is configured to acquire intensity-related information related to the reception intensity of the background light, and

the detection unit is configured to, in response to the reception intensity of the background light indicated by the acquired intensity-related information being high, set a smaller weighting factor for each of the first likelihood and the third likelihood and a larger weighting factor for the second likelihood, as compared to in response to the reception intensity of the background light indicated by the acquired intensity-related information being low.

5. The object detection device according to claim 1 , wherein

the detection unit is configured to use the first to third information to perform at least one of a road surface determination process and a clustering process that associates a plurality of range points with each other.

6. The object detection device according to claim 5 , wherein

the sensor unit is mountable and usable in a vehicle,

the sensor unit is configured to acquire the first to third information as frame images respectively corresponding the first to third information for each predefined frame period, and

the detection unit is configured to perform an association process on each of the first to third information to associate a result of the clustering process performed on a current frame image acquired during a current frame period and a result of the clustering process performed on a previous frame image acquired during a previous frame period with each other using at least pixel values of each of the current and previous frame images, the result of the clustering process performed on the previous frame image being a result of tracking process that associates the result of the clustering process performed on the previous frame image and a result of the clustering process performed on a next previous image acquired during a next previous frame period with each other.

7. The object detection device according to claim 6 , wherein

the detection unit is configured to perform the clustering process and the association process, and in the association process, for each of the first to third information, acquire a feature value of the pixel values for the result of the clustering process performed on each of current and previous frame images, acquire a difference between the feature values for the current and previous frame images, in response to the difference for each of the first to third information being less than a respective predefined threshold, associate the result of the clustering process performed on the current frame image and the result of the tracking process performed on the previous frame image with each other.

8. The object detection device according to claim 7 , wherein

the detection unit is configured to acquire intensity-related information related to the reception intensity of background light,

the detection unit is configured to variably set the threshold for each of the first to third information, and

the detection unit is configured to, in response to the reception intensity of the background light indicated by the acquired intensity-related information being high, set the threshold for each of the first and third information to a smaller value and set the threshold for the second information to a larger value, as compared to in response to the reception intensity of the background light indicated by the acquired intensity-related information being low.

9. The object detection device according to claim 7 , wherein,

for each of the first to third information, the feature value is at least one of an average and a histogram of the pixel values of the pixels.

10. The object detection device according to claim 1 , wherein

the sensor unit further includes a contrast-related value calculator configured to acquire the first to third information as frame images for each predefined frame period, and calculates a contrast-related value for each of the frame images corresponding to the acquired first or third information,

the detection unit is configured to, given the three frame images respectively corresponding to the acquired first to third information, in response to the contrast-related value calculated for each of the three frame images being equal to or greater than a predetermined contrast threshold, detect the object using all of the acquired three frame images, and in response to at least one of the acquired three frame images being less than the predetermined contrast threshold, not perform detection of the object using all of the acquired three frame images.

11. The object detection device according to claim 1 , wherein

the sensor unit is configured as a ranging device that measures the distance to the object.

12. The object detection device according to claim 1 , wherein

each of the light receiving elements comprises a single photon avalanche diode (SPAD) that outputs an output signal indicating incidence of light as the light reception signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2021
From: KATO, KAZUKI
To: DENSO CORPORATION
Reel/Frame 057905/0001 →
Priority Claims (1)
JP 2019-063664 · Mar 28, 2019 · national
Continuity (2)
Continuation PCTJP2020013001 · Mar 24, 2020
Related Publication 20220012505A1 · Jan 13, 2022
Cited By (2)
US 12,687,619 US 12,693,424