IP Library › Granted Patent US 10,830,887
Granted Patent B2
US 10,830,887 · App. 15/877,512 · Granted Nov 10, 2020

Object sensor assembly including stereoscopic cameras and range finders

Inventors: Yew Kwang Low (Singapore, SG); Kok Wee Yeo (Singapore, SG); Binghua Pan (Singapore, SG); Ronald M. Taylor (Greentown, IN); Ward K. Everly (Westfield, IN)
Assignee: Aptiv Technologies Limited
G01S17/08G01C3/08G01S17/86G01S17/87G01S17/931H04N5/33H04N13/239G01S2013/9314G01S2013/9321G01S2013/9323G01S2013/93271H04N13/243H04N13/254H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,830,887
App. No.
15/877,512
Granted
Nov 10, 2020
Kind
B2
Abstract

An illustrative example sensor device includes a plurality of range finders that each have an emitter configured to emit a selected type of radiation and a detector configured to detect the selected type of radiation reflected from an object. A plurality of cameras are configured to generate an image of an object based upon receiving the selected type of radiation from the object. A processor is configured to determine a distance between the sensor device and an object based on at least two of the images, wherein the images are each from a different camera.

Claims (44)

1. A sensor system, comprising:

a plurality of range finders, each of the range finders including at least one emitter that is configured to emit a selected frequency range of radiation and at least one detector configured to detect the selected frequency range of radiation, the range finders being configured to provide an indication of a distance between the range finders and an object based on the selected frequency range of radiation reflected from an object and detected by the detectors;

a plurality of cameras that are configured to generate respective images of the object based on only detecting the selected frequency range of radiation from the object, each of the plurality of cameras associated with a respective one of the plurality of range finders; and

a processor that is configured to determine a distance between the sensor system and the object based on differences between at least two of the images of the object from respective ones of the cameras.

2. The sensor system of claim 1 , wherein the processor is configured to determine the distance between the sensor system and the object by not processing information regarding other visible features within a field of view of the respective ones of the cameras, the other visible features not detectable by the plurality of cameras based on the selected frequency range of radiation.

3. The sensor system of claim 2 , wherein the plurality of cameras comprise at least one filter that filters out any radiation other than the selected frequency range of radiation.

4. The sensor system of claim 2 , wherein the selected frequency range of radiation comprises near infrared radiation.

5. The sensor system of claim 2 , wherein the only objects in the images of the respective cameras are objects from which the selected frequency range of radiation is detected.

6. The sensor system of claim 1 , wherein the processor is configured to determine a size of the object based on a relationship between edges of the object and a camera axis in the respective images.

7. The sensor system of claim 1 , wherein the processor is configured to use the indication from the range finders as an estimate of the distance between the sensor system and the object in the images.

8. The sensor system of claim 1 , wherein the processor is configured to:

determine a range basis from the indication from the range finders; and

select a number of the cameras from which to obtain an image of the object dependent on the determined range basis.

9. The sensor system of claim 8 , wherein the processor is configured to:

determine which of the cameras generated an image of the object; and

select the number of the cameras from among the cameras that generated an image of the object.

10. The sensor system of claim 1 , wherein:

the cameras have a frame duration for generating an image;

at least a first one of the emitters emits the selected frequency range of radiation for a first portion of the frame duration;

at least a second one of the emitters emits the selected frequency range of radiation for a second portion of the frame duration; and

the first and second portions of the frame duration collectively are at least as long as the frame duration.

11. A method of determining a distance to an object, the method comprising:

emitting a selected frequency range of radiation from a respective range finder emitter of a plurality of range finders;

detecting only the selected frequency range of radiation from the object at each of a plurality of cameras, each of the plurality of cameras associated with a respective one of the plurality of range finders;

generating an image of the object from each of the cameras based on detecting the selected frequency range of radiation from the object; and

determining the distance to the object based on differences between at least two of the images of the object, wherein the at least two of the images are each from a different one of the cameras.

12. The method of claim 11 , wherein determining the distance to the object based on differences between at least two of the images of the object does not include processing information regarding other visible features within a field of view of the respective ones of the cameras, the other visible features not detectable by the plurality of cameras based on the selected frequency range of radiation.

13. The method of claim 12 , wherein the plurality of cameras comprise at least one filter that filters out any radiation other than the selected frequency range of radiation.

14. The method of claim 12 , wherein the selected frequency range of radiation comprises near infrared radiation.

15. The method of claim 12 , wherein generating the image of the object comprises only including a representation of objects in the image from which the selected frequency range of radiation is detected.

16. The method of claim 11 , further comprising determining a size of the object based on a relationship between edges of the object and a camera axis in the respective images.

17. The method of claim 11 , comprising:

determining a range to the object based on an indication from a range finder detector of at least one of the plurality of range finders that detects the selected frequency range of radiation; and

using the determined range as an estimate of the distance to the object in the images.

18. The method of claim 11 , comprising:

determining a range basis from an indication from a range finder detector of at least one of the plurality of range finders that detects the selected frequency range of radiation; and

selecting a number of the cameras from which to obtain an image of the object dependent on the determined range basis.

19. The method of claim 18 , comprising:

determining which of the cameras generated an image of the object; and

selecting the number of the cameras from among the cameras that generated an image of the object.

20. The method of claim 11 , wherein:

the cameras have a frame duration for generating an image;

the method comprises emitting the selected frequency range of radiation from at least a first emitter of at least one of the plurality of range finders for a first portion of the frame duration and emitting the selected frequency range of radiation from at least a second emitter of the at least one of the plurality of range finders for a second portion of the frame duration; and

the first and second portions of the frame duration collectively are at least as long as the frame duration.

Assignments (5)
MERGER Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES (2) S.À R.L.
To: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
Reel/Frame 066566/0173 →
ENTITY CONVERSION Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES LIMITED
To: APTIV TECHNOLOGIES (2) S.À R.L.
Reel/Frame 066746/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2024
From: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
To: APTIV TECHNOLOGIES AG
Reel/Frame 066551/0219 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2020
From: DELPHI TECHNOLOGIES LLC
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 052044/0428 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2018
From: LOW, YEW KWANG; YEO, KOK WEE; PAN, BINGHUA; TAYLOR, RONALD M.; EVERLY, WARD K.
To: DELPHI TECHNOLOGIES, LLC
Reel/Frame 044697/0220 →
Continuity (1)
Related Publication 20190227168A1 · Jul 25, 2019