IP Library › Granted Patent US 11,721,031
Granted Patent B2
US 11,721,031 · App. 17/083,079 · Granted Aug 8, 2023

Scalable depth sensor

Inventors: Andreas Aßmann (Edinburgh, GB); Brian Douglas Stewart (Edinburgh, GB)
Assignee: STMicroelectronics (Research & Development) Limited
G06T7/50G01S7/483G01S17/894G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,721,031
App. No.
17/083,079
Granted
Aug 8, 2023
Kind
B2
Abstract

A system and method for a scalable depth sensor. The scalable depth sensor having an emitter, a receiver, and a processor. The emitter is configured to uniformly illuminate a scene within a field-of-view of the emitter. The receiver including a plurality of detectors, each detector configured to capture depth and intensity information corresponding to a subset of the field-of-view. The a processor connected to the detector and configured to selectively sample a subset of the plurality of the detectors in accordance with compressive sensing techniques, and provide an image in accordance with an output from the subset of the plurality of the detectors, the image providing a depth and intensity image corresponding to the field-of-view of the emitter.

Claims (45)

1. A method comprising:

uniformly illuminating a scene within a field-of-view of an emitter;

having a receiver comprising a plurality of detectors;

selectively sampling a subset of the plurality of detectors in accordance with compressive sensing techniques;

capturing depth and intensity measurements by each of the subset of the plurality of detectors, each detector capturing depth and intensity information corresponding to a subset of the field-of-view; and

generating, by a processor, images of the scene in accordance with an output from the subset of the plurality of the detectors, the images providing a depth and intensity image corresponding to the field-of-view of the emitter.

2. The method of claim 1 , wherein the emitter comprises a single light source.

3. The method of claim 1 , wherein the emitter comprises a coherent light source comprising a plurality of light sources, the plurality of light sources providing a single uniform illumination of the scene.

4. The method of claim 1 , further comprising communicating, by each of the subset of the plurality of detectors, a respective depth and intensity measurement to the processor.

5. The method of claim 1 , wherein the receiver is an array comprising a plurality of single-photon avalanche diode (SPAD) devices, wherein each SPAD device corresponds to a detector in the plurality of detectors.

6. The method of claim 1 , further comprising:

emitting a signal to illuminate the scene; and

measuring, each of the subset of the plurality of detectors, a time-of-flight (ToF) of the signal within a respective subset of a field-of-view of each detector, the measurement synchronized in accordance to a timing reference corresponding to the emission of the signal.

7. The method of claim 1 , wherein capturing the depth and the intensity measurements by each of the subset of the plurality of detectors comprises reconstructing the depth and intensity image within the subset of the field-of-view.

8. The method of claim 7 , further comprising providing an output of the reconstructed depth and intensity measurements within the subset of the field-of-view to the processor.

9. The method of claim 1 , wherein selectively sampling the subset of the plurality of detectors in accordance with compressive sensing techniques comprises selectively toggling each of the subset of the plurality of detectors in accordance with a pattern that changes at predefined time intervals.

10. A device comprising:

an emitter configured to uniformly illuminate a scene within a field-of-view of the emitter;

a receiver comprising a plurality of detectors, each detector configured to capture depth and intensity information corresponding to a subset of the field-of-view; and

a processor coupled to the detector, the processor configured to:

selectively sample a subset of the plurality of the detectors in accordance with compressive sensing techniques, and

provide an image in accordance with an output from the subset of the plurality of the detectors, the image providing a depth and intensity image corresponding to the field-of-view of the emitter.

11. The device of claim 10 , further comprising a plurality of communication links, each communication link coupling a respective detector to the processor.

12. The device of claim 10 , wherein the receiver is an array comprising a plurality of single-photon avalanche diode (SPAD) devices, wherein each SPAD device corresponds to a detector in the plurality of detectors.

13. The device of claim 10 , wherein the emitter is configured to emit a signal to illuminate the scene, wherein each detector is configured to measure a time-of-flight (ToF) of the signal within a respective subset of the field-of-view of the detector, the measurement synchronized in accordance to a timing reference corresponding to the emission of the signal.

14. The device of claim 10 , wherein each detector configured to capture the depth and intensity information corresponding to a subset of the field-of-view comprises reconstructing the depth and intensity image within the subset of the field-of-view.

15. The device of claim 14 , wherein each receiver is further configured to output the reconstructed depth and intensity image within the subset of the field-of-view to the processor.

16. The device of claim 10 , wherein selectively sampling the subset of the plurality of detectors in accordance with compressive sensing techniques comprises selectively toggling the subset of the plurality of the detectors in accordance with a pattern that changes at predefined time intervals.

17. The device of claim 10 , wherein the emitter comprises a single light source.

18. The device of claim 10 , wherein the emitter comprises a coherent light source comprising a plurality of light sources, the plurality of light sources providing a single uniform illumination of the scene.

19. A system comprising:

an emitter configured to uniformly illuminate a scene within a field-of-view of the emitter; and

an imager comprising:

a plurality of receivers, each receiver comprising a plurality of detectors, each detector configured to capture depth and intensity information corresponding to a subset of the field-of-view based on a reflection from the emitter,

a plurality of processors, each processor coupled to a respective receiver, each processor configured to:

selectively sample a subset of the plurality of the detectors in accordance with compressive sensing techniques; and

provide a corresponding image in accordance with an output from the subset of the plurality of the detectors, the image providing a depth and intensity image corresponding to the field-of-view of the emitter, and

a memory coupled to the processor, the memory used to store each of the images in accordance with a configuration of each respective receiver, the plurality of images providing a final full image corresponding to an image of the scene.

20. The system of claim 19 , wherein each imager comprises a plurality of communication links, each communication link coupling a respective detector to a corresponding processor.

21. The system of claim 19 , wherein each receiver is an array comprising a plurality of single-photon avalanche diode (SPAD) devices, wherein each SPAD device corresponds to a respective detector in a plurality of detectors.

22. The system of claim 19 , wherein the emitter is configured to emit a signal to illuminate the scene, wherein each detector is configured to measure a time-of-flight (ToF) of the signal within a respective subset of the field-of-view of the detector, the measurement synchronized in accordance to a timing reference corresponding to the emission of the signal.

23. The system of claim 19 , wherein each detector configured to capture a depth and intensity image corresponding to a subset of the field-of-view comprises reconstructing the depth and intensity image within the subset of the field-of-view.

24. The system of claim 19 , wherein selectively sampling the subset of the plurality of detectors in accordance with compressive sensing techniques comprises selectively toggling the subset of the plurality of the detectors in accordance with a pattern that changes at predefined time intervals.

25. The system of claim 19 , wherein the emitter comprises a single light source.

26. The system of claim 19 , wherein the emitter comprises a coherent light source comprising a plurality of light sources, the plurality of light sources providing a single uniform illumination of the scene.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ELECTRONIC SIGNATURE WITH INK SIGNATURE PREVIOUSLY RECORDED AT REEL: 055060 FRAME: 0959. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 3, 2022
From: ASSMANN, ANDREAS; STEWART, BRIAN DOUGLAS
To: STMICROELECTRONICS (RESEARCH & DEVELOPMENT) LIMITED
Reel/Frame 061067/0938 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2021
From: ASSMANN, ANDREAS; STEWART, BRIAN DOUGLAS
To: STMICROELECTRONICS (RESEARCH & DEVELOPMENT) LIMITED
Reel/Frame 055060/0959 →
Continuity (1)
Related Publication 20220130060A1 · Apr 28, 2022