IP Library Granted Patent US 11,796,640
Granted Patent B2
US 11,796,640 · App. 16/805,887 · Granted Oct 24, 2023

Time-of-flight depth camera with low resolution pixel imaging

Inventors: Matthew John Lawrenson (Eindhoven, NL); Joachim Wilhelm Hellmig (Ulm, DE); Holger Joachim Moench (Ulm, DE); Nicholas Walker (Eindhoven, NL); Jan Jasper Van Den Berg (Eindhoven, NL)
Assignee: TRUMPF PHOTONIC COMPONENTS GMBH
G01S7/4815G01S7/484G01S17/894
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,796,640
App. No.
16/805,887
Granted
Oct 24, 2023
Kind
B2
Abstract

A time-of-flight depth camera includes a VCSEL array, an optical arrangement, an evaluator and a light detector having at least one detector pixel. The VCSEL array or the optical arrangement are arranged to provide different illumination patterns in a reference plane in a defined field-of-view of the time-of-flight depth camera. The light detector is arranged to detect the different illumination patterns and the evaluator is arranged to reconstruct a depth image of the field of view with a resolution of a predefined number of pixels P based on the detected different illumination patterns. A number of the detected different illumination patterns N is at least 5% of the predefined number of pixels P, preferably at least 10% of the predefined number of pixels P and most preferred at least 20% of the predefined number of pixels P.

Claims (56)

1. A time-of-flight depth camera comprising:

a VCSEL array;

an optical arrangement;

an evaluator; and

a light detector comprising at least one detector pixel,

wherein the VCSEL array or the optical arrangement are arranged to provide different illumination patterns in a reference plane in a defined field-of-view of the time-of-flight depth camera,

wherein the light detector is arranged to detect the different illumination patterns,

wherein the evaluator is arranged to reconstruct a depth image of the field of view with a resolution of a predefined number of pixels P based on the detected different illumination patterns,

wherein a number of the detected different illumination patterns N is at least 5% of the predefined number of pixels P,

wherein the VCSEL array is an addressable VCSEL array,

wherein the VCSEL array is arranged to provide different illumination patterns by addressing different VCSELs of the VCSEL array,

wherein the optical arrangement comprises a replicating optical structure,

wherein the replicating optical structure is arranged to replicate a light pattern provided by the VCSEL array across the illumination pattern such that the illumination pattern consists of two or more sub-illumination patterns,

wherein the detector is arranged such that each detector pixel detects a corresponding sub-illumination pattern,

wherein the number of detected different illumination patterns N is determined by a number of detector pixels D and a number of provided different illumination patterns, and

wherein the number of provided different illumination patterns is given by a product V*O of a number of different illumination patterns provided by the addressable VCSEL array V and a number of different illumination patterns provided by optical arrangement O, wherein V is chosen between 4 and 0.7*N, and wherein O is chosen between 2 and 0.7*N.

2. The time-of-flight depth camera according to claim 1 , wherein the different illumination patterns are pseudo random illumination patterns.

3. The time-of-flight depth camera according to claim 1 , wherein the VCSELs of the VCSEL array are arranged in a random pattern such that the number of different illumination patterns provided by the VCSEL array is increased.

4. A time-of-flight depth camera comprising:

a VCSEL array;

an optical arrangement;

an evaluator; and

a light detector comprising at least one detector pixel, wherein the VCSEL array or the optical arrangement are arranged to provide different illumination patterns in a reference plane in a defined field-of-view of the time-of-flight depth camera,

wherein the light detector is arranged to detect the different illumination patterns,

wherein the evaluator is arranged to reconstruct a depth image of the field of view with a resolution of a predefined number of pixels P based on the detected different illumination patterns,

wherein a number of the detected different illumination patterns N is at least 5% of the predefined number of pixels P,

wherein the VCSEL array is an addressable VCSEL array,

wherein the VCSEL array is arranged to provide different illumination patterns by addressing different VCSELs of the VCSEL array,

wherein the optical arrangement comprises a replicating optical structure,

wherein the optical arrangement is arranged to provide different illumination patterns by changing an optical property of the optical arrangement,

wherein the number of detected different illumination patterns N is determined by a number of detector pixels D and a number of provided different illumination patterns, and

wherein the number of provided different illumination patterns is given by a product V*O of a number of different illumination patterns provided by the addressable VCSEL array V and a number of different illumination patterns provided by optical arrangement O, wherein V is chosen between 4 and 0.7*N, and wherein O is chosen between 2 and 0.7*N.

5. The time-of-flight depth camera according to claim 4 , wherein the optical arrangement comprises a first optical element and a second element, and wherein the optical arrangement is arranged to change a spatial relationship between the first optical element and the second optical element.

6. The time-of-flight depth camera according to claim 5 , wherein the first optical element is a first diffractive optical element, and wherein the second optical element is a second diffractive optical element.

7. The time-of-flight depth camera according to claim 4 , wherein the optical arrangement comprises a spatial light modulator or a micromirror device for providing the different illumination patterns.

8. The time-of-flight depth camera according to claim 4 , wherein the light detector comprises less than 10 detector pixels.

9. The time-of-flight depth camera according to claim 4 , wherein the number of detected different illumination patterns N is less than the predefined number of pixels P.

10. A method of providing a depth image from a defined field of view with a resolution of a predefined number of pixels P, the method comprising the steps of:

changing an optical interaction between a VCSEL array and an optical arrangement, wherein the VCSEL array is an addressable VCSEL array,

providing a number of different illumination patterns by changing the optical interaction,

detecting the different illumination patterns, wherein the number of detected different illumination patterns N is at least 5% of the predefined number of pixels P in a reference plane in the defined field-of-view,

reconstructing the depth image of the field of view based on the detected different illumination patterns,

providing different illumination patterns by addressing different VCSELs of the addressable VCSEL array,

replicating by means of a replicating optical structure comprised by the optical arrangement a light pattern provided by the addressable VCSEL array across the illumination pattern such that the illumination pattern consists of two or more sub-illumination patterns, and

detecting by each detector pixels a corresponding sub-illumination pattern,

wherein the number of detected different illumination patterns N is determined by a number of detector pixels D and a number of provided different illumination patterns, and

wherein the number of provided different illumination patterns is given by a product V*O of a number of different illumination patterns provided by the addressable VCSEL array V and a number of different illumination patterns provided by optical arrangement O, wherein V is chosen between 4 and 0.7*N, and wherein O is chosen between 2 and 0.7*N.

11. A method of providing a depth image from a defined field of view with a resolution of a predefined number of pixels P, the method comprising the steps of:

changing an optical interaction between a VCSEL array and an optical arrangement, wherein the VCSEL array is an addressable VCSEL array,

providing a number of different illumination patterns by changing the optical interaction,

detecting the different illumination patterns, wherein the number of detected different illumination patterns N is at least 5% of the predefined number of pixels P in a reference plane in the defined field-of-view,

reconstructing the depth image of the field of view based on the detected different illumination patterns,

providing different illumination patterns by addressing different VCSELs of the addressable VCSEL array, and

providing different illumination patterns by changing an optical property of the optical arrangement,

wherein the number of detected different illumination patterns N is determined by a number of detector pixels D and a number of provided different illumination patterns, and

wherein the number of provided different illumination patterns is given by a product V*O of a number of different illumination patterns provided by the addressable VCSEL array V and a number of different illumination patterns provided by optical arrangement O, wherein V is chosen between 4 and 0.7*N, and wherein O is chosen between 2 and 0.7*N.

Assignments (3)
CHANGE OF NAME Recorded Mar 27, 2020
From: PHILIPS PHOTONICS GMBH
To: TRUMPF PHOTONIC COMPONENTS GMBH
Reel/Frame 052251/0791 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2020
From: LAWRENSON, MATTHEW JOHN; HELLMIG, JOACHIM WILHELM; MOENCH, HOLGER JOACHIM; WALKER, NICHOLAS; VAN DER BERG, JAN JASPER
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 052047/0623 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2020
From: KONINKLIJKE PHILIPS N.V.
To: PHILIPS PHOTONICS GMBH
Reel/Frame 052120/0257 →
Priority Claims (1)
EP 17188935 · Sep 1, 2017 · regional
Continuity (2)
Continuation PCTEP2018073219 · Aug 29, 2018
Related Publication 20200217931A1 · Jul 9, 2020