IP Library Granted Patent US 9,167,138
Granted Patent B2
US 9,167,138 · App. 13/311,589 · Granted Oct 20, 2015

Pattern projection and imaging using lens arrays

Inventors: Alexander Shpunt (Tel Aviv, IL); Benny Pesach (Rosh Ha'ayin, IL)
Assignee: APPLE INC.
H04N5/2254H04N5/23238H04N5/262
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,167,138
App. No.
13/311,589
Granted
Oct 20, 2015
Kind
B2
Abstract

A method for projection includes generating a pattern of illumination, and positioning an array of lenses so as to project different, respective parts of the pattern onto a scene.

Claims (26)

1. Imaging apparatus, comprising:

an image sensor, comprising an array of detector elements;

objective optics, which are configured to focus optical radiation and are positioned so as to form multiple, respective optical images of different areas of a scene such that all of the optical images focused by each objective optics are cast on the entire area of the array;

means for optically encoding the optical images with different, respective coding patterns; and

a processor, which is configured to process an output signal from the detector elements by matched filtering of the coding patterns in order to reconstruct electronic images of the different areas of the scene.

2. The apparatus according to claim 1 , wherein the means for optically encoding comprise multiple coded apertures, which are configured and positioned to optically modulate the respective optical images formed of the different areas of the scene.

3. The apparatus according to claim 2 , wherein the objective optics comprise multiple lenses, which are configured to form the respective optical images, and wherein each of the coded apertures is associated with an optical aperture of a respective one of the lenses.

4. The apparatus according to claim 1 , wherein the means for optically encoding comprise a projection module, which is configured to project the respective coding patterns onto the different areas of the scene.

5. The apparatus according to claim 4 , wherein the processor is configured to process the reconstructed electronic images so as to generate a depth map of the scene responsively to the coding patterns appearing in the optical images of the different areas of the scene.

6. The apparatus according to claim 1 , wherein the coding patterns are mutually orthogonal.

7. The apparatus according to claim 1 , wherein the processor is configured to reconstruct the electronic images of the different areas of the scene by applying to the output signal respective deconvolution kernels, based on the respective coding patterns.

8. The apparatus according to claim 1 , and comprising a projection module, which is configured to project an optical pattern onto the scene, wherein the processor is configured to process the electronic images so as to generate a depth map of the scene responsively to the optical pattern appearing in the electronic images of the different areas of the scene.

9. The apparatus according to claim 8 , wherein the processor is configured to select a sector of the depth map, to instruct the projection module to project the optical pattern only in the selected sector, and to process the output signal so as to generate a further depth map of the selected sector with enhanced resolution.

10. The apparatus according to claim 1 , wherein the processor is configured to stitch together the electronic images of the different areas of the scene in order to provide a combined image with a wide field of view relative to the electronic images of the different areas.

11. A method for imaging, comprising:

focusing optical radiation so as to form multiple, respective optical images of different areas of a scene such that all of the optical images focused by each objective optics are cast on the entire area of an array of detector elements;

optically encoding the optical images with different, respective coding patterns; and

processing an output signal from the detector elements by matched filtering of the coding patterns in order to reconstruct electronic images of the different areas of the scene.

12. The method according to claim 11 , wherein optically encoding the optical images comprise applying multiple coded apertures to optically modulate the respective optical images formed of the different areas of the scene.

13. The method according to claim 12 , wherein focusing the optical radiation comprises forming the optical images using multiple, respective lenses, and wherein each of the coded apertures is associated with an optical aperture of a respective one of the lenses.

14. The method according to claim 11 , wherein optically encoding the optical images comprises projecting the respective coding patterns onto the different areas of the scene.

15. The method according to claim 14 , and comprising processing the reconstructed electronic images so as to generate a depth map of the scene responsively to the pattern appearing in the optical images of the respective portions of the scene.

16. The method according to claim 11 , wherein the coding patterns are mutually orthogonal.

17. The method according to claim 11 , wherein processing the output signal comprises applying to the output signal multiple, respective deconvolution kernels, based on the respective coding patterns.

18. The method according to claim 11 , and comprising projecting an optical pattern onto the scene, and processing the electronic images so as to generate a depth map of the scene responsively to the optical pattern appearing in the electronic images of the different areas of the scene.

19. The method according to claim 18 , and comprising, after generating the depth map, selecting a sector of the depth map, projecting the optical pattern only in the selected sector, and processing the output signal so as to generate a further depth map of the selected sector with enhanced resolution.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION # 13840451 AND REPLACE IT WITH CORRECT APPLICATION # 13810451 PREVIOUSLY RECORDED ON REEL 034293 FRAME 0092. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 11, 2015
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 035624/0091 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2014
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 034293/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2011
From: SHPUNT, ALEXANDER; PESACH, BENNY
To: PRIMESENSE LTD.
Reel/Frame 027330/0637 →
Continuity (2)
Provisional Application 61419891 · Dec 6, 2010
Related Publication 20120140094A1 · Jun 7, 2012