IP Library Granted Patent US 10,033,986
Granted Patent B2
US 10,033,986 · App. 15/142,565 · Granted Jul 24, 2018

Capturing light-field images with uneven and/or incomplete angular sampling

Inventors: Colvin Pitts (Snohomish, WA); Chia-Kai Liang (San Jose, CA); Kurt Akeley (Saratoga, CA)
Assignee: Google LLC
H04N13/0228G02B3/005G02B3/0056H04N13/0018H04N13/0217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,033,986
App. No.
15/142,565
Granted
Jul 24, 2018
Kind
B2
Abstract

A light-field camera may generate four-dimensional light-field data indicative of incoming light. The light-field camera may have an aperture configured to receive the incoming light, an image sensor, and a microlens array configured to redirect the incoming light at the image sensor. The image sensor may receive the incoming light and, based on the incoming light, generate the four-dimensional light-field data, which may have first and second spatial dimensions and first and second angular dimensions. The first angular dimension may have a first resolution higher than a second resolution of the second angular dimension.

Claims (80)

1. A light-field camera for generating four-dimensional light-field data, the light-field camera comprising:

an aperture configured to receive incoming light;

an image sensor; and

a microlens array configured to redirect the incoming light at the image sensor;

wherein the image sensor is configured to receive the incoming light and, based on the incoming light, to generate four-dimensional light-field data comprising a first spatial dimension, a second spatial dimension, a first angular dimension, and a second angular dimension;

wherein the first angular dimension of a captured image has a first resolution larger than a second resolution of the second angular dimension of the captured image.

2. The light-field camera of claim 1 , wherein the aperture comprises an exit pupil comprising a length and a width;

wherein the length is larger than the width.

3. The light-field camera of claim 2 , wherein the length is at least twice as large as the width.

4. The light-field camera of claim 2 , wherein the length is at least four times as large as the width.

5. The light-field camera of claim 1 , wherein:

the microlens array comprises a plurality of microlenses, each of which redirects a portion of the incoming light to a portion of the image sensor to generate a segment of the four-dimensional light-field data; and

the aperture comprises an exit pupil that is shaped and oriented, relative to the microlens array, such that the portions of the image sensor define a tessellated pattern on the image sensor.

6. The light-field camera of claim 5 , wherein the microlens array is oriented, relative to the exit pupil, to provide an MLA-to-exit pupil rotation that is not equal to 0°.

7. The light-field camera of claim 1 , wherein:

the aperture comprises an exit pupil comprising a discontinuous shape having a length and a width; and

the discontinuous shape comprises a plurality of sections displaced from each other along the width.

8. The light-field camera of claim 7 , wherein:

the plurality of sections comprises a first rectangular section and a second rectangular section, each of which has a width; and

the first rectangular section is displaced from the second rectangular section by a distance equal to two times the width.

9. The light-field camera of claim 7 , wherein the plurality of sections are further displaced from each other along the length.

10. The light-field camera of claim 7 , wherein:

the microlens array comprises a plurality of microlenses, each of which redirects a portion of the incoming light to a portion of the image sensor to generate a segment of the four-dimensional light-field data; and

the sections are displaced from each other such that the sections from neighboring microlenses of the microlens array interdigitate to define a tessellated pattern on the image sensor.

11. The light-field camera of claim 1 , wherein the microlens array comprises a plurality of microlenses arranged in a hexagonal packing.

12. The light-field camera of claim 1 , wherein the microlens array comprises a plurality of microlenses arranged in a rectangular packing.

13. The light-field camera of claim 1 , further comprising a main lens through which the incoming light passes prior to redirection of the incoming light by the microlens array;

wherein the main lens comprises an anamorphic shape.

14. The light-field camera of claim 1 , wherein:

the microlens array comprises a plurality of microlenses, each of which redirects a portion of the incoming light to a portion of the image sensor to generate a segment of the four-dimensional light-field data; and

wherein each of the microlenses comprises a cylindrical shape.

15. The light-field camera of claim 1 , further comprising a masking system configured to position at least one of a plurality of masks proximate the aperture;

wherein the masks define a plurality of exit pupils having a plurality of different shapes, each of which defines an exit pupil for the aperture.

16. The light-field camera of claim 15 , wherein each exit pupil of the plurality of exit pupils has the same area through which the incoming light can enter the light-field camera.

17. A method for generating four-dimensional light-field data, through use of a light-field camera, the method comprising:

at an aperture of the light-field camera, receiving incoming light;

at a microlens array of the light-field camera, redirecting the incoming light at an image sensor of the light-field camera;

at the image sensor:

receiving the incoming light; and

based on the incoming light, generating four-dimensional light-field data comprising a first spatial dimension, a second spatial dimension, a first angular dimension, and a second angular dimension;

wherein the first angular dimension of a captured image has a first resolution larger than a second resolution of the second angular dimension of the captured image.

18. The method of claim 17 , wherein the aperture comprises an exit pupil comprising a length and a width;

wherein the length is larger than the width.

19. The method of claim 17 , wherein:

the microlens array comprises a plurality of microlenses; and

the aperture comprises an exit pupil;

wherein redirecting the incoming light at the image sensor comprises, with each of the plurality of microlenses, redirecting a portion of the incoming light to a portion of the image sensor to generate a segment of the four-dimensional light-field data;

and wherein the exit pupil is shaped and oriented, relative to the microlens array, such that the portions of the image sensor define a tessellated pattern on the image sensor.

20. The method of claim 19 , wherein the microlens array is oriented, relative to the exit pupil, to provide an MLA-to-exit pupil rotation that is not equal to 0°.

21. The method of claim 17 , wherein:

the aperture comprises an exit pupil comprising a discontinuous shape having a length and a width; and

the discontinuous shape comprises a plurality of sections displaced from each other along the width;

wherein receiving the incoming light at the aperture comprises passing the incoming light through each of the plurality of sections.

22. The method of claim 21 , wherein:

the microlens array comprises a plurality of microlenses;

redirecting the incoming light at the image sensor comprises, with each of the plurality of microlenses, redirecting a portion of the incoming light to a portion of the image sensor to generate a segment of the four-dimensional light-field data; and

redirecting the incoming light at the image sensor further comprises causing the sections from neighboring microlenses of the microlens array to interdigitate to define a tessellated pattern on the image sensor.

23. The method of claim 17 , further comprising, prior to redirection of the incoming light by the microlens array, causing the incoming light to pass through a main lens comprising an anamorphic shape.

24. The method of claim 17 , wherein:

the microlens array comprises a plurality of microlenses;

redirecting the incoming light at the image sensor comprises, with each of the plurality of microlenses, redirecting a portion of the incoming light to a portion of the image sensor to generate a segment of the four-dimensional light-field data; and

each of the microlenses comprises a cylindrical shape.

25. The method of claim 17 , further comprising, with a masking system, positioning at least one of a plurality of masks proximate the aperture;

wherein the masks define a plurality of exit pupils having a plurality of different shapes, each of which defines an exit pupil for the aperture.

26. A light-field camera for generating four-dimensional light-field data, the light-field camera comprising:

an aperture configured to receive incoming light;

an image sensor; and

a microlens array configured to redirect the incoming light at the image sensor;

wherein the image sensor is configured to receive the incoming light and, based on the incoming light, to generate four-dimensional light-field data comprising a first spatial dimension, a second spatial dimension, a first angular dimension, and a second angular dimension, wherein the first angular dimension of the light-field data has a first resolution larger than a second resolution of the second angular dimension of the light-field data;

wherein the microlens array comprises a plurality of microlenses, each of which redirects a portion of the incoming light to a portion of the image sensor to generate a segment of the four-dimensional light-field data;

and wherein the aperture comprises an exit pupil comprising a length and a width;

wherein the length is larger than the width;

wherein the exit pupil is further shaped and oriented, relative to the microlens array, such that the portions of the image sensor define a tessellated pattern on the image sensor.

27. The light-field camera of claim 26 , wherein the microlens array is oriented, relative to the exit pupil, to provide an MLA-to-exit pupil rotation that is not equal to 0°.

28. The light-field camera of claim 26 , wherein:

the aperture comprises an exit pupil comprising a discontinuous shape having a length and a width;

the discontinuous shape comprises a plurality of sections displaced from each other along the width; and

the sections are displaced from each other such that the sections from neighboring microlenses of the microlens array interdigitate to define a tessellated pattern on the image sensor.

29. The light-field camera of claim 26 , further comprising a masking system configured to position at least one of a plurality of masks proximate the aperture;

wherein the masks define a plurality of exit pupils having a plurality of different shapes, each of which defines an exit pupil for the aperture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2019
From: LYTRO, INC.
To: GOOGLE LLC
Reel/Frame 050009/0829 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2016
From: PITTS, COLVIN; LIANG, CHIA-KAI; AKELEY, KURT
To: LYTRO, INC.
Reel/Frame 038422/0560 →
Continuity (2)
Provisional Application 62166595 · May 26, 2015
Related Publication 20160353082A1 · Dec 1, 2016