Systems and methods for compressive light sensing using multiple spatial light modulators

1. A method for capturing light field information including spatial and angular information using an image pickup device that includes an image sensor and at least one spatial light modulator (SLM), the method comprising:

taking multiple captures of a scene using at least one SLM to obtain coded projections of a light field from the scene, wherein each capture is taken using at least one pattern on the at least one SLM, and wherein the at least one SLM modulates light from the scene; and

recovering light field data using a reconstruction process on the obtained coded projections of the light field,

wherein the reconstruction process uses L-1 minimization on the obtained coded projections to recover the light field data.

2. The method according to claim 1 , wherein each pattern on the at least one SLM is a random pattern.

3. The method according to claim 1 , wherein each pattern on the at least one SLM is determined based on a particular scene to be captured.

4. The method according to claim 1 , wherein each pattern on the at least one SLM is determined based on previously collected images of the scene being captured.

5. The method according to claim 1 , wherein each pattern on the at least one SLM comprises an opaque section and a transparent section.

6. A system for capturing images, the system comprising:

one or more spatial light modulators, wherein each spatial light modulator is configurable into a respective pattern, and wherein each of the spatial light modulators is configured to modulate light from a scene;

a first image sensor that includes one or more pixels; and

one or more processors configured to cause the system to

configure the one or more spatial light modulators into respective patterns, wherein each spatial light modulator is configured into a respective random pattern,

capture coded projections of a light field from the scene using the one or more spatial light modulators and the first image sensor, wherein the respective random pattern of each spatial light modulator used to capture a coded projection is different than the respective random pattern used to capture a previous coded projection, and

generate a representation of the light field using a reconstruction process on the captured coded projections of the light field.

7. The system of claim 6 , further comprising:

a redirector configured to split the light field into a first light field and a second light field; and

a second image sensor,

wherein the first light field passes through a first group of spatial light modulators of the one or more spatial light modulators to the first image sensor and the second light field passes through a second group of spatial light modulators of the one or more spatial light modulators to the second image sensor, and

wherein the one or more processors are further configured to cause the system to capture coded projections of the light field of the scene using the one or more spatial light modulators, the first image sensor, and the second image sensor.

8. The system of claim 7 , wherein the one or more processors are further configured to cause the system to simultaneously capture coded projections of the first light field and coded projections of the second light field, and wherein the coded projections of the light field comprise coded projections of the first light field and coded projections of the second light field.

9. The system of claim 6 , wherein the light field does not pass through a lens between the scene and the first image sensor.

10. The system of claim 6 , wherein the system comprises two or more spatial light modulators,

wherein a distance between any two spatial light modulators is adjustable by the system, and

wherein the one or more processors are further configured to cause the system to adjust a distance between two spatial light modulators.

11. The system of claim 6 , wherein the reconstruction process includes determining a measurement matrix based on the respective patterns of the one or more spatial light modulators used to capture the coded projections.

12. A system for capturing images, the system comprising:

a plurality of spatial light modulators, wherein each spatial light modulator is configurable into a respective pattern, and wherein each spatial light modulator is configured to modulate light from a scene;

a first image sensor that is configured to capture coded projections of a light field from the scene that has passed through the plurality of spatial light modulators, wherein the first image sensor includes one or more pixels; and

one or more processors, wherein the one or more processors are configured to generate an array of patterns corresponding to the plurality of spatial light modulators, and wherein the one or more processors are configured to generate a sequence of arrays of patterns, wherein a number of the arrays of patterns in the sequence corresponds to a number of coded projections to be captured.

13. The system of claim 12 , wherein the spatial light modulators of the plurality of spatial light modulators are configured with one or more random patterns.

14. The system of claim 12 , further comprising a user input device, wherein the user input device is configured to receive a user selection of one or more patterns.

15. The system of claim 12 , wherein a distance between any two spatial light modulators is adjustable by the system.

16. The method according to claim 1 , wherein the at least one SLM is disposed between the scene and the image sensor.

17. The system of claim 6 , wherein the one or more spatial light modulators are disposed between the scene and the first image sensor.

18. The system of claim 12 , wherein the plurality of spatial light modulators is disposed between the scene and the first image sensor.