SYSTEMS, METHODS, AND MEDIA FOR RECONSTRUCTING A SPACE-TIME VOLUME FROM A CODED IMAGE
Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.
1 . A system for reconstructing a space-time volume from a coded image, comprising:
an image sensor that outputs image data; and
at least one processor that:
causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function;
receives the image data; and
performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.
2 . The system of claim 1 , wherein the reconstruction process is based on an over-complete dictionary.
3 . The system of claim 2 , wherein the over-complete dictionary is based on rotated video samples.
4 . The system of claim 1 , wherein the coded shutter function has random start times for pixel exposure bumps.
5 . The system of claim 1 , wherein the coded shutter function has only a single exposure period per pixel per sensor integration time.
6 . The system of claim 1 , wherein the coded shutter function has at least one pixel in each pixel neighborhood exposed during each interval of a sensor integration time.
7 . The system of claim 1 , further comprising a Liquid Crystal on Silicon chip that modulates light onto the image sensor according to the coded shutter function in response to signals from the at least one processor.
8 . The system of claim 1 , wherein the image sensor has pixels that individually addressable.
9 . The system of claim 1 , wherein the reconstruction process includes performing an orthogonal matching pursuit algorithm.
10 . A method for reconstructing a space-time volume from a coded image, comprising:
causing a projection of the space-time volume to be captured by an image sensor in a single image of image data in accordance with a coded shutter function using a hardware processor;
receiving the image data using a hardware processor; and
performing a reconstruction process on the image data to provide a space-time volume corresponding to the image data using a hardware processor.
11 . The method of claim 10 , wherein the reconstruction process is based on an over-complete dictionary.
12 . The method of claim 11 , wherein the over-complete dictionary is based on rotated video samples.
13 . The method of claim 10 , wherein the coded shutter function has random start times for pixel exposure bumps.
14 . The method of claim 10 , wherein the coded shutter function has only a single exposure period per pixel per sensor integration time.
15 . The method of claim 10 , wherein the coded shutter function has at least one pixel in each pixel neighborhood exposed during each interval of a sensor integration time.
16 . The method of claim 10 , further comprising modulating light onto the image sensor using an Liquid Crystal on Silicon chip according to the coded shutter function in response to signals from the hardware processor.
17 . The method of claim 10 , wherein the image sensor has pixels that are individually addressable.
18 . The method of claim 10 , wherein the reconstruction process includes performing an orthogonal matching pursuit algorithm.
19 . A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for reconstructing a space-time volume from a coded image, the method comprising:
causing a projection of the space-time volume to be captured in a single image of image data in accordance with a coded shutter function;
receiving the image data; and
performing a reconstruction process on the image data to provide a space-time volume corresponding to the image data.
20 . The non-transitory computer-readable medium of claim 19 , wherein the reconstruction process is based on an over-complete dictionary.
21 . The non-transitory computer-readable medium of claim 20 , wherein the over-complete dictionary is based on rotated video samples.
22 . The non-transitory computer-readable medium of claim 19 , wherein the coded shutter function has random start times for pixel exposure bumps.
23 . The non-transitory computer-readable medium of claim 19 , wherein the coded shutter function has only a single exposure period per pixel per sensor integration time.
24 . The non-transitory computer-readable medium of claim 19 , wherein the coded shutter function has at least one pixel in each pixel neighborhood exposed during each interval of a sensor integration time.
25 . The non-transitory computer-readable medium of claim 19 , wherein the method further comprises modulating light onto the image sensor according to the coded shutter function.
26 . The non-transitory computer-readable medium of claim 19 , wherein the method further comprises individually addressing pixels of an image sensor.
27 . The non-transitory computer-readable medium of claim 19 , wherein the reconstruction process includes performing an orthogonal matching pursuit algorithm.