Imaging device including pixels having individually settable incident angle directivity
The present technology relates to an imaging device and method, and an image processing device and method that can more easily suppress unauthorized use and tampering of an image. An object is imaged by an imaging element including a plurality of pixel output units that receives incident light entering without passing through either an imaging lens or a pinhole, and that each outputs one detection signal indicating an output pixel value modulated by an incident angle of the incident light, and a detection image obtained by the imaging and formed by a detection signal obtained in the pixel output units of the imaging element is output without associating with a restoration matrix including coefficients used when a restored image is restored from the detection image. The present disclosure can be applied to, for example, an imaging device, an image processing device, an information processing device, an electronic device, a computer, a program, a storage medium, a system, and the like.
1. An imaging device, comprising:
an imaging element that includes a plurality of pixels, each pixel having a photodetector and a light-receiving surface, and receiving incident light entering without passing through either a single imaging lens that directs light to two or more of the plurality of pixels or a pinhole, and outputting a detection signal indicating an output pixel value optically modulated according to an incident angle of the incident light, wherein each pixel of the plurality of pixels has an independently configurable light shielding layer formed on the light-receiving surface of the pixel to block the incident light such that an incident angle directivity, indicating a directivity of the output pixel value with respect to an incident angle of incident light from an object, is independently settable for the pixel; and
output processing circuitry configured to output a detection image formed by detection signals obtained from the plurality of pixels of the imaging element, without using a restoration matrix including coefficients used when the detection image is restored to form a restored image.
2. The imaging device according to claim 1 , wherein
each pixel of the plurality of pixels has a configuration in which, by having different photodiodes (PD) from each other that contribute to an output of the pixel, the incident angle directivity indicating the directivity of the output pixel value respect to the incident angle of incident light from the object is independently settable in each of the plurality of pixels.
3. The imaging device according to claim 1 , further comprising
readout control circuitry configured to control reading out of the detection signal from each pixel of the plurality of pixels of the imaging element, and regularly or irregularly switch the pixel from which the detection signal is read out.
4. The imaging device according to claim 1 , further comprising
a restoration matrix selling circuit configured to set the restoration matrix when a predetermined condition is satisfied, wherein
the output processing circuitry is further configured to output the restoration matrix set by the restoration matrix setting circuit.
5. The imaging device according to claim 4 , further comprising
an encryption circuit that encrypts the restoration matrix set by the restoration matrix setting circuit, wherein
the output processing circuitry is further configured to output the restoration matrix encrypted by the encryption circuit.
6. The imaging device according to claim 1 , wherein
the detection image output by the output processing circuitry is an image in which an object is visually unrecognizable, and
the restored image is an image in which the object is visually recognizable.
7. The imaging device according to claim 1 , further comprising
a restoration circuit configured to generate the restored image from the detection image using the restoration matrix, wherein
the output processing circuitry is further configured to display the restored image generated by the restoration circuit.
8. An imaging method, comprising:
imaging an object by an imaging element including a plurality of pixels, each pixel having a photodetector and a light-receiving surface, and receiving incident light entering without passing through either a single imaging lens that directs light to two or more of the plurality of pixels or a pinhole, and outputting a detection signal indicating an output pixel value optically modulated according to an incident angle of the incident light, wherein each pixel of the plurality of pixels has an independently configurable light shielding layer formed on the light-receiving surface of the pixel to block the incident light such that an incident angle directivity, indicating a directivity of the output pixel value with respect to an incident angle of incident light from an object, is independently settable for the pixel; and
outputting a detection image obtained by the imaging and formed by detection signals obtained from the plurality of pixels of the imaging element, without using a restoration matrix including coefficients used when the detection image is restored to form a restored image.
9. An image processing device, comprising:
restoration circuitry configured to generate a restored image from a detection image obtained by an external device using a restoration matrix that includes coefficients used when the restored image is generated from the detection image, which is obtained by imaging an object with an imaging element, the imaging element including a plurality of pixels, and is formed by detection signals obtained from the plurality of pixels,
each of the plurality of pixels having a photodetector and a light-receiving surface, and receiving incident light entering without passing through either a single imaging lens that directs light to two or more of the plurality of pixels or a pinhole, and outputting a detection signal indicating an output pixel value optically modulated according to an incident angle of the incident light,
wherein each pixel of the plurality of pixels has an independently configurable light shielding layer formed on the light-receiving surface of the pixel to block the incident light such that an incident angle directivity, indicating a directivity of the output pixel value with respect to an incident angle of incident light from an object, is independently settable for the pixel.
10. The image processing device according to claim 9 , further comprising
a restoration matrix setting circuit configured to set a restoration matrix used to generate the restored image by the restoration circuitry, wherein
the restoration circuitry is further configured to generate the restored image from the detection image using the restoration matrix set by the restoration matrix setting circuit.
11. The image processing device according to claim 10 , wherein the restoration matrix setting circuit is further configured to regularly or irregularly switch the restoration matrix used to generate the restored image.
12. The image processing device according to claim 10 , wherein the restoration matrix setting circuit is further configured to generate the restoration matrix used to generate the restored image.
13. The image processing device according to claim 10 , further comprising a restoration matrix memory that stores candidate restoration matrices, wherein
the restoration matrix setting circuit is further configured to set the restoration matrix used to generate the restored image from the restoration matrices stored in the restoration matrix memory.
14. The image processing device according to claim 13 , further comprising a restoration matrix communication circuit configured to obtain a restoration matrix from the external device by communication, wherein
the restoration matrix memory stores the restoration matrix obtained by the restoration matrix communication circuit.
15. The image processing device according to claim 14 , further comprising a decryption circuit configured to decrypt an encrypted restoration matrix obtained by the restoration matrix communication circuit, wherein
the restoration matrix memory stores the restoration matrix decrypted by the decryption circuit.
16. The image processing device according to claim 15 , wherein the restoration matrix communication circuit is further configured to obtain an encrypted restoration matrix associated with the detection image.
17. The image processing device according to claim 14 , further comprising an authentication circuit configured to perform an authentication process of itself for the external device, wherein
the restoration matrix communication circuit is further configured to obtain a restoration matrix from the external device when authentication by the authentication circuit is successful.
18. An image processing method, comprising:
generating a restored image from a detection image obtained by an external device using a restoration matrix that includes coefficients used when the restored image is generated from the detection image, which is obtained by imaging an object with an imaging element, the imaging element including a plurality of pixels, and is formed by detection signals obtained from the plurality of pixels,
each of the plurality of pixels having a photodetector and a light-receiving surface, and receiving incident light entering without passing through either a single imaging lens that directs light to two or more of the plurality of pixels or a pinhole, and outputting a detection signal indicating an output pixel value optically modulated according to an incident angle of the incident light,
wherein each pixel of the plurality of pixels has an independently configurable light shielding layer formed on the light-receiving surface of the pixel to block the incident light such that an incident angle directivity, indicating a directivity of the output pixel value with respect to an incident angle of incident light from an object, is independently settable for the pixel.