Imaging device, image processing apparatus, and image processing method

1. An imaging device, comprising:

a semiconductor substrate;

a plurality of directive pixel output units on the semiconductor substrate, wherein

each directive pixel output unit of the plurality of directive pixel output units is configured to receive incident light from an imaging target without intervention of an imaging lens and a pinhole,

an angle of the incident light from the imaging target for each directive pixel output unit of the plurality of directive pixel output units is same,

each directive pixel output unit of the plurality of directive pixel output units is configured to independently set an incident angle directivity indicative of a directivity of a respective directive pixel output unit at an incident angle of the incident light, and

the incident angle directivity of each of the plurality of directive pixel output units is different; and

a plurality of non-directive pixel output units on the semiconductor substrate, wherein the plurality of non-directive pixel output units has no configuration for the incident angle directivity.

2. The imaging device according to claim 1 , wherein

each directive pixel output unit of the plurality of directive pixel output units is configured to output a first detection signal,

each non-directive pixel output unit of the plurality of non-directive pixel output units is configured to output a second detection signal, and

the imaging device is configured to:

generate a detection image based on the first detection signal output from the each directive pixel output unit, wherein the imaging target is absent in the detection image; and

generate a captured image based on the second detection signal output from the each non-directive pixel output unit, wherein the captured image includes the imaging target.

3. The imaging device according to claim 2 , wherein

a number of the plurality of directive pixel output units associated with the generation of the detection image coincide with a number of the plurality of non-directive pixel output units associated with the generation of the captured image, and

an angle of view of a restoration image coincides with an angle of view of the captured image, and

the restoration image is associated with the detection image.

4. The imaging device according to claim 1 , further comprising a rectangular region that includes the plurality of non-directive pixel output units.

5. The imaging device according to claim 4 , wherein the plurality of non-directive pixel output units is around the rectangular region.

6. The imaging device according to claim 1 , wherein each directive pixel output unit of the plurality of directive pixel output units includes:

a photodiode; and

a light shielding film, wherein the light shielding film is configured to shield the photodiode from incidence of a part of the incident light.

7. The imaging device according to claim 1 , wherein

each directive pixel output unit of the plurality of directive pixel output units includes a plurality of photodiodes, and

the each directive pixel output unit is configured to output a detection signal corresponding to a set of photodiodes of the plurality of photodiodes.

8. The imaging device according to claim 1 , wherein

the imaging device is configured to control a first output pixel value and a second output pixel value,

the first output pixel value is associated with a first directive pixel output unit of the plurality of directive pixel output units,

the second output pixel value is associated with a second directive pixel output unit of the plurality of directive pixel output units, and

the incident angle directivity to the incident light from the imaging target for the first output pixel value is different from the incident angle directivity of the second output pixel value based on the first output pixel value and the second output pixel value.

9. An image processing apparatus, comprising:

an imaging device that includes:

a semiconductor substrate;

a plurality of directive pixel output units on the semiconductor substrate, wherein

each directive pixel output unit of the plurality of directive pixel output units is configured to receive incident light from an imaging target without intervention of an imaging lens and a pinhole,

an angle of the incident light from the imaging target for each directive pixel output unit of the plurality of directive pixel output units is same, and

each directive pixel output unit of the plurality of directive pixel output units is configured to:

independently set an incident angle directivity indicative of a directivity of a respective directive pixel output unit at an incident angle of the incident light, wherein the incident angle directivity of each of the plurality of directive pixel output units is different; and

output a first detection signal; and

a plurality of non-directive pixel output units on the semiconductor substrate, wherein

the plurality of non-directive pixel output units has no configuration for the incident angle directivity, and

each non-directive pixel output unit of the plurality of non-directive pixel output units is configured to output a second detection signal; and

an image generation controlling section configured to control an output image generation process, wherein the output image generation process is controlled based on selective usage of:

the first detection signal output from the each directive pixel output unit, and

the second detection signal output from the each non-directive pixel output unit.

10. The image processing apparatus according to claim 9 , wherein

the imaging device further includes a specific region that includes the plurality of non-directive pixel output units.

11. The image processing apparatus according to claim 10 , wherein

the imaging device is further configured to:

generate a detection image based on the first detection signal output from the each directive pixel output unit; and

generate a captured image based on the second detection signal output from the each non-directive pixel output unit.

12. The image processing apparatus according to claim 9 , further comprising

an exposure controlling section configured to control exposure of the imaging device based on the second detection signal output from at least one non-directive pixel output unit of the plurality of non-directive pixel output units.

13. The image processing apparatus according to claim 12 , wherein

the exposure controlling section is further configured to control exposure of the plurality of directive pixel output units.

14. The image processing apparatus according to claim 9 , further comprising

an image processing section configured to restore a restoration image based on a detection image, wherein the detection image includes the first detection signal output from each directive pixel output unit of the plurality of directive pixel output units.

15. An image processing method, comprising:

controlling an output image generation process based on selective usage of:

a first detection signal output from each directive pixel output unit of a plurality of directive pixel output units of an imaging device, and

a second detection signal output from a plurality of non-directive pixel output units of the imaging device, wherein

the imaging device includes:

a semiconductor substrate;

the plurality of directive pixel output units on the semiconductor substrate, wherein

each directive pixel output unit of the plurality of directive pixel output units has a configuration for receiving incident light from an imaging target without intervention of an imaging lens and a pinhole,

an angle of the incident light from the imaging target for each directive pixel output unit of the plurality of directive pixel output units is same,

each directive pixel output unit of the plurality of directive pixel output units has a configuration to independently set an incident angle directivity,

the incident angle directivity of the each directive pixel output unit is indicative of a directivity of a respective directive pixel output unit at an incident angle of the incident light, and

the incident angle directivity of each of the plurality of directive pixel output units is different; and

the plurality of non-directive pixel output units on the semiconductor substrate, wherein the plurality of non-directive pixel output units has no configuration for providing the incident angle directivity.

16. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

controlling an output image generation process based on selective usage of:

a first detection signal output from each directive pixel output unit of a plurality of directive pixel output units of an imaging device, and

a second detection signal output from a plurality of non-directive pixel output units of the imaging device, wherein

the imaging device includes:

a semiconductor substrate;

the plurality of directive pixel output units on the semiconductor substrate, wherein

each directive pixel output unit of the plurality of directive pixel output units has a configuration for receiving incident light from an imaging target without intervention of an imaging lens and a pinhole,

an angle of the incident light from the imaging target for each directive pixel output unit of the plurality of directive pixel output units is same,

each directive pixel output unit of the plurality of directive pixel output units has a configuration to independently set an incident angle directivity, and

the incident angle directivity of the each directive pixel output unit is indicative of a directivity of a respective directive pixel output unit at an incident angle of the incident light, and

the incident angle directivity of each of the plurality of directive pixel output units is different; and

the plurality of non-directive pixel output units on the semiconductor substrate, wherein the plurality of non-directive pixel output units has no configuration for providing the incident angle directivity.