Feature extraction element, feature extraction system, and determination apparatus

1. A feature extracting element, comprising:

a light-receiving substrate where a plurality of light-receiving elements for photoelectrically converting received light are two-dimensionally arrayed; and

one or more other substrates that are laminated on the light-receiving substrate, wherein the one or more other substrates have:

an AD conversion circuit substrate to receive signals generated by the plurality of light-receiving elements and to convert the signals received from the plurality of light-receiving elements;

a convolution processor, connected to the light-receiving substrate via the AD conversion circuit substrate, having a plurality of multiplying circuits that are correspondingly provided per the light-receiving element or per a block that is configured of more than one light-receiving element among the plurality of the light-receiving elements, and performs a convolution operation using the plurality of multiplying circuits on the signals that are output from the AD conversion circuit substrate directly to the plurality of multiplying circuits; and

a pooling circuit to sample a signal that is output from the convolution processor, based on a predetermined condition.

2. The feature extracting element according to claim 1 , further comprising:

a connection wiring to pass the signal that is sampled to the plurality of multiplying circuits,

wherein

the convolution processor and the pooling circuit each are provided in substrates different from each other, among the plurality of other substrates, and

the connection wiring includes a through-electrode to connect the substrates different from each other.

3. The feature extracting element according to claim 1 , having:

a plurality of multiplying circuit substrates that are laminated on each other as the other substrates, and

wherein

the plurality of multiplying circuits are provided in multiplying circuit substrates that are different from each other, among the plurality of multiplying circuit substrates.

4. The feature extracting element according to claim 3 , wherein filter coefficients being different from each other for the convolution operation are set for the plurality of multiplying circuit substrates.

5. The feature extracting element according to claim 1 , wherein

the convolution processor has an adding circuit to sum up outputs from the plurality of multiplying circuits that are respectively provided corresponding to the plurality of light-receiving elements; and

the adding circuit is provided in an adding circuit substrate that falls in the one or more other substrates.

6. The feature extracting element according to claim 1 , further comprising:

a connection wiring to pass the signal that is sampled to the plurality of multiplying circuits;

a latch circuit to hold a signal from at least one light-receiving element among the plurality of light-receiving elements; and

a read-out circuit to read out the signal from the at least one light-receiving element, wherein

the read-out circuit is provided in a read-out substrate that falls in the one or more other substrates, and

the connection wiring connects between the pooling circuit and the latch circuit.

7. The feature extracting element according to claim 1 , wherein the one or more other substrates have an activation function calculation processing unit to input, to an activation function, a signal on which the convolution operation is performed to output a resultant output signal to the pooling circuit.

8. The feature extracting element according to claim 1 , wherein signals output from the plurality of light-receiving elements are output to outside.

9. A feature extracting system, comprising:

the feature extracting element according to claim 1 ; and

a controller to control such that the convolution operation of the convolution processor and the sampling of the pooling circuit are repeated, wherein

the controller controls, when the convolution operation is repeated, the convolution processor such that predetermined filter coefficients are respectively used.

10. A judging apparatus, comprising:

the feature extracting element according to claim 1 ; and

a controller to judge an image-capturing target by a feature quantity that is extracted based on an output from the pooling circuit.

11. A feature extracting element, comprising:

a light-receiving substrate where a plurality of light-receiving elements for photoelectrically converting received light are two-dimensionally arrayed; and

one or more other substrates that are laminated on the light-receiving substrate, wherein the one or more other substrates have:

a convolution processor which has a plurality of multiplying circuits that are correspondingly provided per the light-receiving element or per a block that is configured of the plurality of the light-receiving elements, and performs a convolution operation on signals that are output from the plurality of light-receiving elements using the plurality of multiplying circuits; and

a pooling circuit to sample a signal that is output from the convolution processor, based on a predetermined condition,

wherein

the convolution processor and the pooling circuit each are provided in substrates different from each other, among the plurality of other substrates.

12. A feature extracting element, comprising:

a light-receiving substrate where a plurality of light-receiving elements for photoelectrically converting received light are two-dimensionally arrayed; and

one or more other substrates that are laminated on the light-receiving substrate, wherein the one or more other substrates have:

a convolution processor which has a plurality of multiplying circuits that are correspondingly provided per the light-receiving element or per a block that is configured of the plurality of the light-receiving elements, and performs a convolution operation on signals that are output from the plurality of light-receiving elements using the plurality of multiplying circuits, and

a pooling circuit to sample a signal that is output from the convolution processor, based on a predetermined condition,

wherein

the one or more other substrates include a plurality of multiplying circuit substrates laminated on each other, and

the plurality of multiplying circuits are provided in multiplying circuit substrates that are different from each other, among the plurality of multiplying circuit substrates.

13. A feature extracting system, comprising:

a feature extracting element, including:

a light-receiving substrate where a plurality of light-receiving elements for photoelectrically converting received light are two-dimensionally arrayed, and

one or more other substrates that are laminated on the light-receiving substrate, wherein the one or more other substrates have:

a convolution processor which has a plurality of multiplying circuits that are correspondingly provided per the light-receiving element or per a block that is configured of the plurality of the light-receiving elements, and performs a convolution operation on signals that are output from the plurality of light-receiving elements using the plurality of multiplying circuits, and

a pooling circuit to sample a signal that is output from the convolution processor, based on a predetermined condition; and

a controller to control such that the convolution operation of the convolution processor and the sampling of the pooling circuit are repeated, wherein

the controller controls, when the convolution operation is repeated, the convolution processor such that different filter coefficients are respectively used.