Image sensor, imaging apparatus, electronic device, image processing system, and signal processing method

1. An image sensor, comprising:

a filter array, comprising a plurality of first sets of filters and a plurality of second sets of filters, each of the plurality of first sets of filters comprising a plurality of first color filters and a plurality of second color filters, a number of first color filters and a number of second color filters being same in each of the plurality of first sets of filters, and each of the plurality of second sets of filters comprising a plurality of first color filters and a plurality of third color filters, a number of first color filters and a number of third color filters being same in each of the plurality of second sets of filters; and

a pixel array, comprising a plurality of pixels each corresponding to one filter in the filter array and configured to receive light passing through the corresponding filter to generate an electrical signal,

wherein the image sensor is configured to combine the electrical signals generated by the pixels corresponding to each of the plurality of first sets of filters to generate a first pixel signal and a third pixel signal, the first pixel signal representing a value in a first color channel of the light applied to the pixels corresponding to the first set of filters, and the third pixel signal representing a value in a second color channel of the light applied to the pixels corresponding to the first set of filters, and the image sensor is configured to combine the electrical signals generated by the pixels corresponding to each of the plurality of second sets of filters to generate a second pixel signal and a fourth pixel signal, the second pixel signal representing a value in the first color channel of the light applied to the pixels corresponding to the second set of filters, and the fourth pixel signal representing a value in a third color channel of the light applied to the pixels corresponding to the second set of filters.

2. The image sensor according to claim 1 , wherein the number of filters in each of the plurality of first sets of filters is N*N, and the number of filters in each of the plurality of second sets of filters is N*N, where N is an integer greater than or equal to 2.

3. The image sensor according to claim 1 , wherein each first color filter is a green filter or a yellow filter, each second color filter is a red filter, and each third color filter is a blue filter.

4. The image sensor according to claim 1 , wherein the plurality of first sets of filters are arranged in a first diagonal direction, and the plurality of second sets of filters are arranged in a second diagonal direction different from the first diagonal direction.

5. The image sensor according to claim 1 , wherein

in each of the plurality of first sets of filters, the plurality of first color filters and the plurality of second color filters are arranged adjacently to each other in a vertical direction and a horizontal direction of the image sensor, and

in each of the plurality of second sets of filters, the plurality of first color filters and the plurality of third color filters are arranged adjacently to each other in the vertical direction and the horizontal direction of the image sensor.

6. The image sensor according to claim 1 , wherein

in each of the plurality of first sets of filters, the filters are arranged in rows and the filters in each row have a same color,

in each of the plurality of first sets of filters, the filters are arranged in columns and the filters in each column have a same color,

in each of the plurality of second sets of filters, the filters are arranged in rows and the filters in each row have a same color, or

in each of the plurality of second sets of filters, the filters are arranged in columns and the filters in each column have a same color.

7. The image sensor according to claim 1 , further comprising a microlens array, the microlens array comprising a plurality of sets of microlenses, wherein each of the plurality of sets of microlenses comprises a plurality of microlenses each corresponding to one filter and one pixel.

8. The image sensor according to claim 1 , further comprising a microlens array, the microlens array comprising a plurality of sets of microlenses, wherein each of the plurality of sets of microlenses comprises one microlens corresponding to one set of filters and to the pixels corresponding to the one set of filters.

9. The image sensor according to claim 1 , wherein the image sensor is further configured to process the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal to output an image signal, the image signal comprising a plurality of image signal units each comprising four pixel signals, of which two pixel signals each have a value in the first color channel, one pixel signal has a value in the second color channel, one pixel signal has a value in the third color channel, wherein the color channels corresponding to the four pixel signals are arranged in a Bayer array.

10. An image sensor, comprising:

a filter array, provided on a pixel array, the filter array comprising a plurality of first sets of filters and a plurality of second sets of filters, each of the plurality of first sets of filters comprising a plurality of first color filters and a plurality of second color filters, a number of first color filters and a number of second color filters being same in each of the plurality of first sets of filters, and each of the plurality of second sets of filters comprising a plurality of first color filters and a plurality of third color filters, a number of first color filters and a number of third color filters being same in each of the plurality of second sets of filters; and

a control circuit, provided on a substrate with the pixel array, and configured to combine electrical signals generated by pixels corresponding to each of the plurality of first sets of filters to generate a first pixel signal and a third pixel signal, the first pixel signal representing a value in a first color channel of light applied to the pixels corresponding to the first set of filters, and the third pixel signal representing a value in a second color channel of light applied to the pixels corresponding to the first set of filters, and the control circuit is configured to combine electrical signals generated by pixels corresponding to each of the plurality of second sets of filters to generate a second pixel signal and a fourth pixel signal, the second pixel signal representing a value in the first color channel of light applied to the pixels corresponding to the second set of filters, and the fourth pixel signal representing a value in a third color channel of light applied to the pixels corresponding to the second set of filters.

11. A signal processing method, applied in an image sensor, the image sensor comprising:

a filter array, comprising a plurality of first sets of filters and a plurality of second sets of filters, each of the plurality of first sets of filters comprising a plurality of first color filters and a plurality of second color filters, a number of first color filters and a number of second color filters being same in each of the plurality of first sets of filters, and each of the plurality of second sets of filters comprising a plurality of first color filters and a plurality of third color filters, a number of first color filters and a number of third color filters being same in each of the plurality of second sets of filters; and

a pixel array, comprising a plurality of pixels each corresponding to one filter in the filter array and configured to receive light passing through the corresponding filter to generate an electrical signal;

the signal processing method comprising:

combining the electrical signals generated by the pixels corresponding to each of the plurality of first sets of filters to generate a first pixel signal and a third pixel signal, the first pixel signal representing a value in a first color channel of the light applied to the pixels corresponding to the first set of filters, and the third pixel signal representing a value in a second color channel of the light applied to the pixels corresponding to the first set of filters; and

combining the electrical signals generated by the pixels corresponding to each of the plurality of second sets of filters to generate a second pixel signal and a fourth pixel signal, the second pixel signal representing a value in the first color channel of the light applied to the pixels corresponding to the second set of filters, and the fourth pixel signal representing a value in a third color channel of the light applied to the pixels corresponding to the second set of filters.

12. The signal processing method according to claim 11 , further comprising:

processing the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal to generate a color image.

13. The signal processing method according to claim 12 , wherein a plurality of first pixel signals and a plurality of second pixel signals form a first image signal, a plurality of third pixel signals form a second image signal, and a plurality of fourth pixel signals form a third image signal, and said processing the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal to generate the color image comprises:

performing an interpolation process on the second image signal based on the plurality of third pixel signals, such that each pixel signal in the second image signal after the interpolation process has a value in the second color channel;

performing an interpolation process on the third image signal based on the plurality of fourth pixel signals, such that each pixel signal in the third image signal after the interpolation process has a value in the third color channel; and

processing the first image signal, the second image signal after the interpolation process, and the third image signal after the interpolation process to generate the color image.

14. The signal processing method according to claim 12 , further comprising:

processing the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal to output an image signal, the image signal comprising a plurality of image signal units each comprising four pixel signals, of which two pixel signals each have a value in the first color channel, one pixel signal has a value in the second color channel, one pixel signal has a value in the third color channel, wherein the color channels corresponding to the four pixel signals are arranged in a Bayer array.