Image sensor, method for operating an image sensor, method for manufacturing an image sensor, and stationary device or vehicle or drone having an image sensor
Embodiments of the invention provide an image sensor image sensor including an image sensor structure. The image sensor structure includes a multitude of image elements arranged in a grid-shaped manner in a first direction and in a second direction orthogonal to the first direction. An image element of the multitude of image elements includes a plurality of filter elements spatially arranged side by side. The plurality of filter elements includes at least one color filter and at least one additional filter from a filter group. The filter group includes a first absorption filter with a first optical bandwidth, a second absorption filter with a second optical bandwidth different from the first optical bandwidth, a first polarization filter with a first polarization characteristic, a second polarization filter with a second polarization characteristic different from the first polarization characteristic, and a filter element without absorption effect or polarization effect.
1 . Image sensor comprising:
an image sensor structure comprising a multitude of image elements arranged in a grid-shaped manner in a first direction and in a second direction orthogonal to the first direction,
wherein each image element of the multitude of image elements comprises a first stack of filter elements and a second stack of filter elements, wherein the second stack of filter elements is arranged side by side with the first stack of filter elements in the first direction,
wherein each one of the first stack of filter elements and the second stack of filter elements comprises a plurality of filter elements spatially arranged side by side,
wherein the plurality of filter elements of the first stack of filter elements and the plurality of filter elements of the second stack of filter elements are extended in a flat structure in which filter elements of the first stack of filter elements and filter elements of the second stack of filter elements are arranged in one line or in two lines,
wherein the first stack of filter elements comprises at least a first color filter, a second color filter, and a third color filter, wherein the third color filter is different from the first color filter and the second color filter, and wherein the first color filter is different from the second color filter,
wherein the second stack of filter elements comprises a first absorption filter with a first optical bandwidth, wherein the first optical bandwidth is selected from a spectral range of between 900 nm and 1200 nm, a second absorption filter with a second optical bandwidth, wherein the second optical bandwidth is selected from a spectral range of between 400 nm and 900 nm and is different from the first optical bandwidth, a first polarization filter with a first polarization characteristic, and a second polarization filter with a second polarization characteristic different from the first polarization characteristic,
wherein the first absorption filter and the second absorption filter have optical bandwidths in which water has different absorption rates in order to detect water on a road surface, and
wherein the first polarization filter with a first polarization characteristic, and the second polarization filter with the second polarization characteristic have different polarization characteristics in order to differentiate between water, snow, and black ice.
2 . Vehicle, comprising:
a vehicle front side directed towards a road surface in a driving direction of the vehicle and extending upwards with respect to the road surface; and
an image sensor according to claim 1 , attached at the vehicle front side in an upper area of the vehicle front side and oriented in the driving direction.
3 . The vehicle according to claim 2 , wherein the image sensor is arranged such that the first direction of the image sensor structure is arranged transversally to the driving direction, and such that the second direction of the image sensor structure is arranged longitudinally to the driving direction, wherein the second stack is placed adjacent to the first stack in the first direction being transversally to the driving direction.
4 . Stationary device, comprising:
a front side directed towards a road surface in a driving direction of a vehicle and extending upwards with respect to the road surface; and
an image sensor according to claim 1 , attached at the front side in an upper area of the front side and oriented to the driving direction.
5 . The stationary device according to claim 4 , wherein the image sensor is arranged such that the first direction of the image sensor structure is arranged transversally to the driving direction, and such that the second direction of the image sensor structure is arranged longitudinally to the driving direction, wherein the second stack is placed adjacent to the first stack in the first direction being transversally to the driving direction.
6 . The stationary device according to claim 4 , wherein the stationary device further comprises a processor, and a display,
wherein the processor is configured to estimate a state of the road surface on the basis of a sensor recording of the image sensor; and
wherein the display is configured to inform a driver of the vehicle about the state of the road surface, or to inform a driver of the vehicle about a dangerous state of the road surface.
7 . The stationary device according to claim 4 , wherein the stationary device is configured to inform a remote server about a state of the road surface, or to inform a remote server about a dangerous state of the road surface.
8 . Drone with an image sensor according to claim 1 , wherein the image sensor is configured to be oriented in a moving direction relative to a road surface.
9 . The drone according to claim 8 , wherein the image sensor is arranged such that the first direction of the image sensor structure is arranged transversally to the moving direction, and such that the second direction of the image sensor structure is arranged longitudinally to the moving direction, wherein the second stack is placed adjacent to the first stack in the first direction being transversally to the moving direction.
10 . The drone according to claim 8 , wherein the drone is configured to inform a remote server about a state of the road surface, or to inform a remote server about a dangerous state of the road surface.
11 . The image sensor according to claim 1 , wherein the first stack of filter elements comprises, as the first color filter, a red color filter, as the second color filter, a green color filter, and, as the third color filter, a blue color filter.
12 . The image sensor according to claim 1 , wherein the second optical bandwidth of the second absorption filter comprises, at a half-power bandwidth, a value of between 820 nm and 870 nm, and wherein the first optical bandwidth of the first absorption filter comprises, at the half-power bandwidth, a value of between 920 nm and 970 nm.
13 . The image sensor according to claim 1 ,
wherein the first stack of filter elements comprises: a green filter, a blue filter placed adjacent to the green filter in the first direction, a red filter adjacent to the green filter in the second direction, and another green filter adjacent to the red filter in the first direction and adjacent to the blue filter in the second direction, and,
wherein the second stack comprises: the first absorption filter, the second absorption filter, the first polarization filter and the second polarization filter, wherein the second absorption filter is placed adjacent to the first absorption filter in the first direction, the first polarization filter is placed adjacent to the first absorption filter in the second direction, and the second polarization filter is placed adjacent to the first polarization filter in the first direction and adjacent to the first second absorption filter in the second direction.
14 . The image sensor according to claim 13 , wherein the first stack and the second stack are arranged in two lines side by side in the first direction,
wherein the second absorption filter of the second stack is arranged adjacent to the blue filter of the first stack in the first direction, and
wherein the first polarization filter of the second stack is placed adjacent to the further green filter of the first stack in the first direction.
15 . The image sensor according to claim 1 , wherein the polarization characteristic of the first polarization filter and the polarization characteristic of the second polarization filter are configured to be shifted by 90° with respect to each other.
16 . The image sensor according to claim 1 , wherein the first stack of filter elements and the second stack of filter elements are arranged in two lines side by side in the first direction.
17 . The image sensor according to claim 1 , wherein the image sensor is configured to selectively read out each image sensor portion associated to each individual filter element of the first stack of filter elements and the second stack of filter elements in the image element.
18 . Method for operating an image sensor with an image element structure comprising a multitude of image elements arranged in a grid-shaped manner in a first direction and in a second direction orthogonal to the first direction, wherein each image element of the multitude of image elements comprises a first stack of filter elements and a second stack of filter elements, arranged side by side with the first stack of filter elements in the first direction, wherein each one of the first stack of filter elements and the second stack of filter elements comprises a plurality of filter elements spatially arranged side by side, wherein the plurality of filter elements of the first stack of filter elements and the plurality of filter elements of the second stack of filter elements are extended in a flat structure in which filter elements of the first stack of filter elements and filter elements of the second stack of filter elements are arranged in one line or in two lines, wherein the first stack of filter elements comprises at least a first color filter, a second color filter, and a third color filter, wherein the third color filter is different from the first color filter and the second color filter, and wherein the first color filter is different from the second color filter, wherein the second stack of filter elements comprises a first absorption filter with a first optical bandwidth, wherein the first optical bandwidth is selected from a spectral range of between 900 nm and 1200 nm, a second absorption filter with a second optical bandwidth, wherein the second optical bandwidth is selected from a spectral range of between 400 nm and 900 nm and is different from the first optical bandwidth, a first polarization filter with a first polarization characteristic, and a second polarization filter with a second polarization characteristic different from the first polarization characteristic, the method comprising:
reading out a first light-sensitive area associated to the first and second color filters of the first stack of filter elements; and
reading out a second light-sensitive area associated to the first absorption filter, the second absorption filter, the first polarization filter, and the second polarization filter,
wherein the first absorption filter and the second absorption filter have optical bandwidths in which water has different absorption rates in order to detect water on a road surface, and
wherein the first polarization filter with a first polarization characteristic, and the second polarization filter with the second polarization characteristic have different polarization characteristics in order to differentiate between water, snow, and black ice.
19 . Method for manufacturing an image sensor with an image element structure comprising a multitude of image elements arranged in a grid-shaped manner in a first direction and in a second direction orthogonal to the first direction, the method comprising:
configuring the image elements of the multitude of image elements such that each image element of the multitude of image elements comprises a first stack of filter elements and a second stack of filter elements, wherein the second stack of filter elements is arranged side by side with the first stack of filter elements in the first direction, wherein each one of the first stack of filter elements and the second stack of filter elements comprises a plurality of filter elements spatially arranged side by side, wherein the plurality of filter elements of the first stack of filter elements and the plurality of filter elements of the second stack of filter elements are extended in a flat structure in which filter elements of the first stack of filter elements and filter elements of the stack of filter elements are arranged in one line or in two lines, wherein the first stack of filter elements comprises at least a first color filter, a second color filter, and a third color filter, wherein the third color filter is different from the first color filter and the second color filter, and wherein the first color filter is different from the second color filter, wherein the second stack of filter elements comprises a first absorption filter with a first optical bandwidth, wherein the first optical bandwidth is selected from a spectral range of between 900 nm and 1200 nm, a second absorption filter with a second optical bandwidth, wherein the second optical bandwidth is selected from a spectral range of between 400 nm and 900 nm and is different from the first optical bandwidth, a first polarization filter with a first polarization characteristic, and a second polarization filter with a second polarization characteristic different from the first polarization characteristic,
wherein the first absorption filter and the second absorption filter have optical bandwidths in which water has different absorption rates in order to detect water on a road surface, and
wherein the first polarization filter with a first polarization characteristic, and the second polarization filter with the second polarization characteristic have different polarization characteristics in order to differentiate between water, snow, and black ice.