Three-dimensional imaging device, image processing device, image processing method, and program
View Patent ↗A 3D image capture device includes: a light transmitting section 2 with m transmitting areas (where m is an integer and m≧2) that have different spectral transmittance characteristics; and an image sensor 1 which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which unit elements are arranged. Each unit element includes n photosensitive cells (where n is an integer and n≧m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells. The image capture device further includes an image processing section which modifies an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix and which generates multi-viewpoint images using the modified n×m matrix.
1. A 3D image capture device comprising:
a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;
an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells;
an imaging section which produces an image on the imaging area of the image sensor; and
an image processing section which modifies an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix and which generates multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.
2. The 3D image capture device of claim 1 , wherein the image processing section increases the determinant of the n×m matrix by increasing the angle between at least two of the m column vectors.
3. The 3D image capture device of claim 1 , wherein the image processing section changes the angle so that a value representing correlation between the multi-viewpoint images becomes smaller than a predetermined threshold value.
4. The 3D image capture device of claim 1 , wherein the image processing section increases the angle so that the determinant of the n×m matrix becomes greater than a predetermined threshold value.
5. The 3D image capture device of claim 1 , wherein the image processing section increases the angle between two column vectors that is smaller than the angle formed by any other pair of the m column vectors.
6. The 3D image capture device of claim 1 , wherein the image processing section obtains the angle between two arbitrary ones of the m column vectors and increases the angles sequentially by beginning with the smallest one, thereby increasing the determinant of the n×m matrix.
7. The 3D image capture device of claim 1 , wherein m=2 and n=2.
8. An image processor which generates multi-viewpoint images based on a signal that has been obtained by a 3D image capture device, the device comprising:
a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;
an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells; and
an imaging section which produces an image on the imaging area of the image sensor,
wherein the image processor modifies an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix and generates multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.
9. An image processing method for generating multi-viewpoint images based on a signal that has been obtained by a 3D image capture device, the device comprising:
a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;
an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells; and
an imaging section which produces an image on the imaging area of the image sensor,
wherein the image processing method comprises the steps of:
modifying an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix; and
generating multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.
10. An image processing program stored on a non-transitory computer readable medium for generating multi-viewpoint images based on a signal that has been obtained by a 3D image capture device, the device comprising:
a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;
an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells; and
an imaging section which produces an image on the imaging area of the image sensor,
wherein the program is defined so as to make a computer perform the steps of:
modifying an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix; and
generating multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.