Imaging and display apparatus and method
The object of the present invention is to provide an imaging and display apparatus and method for providing small and reasonable apparatus while the imaging frame rate of the imaging element can be high without decreasing the resolution of the display image. For this object, an imaging and display apparatus comprises an imaging element 12 for performing photo electric conversion on an optical image formed by an optical system 11 , a display element 20 for displaying image information, a readout control section 14 for sequentially reading out the image information from the imaging element 12 , and a image selection section 17 for selecting image information to be displayed on the display element 20 from the image information sequentially read out of the imaging element 12 by the readout control section 14 . The readout control section 14 controls the readout of the imaging element 12 so that spatially different image information is included in the sequential readout period of the imaging element 12 corresponding to the sequential display frames of the display element 20 , and the image selection section 17 selects spatially different image information which is read out of the imaging element 12 in sequential display frames.
1. An imaging and display apparatus comprising;
an imaging element for performing photoelectric conversion on an optical image formed by an optical system;
a readout control section for controlling said imaging element for sequentially reading out a first image information in which plural kinds of frames including frames corresponding to pixel arrays spatially shifted half pixel pitch in the horizontal and/or vertical direction included in the imaging element form one cycle;
a display image information generating section for generating a second image information to be displayed based on said first image information, the second image information comprising plural kinds of frames including frames corresponding to spatially different pixel arrays included in the imaging element which form one cycle, and frame rate of which being lower than that of said first image information;
a display element for displaying the image represented by respective frames of said second image information including frames corresponding to pixel arrays spatially shifted half pixel in the horizontal and/or vertical direction included in said imaging element in a progressive manner; and
an image shifting section for optically and mutually shifting the images of the plural kinds of frames displayed by said display element according to the mutual shift of barycentric positions of the images in the plural kinds of frames.
2. The imaging and display apparatus according to claim 1 , wherein said readout control section controls the readout of said imaging element so that spatially different image information at least in the vertical direction is included.
3. The imaging and display apparatus according to claim 1 , wherein said display image information generating section generates the second image information to be displayed based on the image information obtained by performing adding or averaging operation on the image information of sequential frames of said first image information corresponding to spatially identical pixel arrays included in the imaging element, wherein plural kinds of frames including frames corresponding to spatially different pixel arrays form one cycle in the second image information, and wherein frame rate of the second image information is lower than that of said first image information.
4. The imaging and display apparatus according to claim 1 , wherein said imaging element comprises a color filter in the form of Bayer array, and said display image information generating section generates said second image information so that the image information of each frame constituting said second image information includes color information in the Bayer array.
5. The imaging and display apparatus according to claim 4 , wherein said image information generating section generates said second image information based on the image information subsampled so as to include R, G, B image information constituting the Bayer array generated based on pixel signals of (1+8n)th vertical lines and (4+8n)th vertical lines and R, G, B image information constituting the Bayer array generated based on pixel signals of (3+8n)th vertical lines and (6+8n)th vertical lines, where n is a positive integer.
6. The imaging and display apparatus according to claim 1 , wherein the apparatus further comprises a focus control section controlling said optical system to be focused by processing said first image information which is sequentially read out of said imaging element.
7. An imaging and display method comprising;
a step for sequentially reading out a first image information from an imaging element, in which plural kinds of frames including frames corresponding to pixel arrays spatially shifted half pixel in the horizontal and/or vertical direction included in the imaging element form one cycle;
a step for generating a second image information to be displayed in which plural kinds of frames including frames corresponding to spatially different pixel arrays form one cycle, and frame rate of which is lower than that of said first image information;
a step for displaying the image represented by respective frames of said second image information including plural kinds of frames corresponding to pixel arrays spatially shifted half pixel in the horizontal and/or vertical direction included in the imaging element in a progressive manner, the image represented by the respective frames being optically and mutually shifted; and
a step for optically and mutually shifting the displayed images of the plural kinds of frames according to the mutual shift of barycentric positions of the images in the plural kinds of the frames.