Imaging device and imaging method capable of generating a bulb exposure image
An imaging device of the present invention, using image data that has been continuously read out at specified time intervals from an image sensor, generates relatively dark combination image data resulting from relatively dark combination using darker pixel data of each pixel of image data is generated, and relatively bright combination image data resulting from relatively bright combination using brighter pixel data of each pixel of image data, and difference output image data is generated from the relatively bright combination image data and the relatively dark combination image data. With the generated relatively dark combination image data as background image data and the difference output image data as light trace output image data, respective brightness is adjusted, and by subjecting each of the image data after adjustment to addition combination, it is possible to respectively independently adjust background brightness and light trace brightness.
1. An imaging device, comprising:
an image section including
an image sensor, and
a lens; and
an image processor including
a bright image combination processing section that stores first image data that has been initially generated based on image data read out from the image sensor as cumulative bright image combination image data, comparing pixel data respectively corresponding to a plurality of pixel data constituting second image data generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative bright image combination image data, making a larger of the pixel data within the respective corresponding pixel data new pixel data, and sequentially repeating relatively bright combination processing, for reconstituting the cumulative bright image combination image data, on the second image data of a second and subsequent frames that have been generated based on image data read out from the image sensor,
a dark image combination processing section that stores first image data that has been initially generated based on image data read out from the image sensor as cumulative dark image combination image data, comparing pixel data respectively corresponding to a plurality of pixel data constituting second image data generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative dark image combination image data, making a smaller of the pixel data within the respective corresponding pixel data new pixel data, and sequentially repeating dark image combination processing, for reconstituting the cumulative dark image combination image data, on the second image data of a second and subsequent frames that have been generated based on image data read out from the image sensor,
a difference image combination section that calculates differences between pixel data respectively corresponding to pixel data constituting the cumulative bright image combination image data and pixel data constituting the cumulative dark image combination image data to generate new difference image data, and
an image combination section that combines image data obtained by multiplying the cumulative dark image combination image data by a first gain value and image data obtained by multiplying the difference image data by a second gain value.
2. The imaging device of claim 1 , wherein the image processor further includes
an image addition and combination section for adding image data acquired by carrying out exposure plurality of times, and wherein
the first image data is obtained by shooting at an exposure time that gives an appropriate exposure, and addition image data when absolute values of a difference between addition image data, obtained by adding third image data obtained by carrying out exposure a plurality of times at an exposure time that is shorter than the exposure time that gives an appropriate exposure in the image adding and combining section, and the first image data is within a specified range, is made the second image data.
3. An imaging device, comprising:
an image section including
an image sensor, and
a lens; and
an image processor including
a bright image combination processing section that stores first image data that has been initially generated based on image data that has been read out from the image sensor as cumulative bright image combination image data, comparing differences between pixel data respectively corresponding to a plurality of pixel data constituting second image data that has been generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative bright image combination image data with a specified value, when the difference is greater than or equal to the specified value comparing pixel data respectively corresponding to a plurality of pixel data constituting the second image data generated based on image data that has been read from the image sensor and a plurality of pixel data constituting the cumulative bright image combination image data and making a larger of the pixel data within the respective corresponding pixel data new pixel data, when the difference is smaller the specified value making an average value of pixel data respectively corresponding to pixel data constituting the second image data created based on image data that has been read out from the image sensor and pixel data constituting the cumulative bright image combination image data new pixel data, and sequentially repeating relatively bright image combination processing for reconstituting the cumulative bright image combination image data on the second image data for a second and subsequent frame generated based on image data that has been read out from the image sensor,
a dark image combination processing section that stores first image data that has been initially generated based on image data that has been read out from the image sensor as cumulative relatively dark combination image data, comparing differences between pixel data respectively corresponding to a plurality of pixel data constituting second image data that has been generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative dark image combination image data with a specified value, when the difference is greater than or equal to the specified value comparing pixel data respectively corresponding to a plurality of pixel data constituting the second image data generated based on image data that has been read from the image sensor and a plurality of pixel data constituting the cumulative dark image combination image data and making the larger pixel data new pixel data, when the difference is smaller than the specified value making an average value of pixel data respectively corresponding to pixel data constituting the second image data created based on image data that has been read out from the image sensor and pixel data constituting the cumulative dark image combination image data new pixel data, and sequentially repeating dark image combination processing for reconstituting the cumulative dark image combination image data on the second image data for a second and subsequent frame generated based on image data that has been read out from the image sensor,
a difference image combination section that generates new difference image data by calculating differences between respective pixel data for a plurality of pixel data constituting the cumulative bright image combination image data and a plurality of pixel data constituting the cumulative dark image combination image data, and
an image combination section that combines image data obtained by multiplying the cumulative dark image combination image data by a first gain value and image data obtained by multiplying the difference image data by a second gain value.
4. The imaging device of claim 3 , wherein the image processor further includes
an image addition and combination section for adding image data acquired by carrying out exposure plurality of times, and wherein
the first image data is obtained by shooting at an exposure time that gives an appropriate exposure, and addition image data when absolute values of a difference between addition image data, obtained by adding third image data obtained by carrying out exposure a plurality of times at an exposure time that is shorter than the exposure time that gives an appropriate exposure in the image adding and combining section, and the first image data is within a specified range, is made the second image data.
5. An imaging method comprising:
a bright image combination processing step of storing first image data that has been initially generated based on image data read out from the image sensor as cumulative bright image combination image data, comparing pixel data respectively corresponding to a plurality of pixel data constituting second image data generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative bright image combination image data, making a larger of the pixel data within the respective corresponding pixel data new pixel data, and sequentially repeating bright image combination processing, for reconstituting the cumulative bright image combination image data, on the second image data of a second and subsequent frames that have been generated based on image data read out from the image sensor;
a dark image combination processing step of storing first image data that has been initially generated based on image data read out from the image sensor as cumulative dark image combination image data, comparing pixel data respectively corresponding to a plurality of pixel data constituting second image data generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative dark image combination image data, making the smaller of the pixel data new pixel data, and sequentially repeating dark image combination processing, for reconstituting the cumulative dark image combination image data, on the second image data of a second and subsequent frames that have been generated based on image data read out from the image sensor;
a difference image combination step of calculating differences between pixel data respectively corresponding to pixel data constituting the cumulative bright image combination image data and pixel data constituting the cumulative dark image combination image data to generate new difference image data; and
an image combination step of combining image data obtained by multiplying the cumulative dark image combination image data by a first gain value and image data obtained by multiplying the difference image data by a second gain value.
6. An imaging method comprising:
a bright image combination processing step of storing first image data that has been initially generated based on image data that has been read out from the image sensor as cumulative bright image combination image data, comparing differences between pixel data respectively corresponding to a plurality of pixel data constituting second image data that has been generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative bright image combination image data with a specified value, when the difference is greater than or equal to the specified value comparing pixel data respectively corresponding to a plurality of pixel data constituting the second image data generated based on image data that has been read from the image sensor and a plurality of pixel data constituting the cumulative bright image combination image data and making the larger pixel data new pixel data, when the difference is smaller the specified value making an average value of pixel data respectively corresponding to pixel data constituting the second image data created based on image data that has been read out from the image sensor and pixel data constituting the cumulative bright image combination image data new pixel data, and sequentially repeating bright image combination processing for reconstituting the cumulative bright image combination image data on the second image data for a second and subsequent frame generated based on image data that has been read out from the image sensor;
a dark image combination processing step of storing first image data that has been initially generated based on image data that has been read out from the image sensor as cumulative dark image combination image data, comparing differences between pixel data respectively corresponding to a plurality of pixel data constituting second image data that has been generated based on image data read out from the image sensor and a plurality of pixel data constituting the cumulative dark image combination image data with a specified value, when the difference is greater than or equal to the specified value comparing pixel data respectively corresponding to a plurality of pixel data constituting the second image data generated based on image data that has been read from the image sensor and a plurality of pixel data constituting the cumulative dark image combination image data and making the larger pixel data new pixel data, when the difference is smaller than the specified value making an average value of pixel data respectively corresponding to pixel data constituting the second image data created based on image data that has been read out from the image sensor and pixel data constituting the cumulative dark image combination image data new pixel data, and sequentially repeating dark image combination processing for reconstituting the cumulative dark image combination image data on the second image data for a second and subsequent frame generated based on image data that has been read out from the image sensor;
a difference image combination step of generating new difference image data by calculating differences between respective pixel data for a plurality of pixel data constituting the cumulative bright image combination image data and a plurality of pixel data constituting the cumulative dark image combination image data; and
an image combination step of combining image data obtained by multiplying the cumulative dark image combination image data by a first gain value and image data obtained by multiplying the difference image data by a second gain value.