Imaging device
An imaging device includes: a solid-state image sensor that is exposed to reflection light from an object and accumulates signal charges; and a control arithmetic device that controls irradiation by an infrared light source and exposure of the solid-state image sensor. The solid-state image sensor includes: photoelectric converters that convert the reflection light from the object into the signal charges; and charge accumulators that accumulate the signal charges. The imaging device performs, within one frame period, m types of exposure sequences (m is an integer greater than or equal to four) for controlling the irradiation and the exposure; assigns the charge accumulators exclusively to the m types of exposure sequences; accumulates, into the charge accumulators, the signal charges obtained from n (n is an integer greater than or equal to three) of the photoelectric converters in at least one type of exposure sequence among the m types of exposure sequences.
1. An imaging device, comprising:
a light source that irradiates an object with light;
a solid-state image sensor that is exposed to reflection light from the object and accumulates the reflection light as a signal charge; and
a controller that controls irradiation by the light source and exposure of the solid-state image sensor, wherein
the solid-state image sensor includes:
a plurality of photoelectric converters that convert the reflection light from the object into signal charges, each of the signal charges being the signal charge; and
a plurality of charge accumulators that accumulate the signal charges, and
the imaging device:
performs, within one frame period, m types of exposure sequences for controlling the irradiation and the exposure, m being an integer greater than or equal to four;
assigns the plurality of charge accumulators exclusively to the m types of exposure sequences;
sets correspondence between a set of n photoelectric converters among the plurality of photoelectric converters and one charge accumulator among the plurality of charge accumulators in at least one type of exposure sequence among the m types of exposure sequences, n being an integer greater than or equal to three;
adds the signal charges obtained from the n photoelectric converters and accumulates the signal charges added into the one charge accumulator corresponding to the n photoelectric converters; and
changes a combination of the n photoelectric converters in every k types of exposure sequences among the m types of exposure sequences, k being an integer greater than or equal to one.
2. The imaging device according to claim 1 , wherein
the imaging device performs the at least one type of exposure sequence repeatedly within one frame period.
3. The imaging device according to claim 2 , wherein
the imaging device sets a total number of repetitions of the m types of exposure sequences based on an irradiation intensity of the light source, an irradiation time of the light source, an irradiation wavelength of the light source, and an exposure period of the solid-state image sensor.
4. The imaging device according to claim 1 , wherein
the m types of exposure sequences differ from each other in terms of at least one of an irradiation intensity of the light source, an irradiation time of the light source, an irradiation wavelength of the light source, or an exposure period of the solid-state image sensor.
5. The imaging device according to claim 4 , wherein
the imaging device is a time of flight (TOF) range finding device, and
the imaging device includes a distance calculator that calculates a distance to the object by use of the signal charges accumulated in the plurality of charge accumulators in at least two types of exposure sequences among the m types of exposure sequences.
6. The imaging device according to claim 5 , wherein
the m types of exposure sequences include a long exposure sequence and a short exposure sequence,
the irradiation time of the light source and the exposure period of the solid-state image sensor are each set longer in the long exposure sequence than in the short exposure sequence, and
the distance calculator calculates at least two types of distances to the object based on the m types of exposure sequences.
7. The imaging device according to claim 6 , wherein
the imaging device includes a distance corrector that corrects a distance calculated in the long exposure sequence by use of a distance calculated in the short exposure sequence.
8. The imaging device according to claim 6 , wherein
the imaging device includes an anomaly notifier that lets know of an anomaly when a difference between a part of a distance calculated in the long exposure sequence and a distance calculated in the short exposure sequence exceeds a prescribed range.
9. The imaging device according to claim 6 , wherein
when the exposure period in the short exposure sequence is regarded as a short exposure period,
the short exposure period is changed in every frame, and
in response to a change in the short exposure sequence in every frame, a scan is performed with a condition that a distance range calculated in the short exposure sequence overlaps a part of a distance range calculated in the long exposure sequence.
10. The imaging device according to claim 6 , wherein
the exposure period in the short exposure sequence is set based on a distance calculated in the long exposure sequence for a preceding frame.
11. The imaging device according to claim 1 , wherein
the imaging device changes, in each of frames, a combination of the n photoelectric converters from which the signal charges are obtained and added.
12. The imaging device according to claim 1 , wherein
m is five or six,
the plurality of photoelectric converters are disposed in a matrix,
the imaging device repeats each of the five or six types of exposure sequences a plurality of times within one frame period, and
the n photoelectric converters are a set of four photoelectric converters, among the plurality of photoelectric converters, that are arrayed in two rows by two columns.
13. The imaging device according to claim 1 , wherein
the imaging device is a TOF range finding device,
the plurality of photoelectric converters are disposed in a matrix,
the m types of exposure sequences include a first long exposure sequence, a second long exposure sequence, a third long exposure sequence, a first short exposure sequence, a second short exposure sequence, and a third short exposure sequence,
an irradiation time of the light source and an exposure period of the solid-state image sensor are each longer in the first long exposure sequence, the second long exposure sequence, and the third long exposure sequence than in the first short exposure sequence, the second short exposure sequence, and the third short exposure sequence,
the exposure period in the second long exposure sequence differs from the exposure period in the first long exposure sequence,
the exposure period in the second short exposure sequence differs from the exposure period in the first short exposure sequence,
the third long exposure sequence and the third short exposure sequence each involve the exposure of background light that includes no reflection light component associated with the irradiation by the light source,
the first long exposure sequence, the second long exposure sequence, the third long exposure sequence, the first short exposure sequence, the second short exposure sequence, and the third short exposure sequence are each repeated a plurality of times within one frame period,
the n photoelectric converters are four photoelectric converters, among the plurality of photoelectric converters, that are arrayed in two rows by two columns, and
the imaging device includes a distance calculator that calculates two types of distances to the object by use of the signal charges accumulated in the first long exposure sequence, the second long exposure sequence, and the third long exposure sequence and the signal charges added and accumulated in the first short exposure sequence, the second short exposure sequence, and the third short exposure sequence.
14. The imaging device according to claim 13 , wherein
the irradiation by the light source is performed in the third long exposure sequence and the third short exposure sequence, and a period after the reflection light has become extinct serves as the exposure period.
15. The imaging device according to claim 1 , wherein
the imaging device is a TOF range finding device,
the plurality of photoelectric converters are disposed in a matrix,
the m types of exposure sequences include a first strong exposure sequence, a second strong exposure sequence, a first weak exposure sequence, a second weak exposure sequence, and a background exposure sequence,
an irradiation intensity of the light source is greater in the first strong exposure sequence and the second strong exposure sequence than in the first weak exposure sequence and the second weak exposure sequence,
an exposure period in the second strong exposure sequence differs from an exposure period in the first strong exposure sequence,
an exposure period in the second weak exposure sequence differs from an exposure period in the first weak exposure sequence,
the background exposure sequence involves the exposure of background light that does not include the reflection light,
the first strong exposure sequence, the second strong exposure sequence, the first weak exposure sequence, the second weak exposure sequence, and the background exposure sequence are each repeated a plurality of times within one frame period,
the n photoelectric converters are four photoelectric converters, among the plurality of photoelectric converters, that are arrayed in two rows by two columns, and
the imaging device includes a distance calculator that, for every set of the n photoelectric converters, calculates a distance by use of the signal charges in the background exposure sequence and one of the signal charges in the first strong exposure sequence and the second strong exposure sequence and the signal charges in the first weak exposure sequence and the second weak exposure sequence.
16. The imaging device according to claim 1 , wherein
when a period from when an intensity of the reflection light from the object starts increasing to when the intensity stops increasing is regarded as a rise period and a period from when the intensity of the reflection light from the object starts decreasing to when the intensity stops decreasing is regarded as a fall period,
in the m types of exposure sequences, an exposure period of the solid-state image sensor is set so as to coincide with one of a first period that includes at least a part of the rise period but does not include the fall period and a second period that includes a part of the fall period but does not include the rise period.
17. The imaging device according to claim 16 , wherein
the m types of exposure sequences include an exposure sequence in which the object is irradiated with light having different irradiation wavelengths.
18. The imaging device according to claim 16 , wherein
the imaging device is an observation device that observes an inside of a light scattering body through an application of time-domain imaging,
the plurality of photoelectric converters are disposed in a matrix,
the m types of exposure sequences include a first long wavelength sequence, a second long wavelength sequence, a third long wavelength sequence, a first short wavelength sequence, a second short wavelength sequence, and a third short wavelength sequence,
an irradiation wavelength is longer in the first long wavelength sequence, the second long wavelength sequence, and the third long wavelength sequence than in the first short wavelength sequence, the second short wavelength sequence, and the third short wavelength sequence,
the exposure period in each of the first long wavelength sequence and the first short wavelength sequence is equal to the first period,
the exposure period in each of the second long wavelength sequence and the second short wavelength sequence is equal to the second period,
the third long wavelength sequence and the third short wavelength sequence each involve the exposure of background light that includes no reflection light component associated with the irradiation by the light source,
the first long wavelength sequence, the second long wavelength sequence, the third long wavelength sequence, the first short wavelength sequence, the second short wavelength sequence, and the third short wavelength sequence are each repeated a plurality of times within one frame period,
the n photoelectric converters are four photoelectric converters, among the plurality of photoelectric converters, that are arrayed in two rows by two columns, and
the imaging device includes an arithmetic operator that obtains a structure and a condition of the inside of the light scattering body through an arithmetic operation by use of each of the signal charges accumulated in the first long wavelength sequence, the second long wavelength sequence, and the third long wavelength sequence and the signal charges accumulated in the first short wavelength sequence, the second short wavelength sequence, and the third short wavelength sequence.
19. The imaging device according to claim 18 , wherein
The irradiation by the light source is performed in the third long wavelength sequence and the third short wavelength sequence, and a period after the reflection light has become extinct serves as the exposure period.
20. The imaging device according to claim 18 , wherein
the arithmetic operator obtains the structure and the condition of a deep part of the light scattering body and the structure and the condition of a surface layer part of the light scattering body by use of a result from imaging in the first long wavelength sequence, the second long wavelength sequence, and the third long wavelength sequence and a result from imaging in the first short wavelength sequence, the second short wavelength sequence, and the third short wavelength sequence.