Image processing apparatus, distance measuring apparatus, and image processing method
An image processing apparatus has a light source that emits a light signal at a predetermined time interval, a scanner capable of changing at least one of a scanning range or a scanning timing of the light signal for each of frames, a light receiver that receives a reflected light signal reflected on an object by irradiating the object with the light signal, processing circuitry that generates a distance image for each of the frames based on the reflected light signal received by the light receiver, and synthesizes the distance images of a plurality of the frames to generate a high-resolution distance image.
1. An image processing apparatus comprising:
a light source that emits a light signal at a predetermined time interval;
a scanner capable of changing at least one of a scanning range or a scanning timing of the light signal for each of frames;
a light receiver that receives a reflected light signal reflected on an object by irradiating the object with the light signal; and
processing circuitry,
wherein the processing circuitry is configured to: generate a distance image for each of the frames based on the reflected light signal received by the light receiver; and
synthesize the distance images of a plurality of the frames to generate a high-resolution distance image.
2. The image processing apparatus according to claim 1 , wherein
the scanner makes at least one of the scanning range or the scanning timing of the light signal different for each of a predetermined number of consecutive frames, and repeatedly and periodically switches the scanning range or the scanning timing of the light signal in units of the predetermined number of frames, the predetermined number being two or more, and
the processing circuitry is configured to synthesize distance images of the predetermined number of frames to generate the high-resolution distance image.
3. The image processing apparatus according to claim 1 , wherein
the scanner changes a scanning angle of the light signal emitted from the light source for each of the frames.
4. The image processing apparatus according to claim 1 ,
wherein the processing circuitry is further configured to switch and control a light emission direction of the scanner for each of the frames.
5. The image processing apparatus according to claim 1 ,
wherein the processing circuitry is further configured to:
switch and control a light emission direction of a housing unit in which the light source is built for each of the frames, and
switch and control the light emission direction of the housing unit to cause the scanner to change the range of the scanning with the light signal for each of the frames.
6. The image processing apparatus according to claim 1 ,
wherein the processing circuitry is further configured to variably control a speed at which the scanner switches a traveling direction of the light signal for each of the frames.
7. The image processing apparatus according to claim 1 ,
wherein the processing circuitry is further configured to control an emission start timing at which the light source starts emitting the light signal, wherein
the scanner switches the scanning timing of the light signal for each of the frames based on the emission start timing at which the light source starts emitting the light signal.
8. The image processing apparatus according to claim 7 , wherein
the processing circuitry is configured to variably control the emission start timing of the light signal for each of the frames without changing an emission interval at which the light source emits the light signal.
9. The image processing apparatus according to claim 8 , wherein
the light source emits a plurality of light signals at the same emission interval starting from different emission start times for each of consecutive n frames, n being an integer of 2 or more, and
the processing circuitry is configured to synthesize distance images generated in each of the n frames.
10. The image processing apparatus according to claim 1 ,
wherein the processing circuitry is further configured to perform processing of eliminating a blur in the generated high-resolution distance image.
11. The image processing apparatus according to claim 10 , wherein
the processing circuitry is further configured to:
perform deconvolution processing on luminance information of the high-resolution distance image generated by using a light intensity distribution of the light signal emitted from the light source to generate reflectance of the object; and
sharpen an edge of the generated high-resolution distance image based on the generated reflectance of the object.
12. The image processing apparatus according to claim 11 , wherein
the processing circuitry is configured to set a threshold for a luminance signal corresponding to the reflected light signal received by the light receiver based on the reflectance of the generated object, binarizes the luminance signal based on the threshold, and corrects the high-resolution distance image generated based on a binarized luminance value.
13. The image processing apparatus according to claim 11 , wherein
the processing circuitry is configured to estimate a luminance value corresponding to the reflected light signal received by the light receiver based on the generated reflectance of the object, and corrects the high-resolution distance image generated based on the luminance value.
14. The image processing apparatus according to claim 1 ,
wherein the processing circuitry is further configured to recognize a feature object included in the generated distance image, wherein
the processing circuitry is configured to output the high-resolution distance image generated at a first frame rate for the feature object, and outputs the distance image at a second frame rate higher than the first frame rate without changing a resolution for a region other than the feature object.
15. The image processing apparatus according to claim 14 , wherein
the feature object is a stationary object satisfying a predetermined condition.
16. The image processing apparatus according to claim 15 , wherein
the processing circuitry is further configured to recognize the feature object that is not present before a predetermined period and is stationary based on a difference between the generated distance image and a distance image generated before the predetermined period.
17. The image processing apparatus according to claim 16 , wherein
the processing circuitry is configured to recognize the moving object based on a difference between a plurality of distance images generated most recently.
18. The image processing apparatus according to claim 17 , wherein
the processing circuitry is configured to output the high-resolution distance image generated at the first frame rate in a partial region including the feature object and outputs the distance image generated at the second frame rate in a partial region including the moving object based on results of the recognition.
19. A distance measuring apparatus comprising:
an image processing apparatus; and
a processing circuitry, wherein
the image processing apparatus comprises:
a light source that emits a light signal at a predetermined time interval;
a scanner capable of changing at least one of a scanning range or a scanning timing of the light signal for each of frames; and
a light receiver that receives a reflected light signal reflected on an object by irradiating the object with the light signal,
wherein the processing circuitry is configured to:
generate a distance image for each of the frames based on the reflected light signal received by the light receiver;
synthesize the distance images of the plurality of frames to generate a high-resolution distance image; and
measure a distance to the object based on a time when the reflected light signal is received by the light receiver and a time when the light signal is emitted from the light source.
20. An image processing method comprising:
changing at least one of a scanning range or a scanning timing of the light signal for each of frames;
receiving a reflected light signal reflected on an object by irradiating the object with the light signal;
generating a distance image for each of the frames based on the received reflected light signal; and
synthesizing the distance images of a plurality of frames to generate a high-resolution distance image.