Moving image noise reduction apparatus and moving image noise reduction method
A filter unit decomposes image data from an image sensor adapted to capture images at a predetermined frame rate into a low-frequency component and a first high-frequency component. A motion vector estimation unit reads data from an event sensor, adapted to asynchronously output information on a pixel in which a brightness changes, at a frame rate higher than the predetermined frame rate and estimates a motion vector. A motion compensation unit performs motion compensation based on the motion vector. The filter unit generates a third high-frequency component by adding the first high-frequency component and a second high-frequency component extracted from an image obtained by motion compensation at a predetermined ratio, and reduces a noise in the image data by adding the low-frequency component and the third high-frequency component.
1 . A moving image noise reduction apparatus comprising:
a filter unit that decomposes image data from an image sensor adapted to capture images at a predetermined frame rate into a low-frequency component and a first high-frequency component;
a motion vector estimation unit that reads data from an event sensor, adapted to asynchronously output information on a pixel in which a brightness changes, at a frame rate higher than the predetermined frame rate and estimates a motion vector; and
a motion compensation unit that performs motion compensation based on the motion vector,
wherein the filter unit generates a third high-frequency component by adding the first high-frequency component and a second high-frequency component extracted from an image obtained by motion compensation at a predetermined ratio, and reduces a noise in the image data by adding the low-frequency component and the third high-frequency component.
2 . The moving image noise reduction apparatus according to claim 1 ,
wherein a block range in the image data in which a motion vector is estimated is larger than a block range in the image data in which motion compensation is performed.
3 . The moving image noise reduction apparatus according to claim 1 ,
wherein, when the motion vector is estimated, a timing to start calculating the motion vector is changed according to a shutter speed of the image sensor.
4 . The moving image noise reduction apparatus according to claim 1 ,
wherein the filter unit reduces, when reducing a noise in distance measurement image data from a distance sensor adapted to detect a distance to a subject, a noise in the distance measurement image data by adding a distance measurement image in an entire frequency band from the distance sensor and a distance measurement image in the entire frequency band obtained by motion compensation at a predetermined ratio without decomposing the distance measurement image data into a low-frequency component and a high-frequency component.
5 . A moving image noise reduction method comprising:
filtering image data from an image sensor adapted to capture images at a predetermined frame rate into a low-frequency component and a first high-frequency component;
reading data from an event sensor, adapted to asynchronously output information on a pixel in which a brightness changes, at a frame rate higher than the predetermined frame rate and estimating a motion vector; and
performing motion compensation based on the motion vector,
wherein the filtering generates a third high-frequency component by adding the first high-frequency component to a second high-frequency component extracted from an image obtained by motion compensation at a predetermined ratio, and reduces a noise in the image data by adding the low-frequency component and the third high-frequency component.