Image processing apparatus, method, and program
An image processing device according to an embodiment includes: a depth estimation unit that, when a size of a differential region between a first frame and a second frame at a timing later than a timing of the first frame in chronological order in a moving image satisfies a predetermined condition and is large, estimates a depth of at least a region corresponding to the differential region in the second frame; and a depth estimation result update unit that updates an estimation result of the depth of the first frame by using the region corresponding to the differential region to output the updated estimation result as a new estimation result of the depth of the second frame.
1 . An image processing device comprising one or more processors configured to execute instructions that cause the image processing device to perform operations comprising:
calculating a size of a differential region between a first frame and a second frame at a timing later than a timing of the first frame in chronological order in a moving image;
estimating a depth of the first frame and, when the size of the differential region exceeds a predetermined value, estimating a depth of at least a region corresponding to the differential region in the second frame; and
updating an estimation result of the depth of the first frame by using the estimated depth of the region corresponding to the differential region to output the updated estimation result as a new depth estimation result for the second frame.
2 . The image processing device according to claim 1 , wherein the estimation result of the depth of the first frame is output as an estimation result of a depth of at least one frame between the timing of the first frame and the timing of the second frame.
3 . The image processing device according to claim 1 , wherein the one or more processors are configured to:
estimate a depth of an entire second frame when the size of the differential region exceeds a predetermined value, and
using the region corresponding to the differential region in the estimation result of the depth of the entire second frame to output the updated estimation result as the new depth estimation result for the second frame.
4 . An image processing method performed by an image processing device, the image processing method comprising:
calculating a size of a differential region between a first frame and a second frame at a timing later than a timing of the first frame in chronological order in a moving image;
estimating a depth of the first frame and, when the calculated size of the differential region exceeds a predetermined value, estimating a depth of at least a region corresponding to the differential region in the second frame; and
updating an estimation result of the depth of the first frame by using the estimated depth of the region corresponding to the calculated differential region to output the updated estimation result as a new depth estimation result for the second frame.
5 . The image processing method according to claim 4 , further comprising outputting the estimation result of the depth of the first frame as an estimation result of a depth of at least one frame between the timing of the first frame and the timing of the second frame.
6 . A non-transitory computer-readable medium storing program instructions that, when executed, cause one or more processors to perform operations comprising:
calculating a size of a differential region between a first frame and a second frame at a timing later than a timing of the first frame in chronological order in a moving image;
estimating a depth of the first frame and, when the calculated size of the differential region exceeds a predetermined value, estimating a depth of at least a region corresponding to the differential region in the second frame; and
updating an estimation result of the depth of the first frame by using the estimated depth of the region corresponding to the calculated differential region to output the updated estimation result as a new depth estimation result for the second frame.