Image generation device, imaging device, image generation method, and program for generating a new image from a captured image based on a cut-out frame
An image generating device has a camerawork information extracting unit that extracts imaging information of a captured image, a composition information calculating unit that temporarily decides a cut-out frame for cutting out a new image from the imaging information and the captured image based on a constraint condition, and decides a cut-out frame to smooth a change of the new image between frames, from the temporarily decided cut-out frame, each of the frames being a unit of an image, and a composition information shaping unit that cuts out the new image from the captured image by using the cut-out frame, and converts a size of the new image to a predetermined size. The new image generated from the captured image becomes a favorable image that is easy to see for a viewer, and particularly a more smooth and natural image, without any skilled imaging techniques during capturing.
1. An image generating device comprising:
a human detector implemented by a processor that detects a human from a captured image;
a motion detector implemented by a processor that identifies a motion between frames from the captured image, each of the frames being a unit of an image;
a cut-out frame decider implemented by a processor that temporarily decides a cut-out frame for cutting out a new image from the detected human and the identified motion based on a constraint condition regarding a camerawork between the frames;
a cut-out frame corrector implemented by a processor that interpolates the cut-out frame to reproduce the new image smoothly; and
a composition information shaper implemented by a processor that cuts out the new image from the captured image by using the cut-out frame interpolated by the cut-out frame corrector, and converts a size of the new image to a predetermined size.
2. The image generating device according to claim 1 , wherein the constraint condition includes at least one of a horizontal moving time, a vertical moving time, a zoom-out time, and a zoom-in time.
3. An imaging device comprising:
an imaging system that captures an image; and
the image generating device according to claim 1 .
4. An image generating method comprising:
detecting a human from a captured image;
identifying a motion between frames from the captured image, each of the frames being a unit of an image;
temporarily deciding a cut-out frame for cutting out a new image from the detected human and the identified motion based on a constraint condition regarding a camerawork between the frames;
interpolating the cut-out frame to reproduce the new image smoothly; and
cutting out the new image from the captured image by using the interpolated cut-out frame, and converting a size of the new image to a predetermined size.
5. A program stored on a non-transitory computer-readable medium for enabling a computer to perform a method comprising:
detecting a human from a captured image;
identifying a motion between frames from the captured image, each of the frames being a unit of an image;
temporarily deciding a cut-out frame for cutting out a new image from the detected human and the identified motion based on a constraint condition regarding a camerawork between the frames;
interpolating the cut-out frame to reproduce the new image smoothly; and
cutting out the new image from the captured image by using the interpolated cut-out frame, and converting a size of the new image to a predetermined size.