Electronic device including camera and method for generating video recording of a moving object

1 . An electronic device comprising:

a display;

a memory configured to store instructions; and

a processor,

wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to:

receive a video signal including a subject;

based on receiving the video signal, obtain a plurality of frame images, each frame image of the plurality of frame images having a first size;

estimate a movement trajectory of the subject included in the plurality of frame images;

stitch together the frame images for generating a stitched image in which overlapping portions of the frame images are arranged to overlap according to the movement trajectory of the subject, the stitched image having a second size larger than the first size; and

store the stitched image and the plurality of frame images as a video file,

wherein the second size of the stitched image is predicted according to the movement trajectory, in the case when frame images are stitched.

2 . The electronic device of claim 1 , wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to:

store the frame images to be played, based on the stitched image;

call the stitched image of the second size to the display when playing the video file; and

display data of the stitched image being generated using pixel data of the frame images.

3 . The electronic device of claim 1 , wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to:

identify a distance according to the movement trajectory of the subject; and

scale the plurality of frame images to fit the second size of the stitched image.

4 . The electronic device of claim 1 , wherein the stitched image is an image obtained by arranging the plurality of frame images in a virtual two-dimensional or three-dimensional space, and stitching overlapping portions of adjacently arranged frame images.

5 . The electronic device of claim 4 , wherein the stitched image is generated in a size having four vertices where outermost boundary lines of frame images in which parts having a same image signal among the frame images are arranged in an overlapping form in a two-dimensional image are extended and met.

6 . The electronic device of claim 1 , wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to:

extract a motion vector of motion of the subject according to a position of the subject for each frame image; and

verify whether each motion vector is valid to generate a respective validated object motion,

wherein the estimate of the movement trajectory is obtained by connecting the validated object motions.

7 . The electronic device of claim 6 , wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to calculate an amount of change of the motion vector corresponding to a movement of the subject, and determine whether the amount of change is equal to or greater than a set threshold to verify validity, for each frame image.

8 . The electronic device of claim 7 , wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to:

identify one or more invalid object motions based on a respective motion vector having an associated amount of change that is less than the set threshold;

exclude motion vector data of the invalid object motion and generate replacement data to replace the invalid object motion; and

estimate the movement trajectory of the subject, based on the data verified as the valid object motion and the replacement data.

9 . The electronic device of claim 6 , wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to perform trajectory smoothing with the object motion in which the movement trajectory is smoothed by removing small shake data of the movement trajectory.

10 . The electronic device of claim 3 , wherein the instructions, when individually or collectively executed by the processor, cause the electronic device to calculate a correction value for scaling the first size of all frame images according to the second size of the stitched image, and scale the first size of all frame images by applying the correction value.

11 . A method of generating a video by recording a moving subject using an electronic device, the method comprising:

receiving, with the electronic device, a video signal including a subject;

based on receiving the video signal, obtaining a plurality of frame images, each frame image of the plurality of frame images having a first size;

estimating a movement trajectory of the subject included in the plurality of frame images;

stitching together the frame images for generating a stitched image in which overlapping portions of the frame images are arranged to overlap according to the movement trajectory of the subject, the stitched image having a second size larger than the first size; and

storing, in a memory of the electronic device, the stitched image and the plurality of frame images as a video file,

wherein the second size of the stitched image is predicted according to the movement trajectory, in the case when frame images are stitched,

wherein, in the storing, the plurality of frame images are stored to be played based on the stitched image.

12 . The method of claim 11 , wherein the generating a stitched image further comprises:

identifying a distance according to the movement trajectory of the subject; and

scaling the frame images according to the second size of the stitched image,

wherein the scaled frame images are stored in a memory of the electronic device.

13 . The method of claim 11 , further comprising:

extracting a motion vector of motion of the subject according to a position of the subject for each frame image;

verifying whether each motion vector is valid; and

generating respective validated object motion for each frame image,

wherein estimating the movement trajectory comprises connecting validated object motions.

14 . The method of claim 13 , wherein the verifying whether the motion vectors are valid comprises:

calculating an amount of change of the motion vector corresponding to a movement of the subject, and determining whether the amount of change is equal to or greater than a set threshold to verify validity, for each frame image;

identifying one or more invalid object motions based on a respective motion vector having an associated amount of change that is less than the set threshold;

excluding motion vector data of the invalid object motion and generating replacement data to replace the invalid object motion; and

estimating the movement trajectory of the subject, based on the data verified as the valid object motion and the replacement data.

15 . The method of claim 11 , wherein the estimating the movement trajectory of the subject comprises performing trajectory smoothing with an object motion in which the movement trajectory is smoothed by removing small shake data of the movement trajectory.

16 . The method of claim 12 , wherein the scaling the frame images comprises calculating a correction value for scaling the first size of all frame images according to the second size of the stitched image, and scaling the first size of all frame images by applying the correction value.

17 . A method of generating a video comprising:

obtaining a plurality of frame images with a camera of an electronic device, wherein each frame image has a first size;

identifying a subject in the plurality of frame images;

estimating a movement trajectory of the subject across the plurality of frame images;

generating a stitched image by stitching together at least some of the plurality of frame images based on the estimated movement trajectory, wherein the stitched image has a second size that is greater than the first size; and

storing, in a memory of the electronic device, the stitched image and the plurality of frame images as a video file, wherein the plurality of frame images are configured to be played as a video based on the stitched image,

wherein the second size of the stitched image is predicted according to the movement trajectory, in the case when frame images are stitched.

18 . The method of claim 17 , wherein the stitched image is generated by stitching together multiple of the plurality of frame images, wherein frame images having overlapping portions of a video signal are arranged to overlap according to the movement trajectory of the subject.

19 . The method of claim 17 , further comprising:

extracting a motion vector of motion of the subject according to a position of the subject for each frame image;

verifying whether each motion vector is valid; and

generating respective validated object motion for each frame image,

wherein estimating the movement trajectory comprises connecting validated object motions.

20 . The method of claim 19 , wherein the verifying whether the motion vectors are valid comprises:

calculating an amount of change of the motion vector corresponding to a movement of the subject, and determining whether the amount of change is equal to or greater than a set threshold to verify validity, for each frame image;

identifying one or more invalid object motions based on a respective motion vector having an associated amount of change that is less than the set threshold;

excluding motion vector data of the invalid object motion and generating replacement data to replace the invalid object motion; and

estimating the movement trajectory of the subject, based on the data verified as the valid object motion and the replacement data.