Microvideo system, format, and method of generation
An image capture device includes an image sensor configured to capture raw image data, an image signal processor configured to process the raw image data to form a plurality of image frames, and one or more processors to implement a microvideo generation system. The microvideo generation system is configured to perform a trimming operation relating to the plurality of image frames according to one or more image criteria, and generate, based on the trimming operation, a microvideo including a still image and a video in a same data file.
1 . An image capture device, comprising:
an image sensor configured to capture raw image data;
an image signal processor configured to process the raw image data to form a plurality of image frames; and
one or more processors to implement a microvideo generation system which is configured to:
perform a trimming operation relating to the plurality of image frames according to one or more image criteria, and
generate, based on the trimming operation, a microvideo comprising a still image and a video in a same data file.
2 . The image capture device of claim 1 , wherein the microvideo generation system is configured to, when a duration of the microvideo is less than a minimum duration threshold, store the still image and delete the microvideo.
3 . The image capture device of claim 1 , wherein the microvideo generation system is configured to, when a duration of the microvideo is less than a minimum duration threshold, add image frames to at least one of a beginning of the microvideo or an end of the microvideo until the duration of the microvideo is greater than or equal to the minimum duration threshold.
4 . The image capture device of claim 1 , wherein
the image sensor is configured to capture further raw image data;
the image signal processor is configured to process the further raw image data to form a further plurality of image frames; and
the microvideo generation system is configured to:
perform a further trimming operation relating to the further plurality of image frames according to the one or more image criteria, and
generate, based on the further trimming operation, a further microvideo comprising another still image and a further video in a same further data file,
wherein the microvideo generation system is configured to generate the further microvideo in parallel with generating the microvideo.
5 . The image capture device of claim 4 , wherein the microvideo and the further microvideo have different durations.
6 . The image capture device of claim 4 , wherein the microvideo and the further microvideo have different content from each other.
7 . The image capture device of claim 4 , wherein the further microvideo is generated in parallel with generating the microvideo in response to the image capture device receiving a user control input to capture an image more than a threshold number of times within a predetermined time period.
8 . The image capture device of claim 1 , wherein the still image is displayable at a same or higher resolution than image frames which form the video.
9 . The image capture device of claim 1 , wherein
the microvideo generation system is configured to perform the trimming operation relating to the plurality of image frames according to one or more image criteria by:
identifying a start frame from among a shutter frame or one or more image frames occurring before the shutter frame, from among the plurality of image frames, and
identifying an end frame corresponding to an image frame occurring after the shutter frame, from among the plurality of image frames, and
the microvideo extends from the start frame to the end frame.
10 . The image capture device of claim 9 , wherein
the microvideo generation system is configured to identify the start frame according to the one or more image criteria, and
the one or more image criteria includes first motion information associated with the start frame and second motion information associated with the shutter frame.
11 . The image capture device of claim 10 , wherein the microvideo generation system is configured to compare a difference between the first motion information and the second motion information with a threshold motion value to identify the start frame.
12 . The image capture device of claim 11 , wherein the threshold motion value adaptively changes based on a speed of the image capture device indicated by the first motion information associated with the start frame and the second motion information associated with the shutter frame.
13 . The image capture device of claim 9 , wherein
the microvideo generation system is configured to identify the start frame according to the one or more image criteria, and
the one or more image criteria includes first total sensitivity information associated with the start frame and second total sensitivity information associated with the shutter frame.
14 . The image capture device of claim 13 , wherein the microvideo generation system is configured to determine the first total sensitivity information based on sensor sensitivity information and exposure time information associated with the start frame.
15 . The image capture device of claim 9 , wherein
the microvideo generation system is configured to identify the start frame according to the one or more image criteria, and
the one or more image criteria includes first zoom information associated with the start frame and second zoom information associated with the shutter frame.
16 . The image capture device of claim 9 , wherein
the microvideo generation system is configured to identify the start frame according to the one or more image criteria, and
the one or more image criteria includes focus information associated with the start frame indicating whether the start frame is out of focus.
17 . The image capture device of claim 9 , wherein the microvideo generation system is configured to identify the start frame according to the one or more image criteria and to identify the end frame according to the one or more image criteria.
18 . The image capture device of claim 17 , wherein the microvideo generation system is configured to identify the end frame as an image frame which occurs at a predetermined duration of time after the shutter frame, when the one or more image criteria are not satisfied with respect to the one or more image frames occurring after the shutter frame and within the predetermined duration of time after the shutter frame.
19 . A computer-implemented method, the method comprising:
processing, by a computing system comprising one or more processors, raw image data captured by an image sensor to form a plurality of image frames;
performing, by the computing system, a trimming operation relating to the plurality of image frames according to one or more image criteria; and
generating, based on the trimming operation, a microvideo comprising a still image and a video in a same data file.
20 . One or more non-transitory computer-readable media that store instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations comprising:
processing raw image data captured by an image sensor to form a plurality of image frames;
performing a trimming operation relating to the plurality of image frames according to one or more image criteria; and
generating, based on the trimming operation, a microvideo comprising a still image and a video in a same data file.