System and method for representing long video sequences
Systems and procedures for transforming video into a condensed visual representation. An example procedure may include receiving video comprised of a plurality of frames. For each frame, the example procedure may create a first representation, reduced in one dimension, wherein a visual property of each pixel of the first representation is assigned by aggregating a visual property of the pixels of the frame having the same position in the unreduced dimension. The example procedure may further form a condensed visual representation including the first representations aligned along the reduced dimension according to an order of the frames in the video.
1. A method comprising:
receiving content comprising a plurality of frames;
condensing the content to determine a condensed visual representation and metadata for each frame of the plurality of frames;
determining, based on the condensed visual representation, a plurality of points in the content, each of the plurality of points comprising a transition point or an insertion point in the content; and
causing simultaneous display of the condensed visual representation and identifiers of each of the plurality of points relative to the condensed visual representation.
2. The method of claim 1 , wherein condensing the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames comprises:
aggregating, for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation of each frame; and
aligning the first representation of each frame according to an order of the plurality of frames in the content to determine the condensed visual representation.
3. The method of claim 2 , wherein aggregating the visual property of each of the plurality of pixels comprises averaging the color of each of the plurality of pixels.
4. The method of claim 3 , wherein the metadata for each frame comprises a standard deviation of the colors of the pixels in the frame from the average color.
5. The method of claim 2 , wherein the first representation of each frame is one pixel wide.
6. The method of claim 1 , wherein condensing the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames comprises:
grouping a plurality of pixels of each frame into a block;
aggregating, for each block, a visual property of each of the plurality of pixels; and
replacing the plurality of pixels of each block with the aggregated visual property.
7. The method of claim 6 , wherein grouping the plurality of pixels of each frame into the block comprises grouping the plurality of pixels of each frame into a predetermined number of blocks.
8. The method of claim 7 , wherein the predetermined number of blocks is:
received as a user selection; or
automatically determined based on one of a dimension of the plurality of frames, an amount of visual information contained in each frame, and a visual characteristic of the content.
9. The method of claim 1 , further comprising inserting supplemental content in the content at one of the determined plurality of points in the content.
10. The method of claim 9 , wherein the supplemental content comprises a local advertisement.
11. The method of claim 1 , wherein the metadata for each frame comprises a time stamp of the frame.
12. The method of claim 1 , wherein causing simultaneous display of the condensed visual representation and the identifiers of each of the plurality of points relative to the condensed visual representation further comprises causing display of a frame of the plurality of frames associated with one of the plurality of points and causing display of a predetermined number of additional frames surrounding the frame in the content.
13. The method of claim 1 , wherein the transition point comprises a scene cut in the content.
14. A device comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the device to:
receive content comprising a plurality of frames;
condense the content to determine a condensed visual representation and metadata for each frame of the plurality of frames;
determine, based on the condensed visual representation, a plurality of points in the content, each of the plurality of points comprising a transition point or an insertion point in the content; and
cause simultaneous display of the condensed visual representation and identifiers of each of the plurality of points relative to the condensed visual representation.
15. The device of claim 14 , wherein the instructions, when executed, cause the device to condense the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames by:
aggregating, for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation of each frame; and
aligning the first representation of each frame according to an order of the plurality of frames in the content to determine the condensed visual representation.
16. The device of claim 15 , wherein the instructions, when executed, cause the device to aggregate the visual property of each of the plurality of pixels by averaging the color of each of the plurality of pixels.
17. The device of claim 14 , wherein the instructions, when executed, further cause the device to insert supplemental content in the content at one of the determined plurality of points in the content.
18. A non-transitory computer-readable storage medium comprising a plurality of computer-executable instructions that, when executed, cause:
receiving content comprising a plurality of frames;
condensing the content to determine a condensed visual representation and metadata for each frame of the plurality of frames;
determining, based on the condensed visual representation, a plurality of points in the content, each of the plurality of points comprising a transition point or an insertion point in the content; and
causing simultaneous display of the condensed visual representation and identifiers of each of the plurality of points relative to the condensed visual representation.
19. The computer-readable medium of claim 18 , wherein the instructions, when executed, cause condensing the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames by:
aggregating, for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation of each frame; and
aligning the first representation of each frame according to an order of the plurality of frames in the content to determine the condensed visual representation.
20. The computer-readable medium of claim 19 , wherein the instructions, when executed, cause aggregating the visual property of each of the plurality of pixels by averaging the color of each of the plurality of pixels.