IP Library › Granted Patent US 11,037,602
Granted Patent B2
US 11,037,602 · App. 16/893,694 · Granted Jun 15, 2021

Advanced video editing techniques using sampling patterns

Inventors: Nathan Kenneth Boyd (Los Angeles, CA); Devin Doty (Brooklyn, NY)
Assignee: Snap Inc.
G11B27/031G06K9/00744G06K9/00765H04N21/4312H04N21/47205
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,037,602
App. No.
16/893,694
Filed
Jun 5, 2020
Granted
Jun 15, 2021
Kind
B2
Art Unit
2484
USPC
386/278
Abstract

Systems and methods provide for advanced video editing techniques using sampling patterns. In one example, a computing device can receive a selection of a clip of a video and a sampling pattern. The computing device can determine a respective number of frames to sample from the clip for each interval of time over a length of time for a new clip. For example, the computing device can determine a function corresponding the pattern that relates time and the number of frames to sample, a histogram corresponding to the pattern, or a definite integral corresponding to the pattern, among other approaches. The computing device can extract these numbers of frames from the clip and generate the new clip from the extracted frames. The computing device can present the new clip as a preview and send the new clip to other computing devices.

Claims (64)

1. A method comprising:

determining, by a computing device, individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a non-linear function of the pattern over the plurality of intervals of time, the non-linear function relating a time value and a number of frames to sample from the first clip at the time value, the pattern being associated with a video effect being applied to the first video clip;

extracting, by the computing device, a plurality of frames of the first clip using the individual numbers of frames; and

generating, by the computing device, a second clip based on the plurality of frames.

2. The method of claim 1 , wherein evaluating the non-linear function over the plurality of intervals of time:

determining a histogram corresponding to the pattern; and

evaluating the histogram over the plurality of intervals of time.

3. The method of claim 1 , wherein evaluating the non-linear function over the plurality of intervals of time:

determining a definite integral of the non-linear function; and

evaluating the definite integral over the plurality of intervals of time.

4. The method of claim 1 , further comprising:

displaying a selection bar and a selection slider; and

determining a selection of the first clip from the video based on a position of the selection slider relative to the selection bar.

5. The method of claim 4 , further comprising:

determining a relative length of the selection slider with respect to the selection bar based on a relationship between a first length of time of the first clip and a second length of time of the video.

6. The method of claim 1 , further comprising:

receiving an adjustment factor for determining a second length of time of the second clip relative to a first length of time of the first clip, wherein the plurality of intervals of time occur within the second length of time.

7. The method of claim 1 , further comprising:

displaying a plurality of predetermined sampling patterns; and

receiving the pattern from one of the plurality of predetermined sampling patterns.

8. The method of claim 1 , further comprising:

displaying a drawing interface; and

receiving the pattern as a drawing from the drawing interface.

9. The method of claim 1 , further comprising:

generating a third clip by reversing the plurality of frames; and

presenting the second clip and the third clip on a display of the computing device.

10. The method of claim 1 , further comprising:

receiving, at the computing device, a user input identifying a selection of a second pattern for sampling the first clip;

determining second individual numbers of frames to sample from the first clip for a second plurality of intervals of time using the second pattern;

extracting a second plurality of frames of the first clip using the second individual number of frames; and

generating a third clip using the second plurality of frames.

11. The method of claim 1 , wherein extracting the plurality of frames comprises:

subsampling a first set of frames from at least one first portion of the first clip; and

interpolating a second set of frames of at least one second portion of the first clip.

12. A device comprising:

one or more processors; and

memory including instructions that, upon execution by the one or more processors, cause the device to perform operations comprising:

determining individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a non-linear function of the pattern over the plurality of intervals of time, the non-linear function relating a time value and a number of frames to sample from the first clip at the time value, the pattern being associated with a video effect being applied to the first video clip;

extracting a plurality of frames of the first clip using the individual numbers of frames; and

generating a second clip based on the plurality of frames.

13. The device of claim 12 , wherein the operations further comprise:

displaying one or more user interface elements on a touchscreen of the device; and

receive, at the touchscreen, a length of time for the second clip from the one or more user interface elements, wherein the plurality of intervals of time occur within the length of time.

14. The device of claim 12 , wherein the operations further comprise:

receiving, at a touchscreen of the device, a selection of a second pattern for sampling the first clip;

determining second individual numbers of frames to sample from the first clip for a second plurality of intervals of time using the second pattern;

extracting a second plurality of frames of the first clip using the second individual number of frames; and

generating a third clip using the second plurality of frames.

15. The device of claim 14 , wherein the operations further comprise:

receiving, at the touchscreen, a selection of a first adjustment factor for determining a second length of time of the second clip relative to a first length of time of the first clip, wherein the plurality of intervals of time occur within the second length of time; and

receiving, at the touchscreen, a selection of a second adjustment factor for determining a third length of time of the third clip relative to the first length of time, wherein the second plurality of intervals of time occur within the third length of time.

16. A non-transitory computer-readable storage medium storing instructions that, upon execution by one or more processors of a device, cause the device to perform operations comprising:

determining individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a non-linear function of the pattern over the plurality of intervals of time, the non-linear function relating a time value and a number of frames to sample from the first clip at the time value, the pattern being associated with a video effect being applied to the first video clip;

extracting a plurality of frames of the first clip using the individual numbers of frames; and

generating a second clip based on the plurality of frames.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the operations further comprise:

sending the second video clip to a second device and a duration that the second video clip is accessible on the second device.

18. The non-transitory computer-readable storage medium of claim 16 , wherein a second plurality of frames of a third video clip are in reverse order from the plurality of frames of the second video clip.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the operations further comprise:

sending a video and data for recreating the second video clip from the video to a second device; and

enabling the second device to generate a third video clip from the video.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the operations further comprise:

displaying a drawing interface on a display of the device; and

receiving the pattern as a drawing from the drawing interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2021
From: BOYD, NATHAN KENNETH; DOTY, DEVIN
To: SNAP INC.
Reel/Frame 056196/0281 →
Continuity (2)
Continuation 15691393 · Aug 30, 2017
Related Publication 20200302969A1 · Sep 24, 2020