IP Library Granted Patent US 9,679,605
Granted Patent B2
US 9,679,605 · App. 14/609,227 · Granted Jun 13, 2017

Variable playback speed template for video editing application

Inventors: Joven Michael Matias (Cardiff, CA); Otto Kenneth Sievert (Oceanside, CA); Joshua Edward Bodinet (San Diego, CA)
Assignee: GoPro, Inc.
G11B27/005G06F17/30817G11B27/022G11B27/031G11B27/28H04N5/765H04N5/783H04N5/93H04N9/8205
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,679,605
App. No.
14/609,227
Granted
Jun 13, 2017
Kind
B2
Abstract

A playback speed effect is applied to a video using a playback speed template. The playback speed template specifies playback speed ratios (i.e., ratios between playback duration and capture duration) at the highlight moment, at a template start time, and at a template end time. A video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video is accessed. An input portion of the video including the highlight moment is identified. The duration of the input portion has a duration depending on the template start time and the template end time. A playback speed template is applied to the input portion. A modified video including a modified video portion is generated from the input portion of the video according to the applied playback speed template and is provided for subsequent playback.

Claims (57)

1. A computer-implemented method for applying a playback speed effect to videos, the method comprising:

accessing a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

accessing a previously stored playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

aligning the template highlight time to the highlight capture time;

generating a modified video by applying the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video subsequent to the alignment of the template highlight time to the highlight capture time of the video, the application of the playback speed ratios to the corresponding portions of the video modifying playback durations of the corresponding portions of the video according to the playback speed ratios;

and

providing the modified video for subsequent playback.

2. The method of claim 1 , wherein the previously stored playback speed template specifies one or more progressions of playback speed ratios at times between the template start time, the template highlight time, and the template end time.

3. The method of claim 1 , wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag associated with the highlight moment.

4. The method of claim 1 , wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

5. The method of claim 1 , further comprising:

generating a summary video comprising the modified video placed in a slot of a video summary template,

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.

6. The method of claim 5 , wherein the slot of the video summary template has a slot duration, and wherein aligning the template highlight time to the highlight capture time comprises:

determining a default playback duration of the previously stored playback speed template according to the playback speed ratios at the template times between the template start time and the template end time;

modifying the previously stored playback speed template by temporally scaling template times of the previously stored playback speed template by a ratio of the slot duration to the default playback duration, the temporal scaling of the template times modifying the template highlight time; and

aligning the modified template highlight time to the highlight capture time.

7. The method of claim 1 , wherein the corresponding portions of the video comprises video frames, and wherein applying the playback speed ratios comprises:

identifying a template frame time for individual video frame relatives to the template highlight time by comparing a capture time of the individual video frames to the highlight capture time; and

determining a playback time for the individual video frames using the playback speed ratios to determine a duration of time accumulated between the template highlight time and the template frame time for the individual video frames; and

wherein the modified video is generated based on the playback time determined for the individual video frames.

8. The method of claim 7 , wherein generating the modified video comprises generating additional frames interpolated between the video frames to match a frame rate of the modified video with a specified frame rate.

9. A non-transitory, computer-readable medium storing instructions for applying a playback speed effect to videos, the instructions when executed causing one or more physical processors to:

access a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

access a previously stored playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

align the template highlight time to the highlight capture time;

generate a modified video by apply the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video subsequent to the alignment of the template highlight time to the highlight capture time of the video, the application of the playback speed ratios to the corresponding portions of the video modifying playback durations of the corresponding portions of the video according to the playback speed ratios;

and

provide the modified video for subsequent playback.

10. The medium of claim 9 , wherein the previously stored playback speed template specifies one or more progressions of playback speed ratios at times between the template start time, the template highlight time, and the template end time.

11. The medium of claim 9 , wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag associated with the highlight moment.

12. The medium of claim 9 , wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

13. The medium of claim 9 , wherein the execution of the instructions further causes the one or more physical processors to:

generate a summary video comprising the modified video placed in a slot of a video summary template, and

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.

14. The medium of claim 13 , wherein the slot of the video summary template has a slot duration, and wherein aligning the template highlight time to the highlight capture time comprises:

determining a default playback duration of the previously stored playback speed template according to the playback speed ratios at the template times between the template start time and the template end time;

modifying the previously stored playback speed template by temporally scaling template times of the previously stored playback speed template by a ratio of the slot duration to the default playback duration, the temporal scaling of the template times modifying the template highlight time; and

aligning the modified template highlight time to the highlight capture time.

15. The medium of claim 9 , wherein the corresponding portions of the video comprises video frames, and wherein applying the playback speed ratios comprises:

identifying a template frame time for individual video frame relatives to the template highlight time by comparing a capture time of the individual video frames to the highlight capture time; and

determining a playback time for the individual video frames using the playback speed ratios to determine a duration of time accumulated between the template highlight time and the template frame time for the individual video frames; and

wherein the modified video is generated based on the playback time determined for the individual video frames.

16. The medium of claim 15 , wherein generating the modified video comprises generating additional frames interpolated between the plurality of video frames to match a frame rate of the modified video with a specified frame rate.

17. A computing system for applying a playback speed effect to videos, the system comprising:

a non-transitory computer-readable memory storing computer-readable instructions; and

one or more physical processors configured by the computer-readable instructions to:

access a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

access a previously stored playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

align the template highlight time to the highlight capture time;

generate a modified video by applying the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video subsequent to the alignment of the template highlight time to the highlight capture time of the video, the application of the playback speed ratios to the corresponding portions of the video modifying playback durations of the corresponding portions of the video according to the playback speed ratios; and

provide the modified video for subsequent playback.

18. The system of claim 17 , wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag associated with the highlight moment.

19. The system of claim 17 , wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

20. The system of claim 19 , wherein the one or more physical processors are further configured to:

generate a summary video comprising the modified video placed in a slot of a video summary template,

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY AGREEMENT Recorded Mar 28, 2016
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 038184/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2015
From: MATIAS, JOVEN MICHAEL; SIEVERT, OTTO KENNETH; BODINET, JOSHUA EDWARD
To: GOPRO, INC.
Reel/Frame 036649/0247 →
Continuity (1)
Related Publication 20160225405A1 · Aug 4, 2016