IP Library › Granted Patent US 11,257,521
Granted Patent B2
US 11,257,521 · App. 17/118,296 · Granted Feb 22, 2022

Systems and methods for generating time-lapse videos

Inventors: Thomas Derbanne (Paris, FR); César Douady (Orsay, FR); Maxim Karpushin (Paris, FR)
Assignee: GoPro, Inc.
G11B27/005G11B27/13G11B27/34H04N5/23258H04N5/23267
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,257,521
App. No.
17/118,296
Granted
Feb 22, 2022
Kind
B2
Abstract

Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.

Claims (33)

1. A system for generating time-lapse videos, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining video content, the video content captured by an image capture device during a capture duration, the video content having a progress length, the video content including video frames that define visual content viewable as a function of progress through the progress length, the video frames corresponding to moments within the progress length;

obtain rotational position information of the image capture device, the rotational position information characterizing rotational positions of the image capture device during the capture duration;

determine time-lapse video frames from the video frames of the video content based on a spatiotemporal metric, the spatiotemporal metric determined based on a speed pattern of the time-lapse video frames, a desired speed pattern for time-lapse video content, moments corresponding to the time-lapse video frames, angular velocity of the image capture device during capture of the time-lapse video frames, and angular acceleration of the image capture device during capture of the time-lapse video frames; and

generate the time-lapse video content based on the time-lapse video frames.

2. The system of claim 1 , wherein the spatiotemporal metric characterizes spatial smoothness and temporal regularity of the time-lapse video frames, the spatial smoothness determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames and the temporal regularity determined based on the moments corresponding to the time-lapse video frames.

3. The system of claim 2 , wherein the spatial smoothness is determined further based on one or more transformations applied to the time-lapse video frames.

4. The system of claim 2 , wherein the spatiotemporal metric is determined further based on a comparison of the speed pattern of the time-lapse video frames and the desired speed pattern for the time-lapse video content, and differences between the moments corresponding to the time-lapse video frames.

5. The system of claim 2 , wherein the spatiotemporal metric is determined further based on the visual content of the time-lapse video frames, and the spatiotemporal metric further characterizes content characteristics of the time-lapse video frames.

6. The system of claim 5 , wherein the speed pattern of the time-lapse video frames is determined based on the content characteristics of the time-lapse video frames.

7. The system of claim 6 , wherein the speed pattern of the time-lapse video frames includes a speed-up for a sub-set of the time-lapse video frames based on the content characteristics of the sub-set of the time-lapse video frames indicating no highlight event within the sub-set of the time-lapse video frames.

8. The system of claim 1 , wherein the one or more physical processors are, to determine the time-lapse video frames, further configured to:

select a set of video frames of the video content based on the spatiotemporal metric; and

stabilize at least some of the set of video frames.

9. The system of claim 8 , wherein the time-lapse video content is generated based on storage of the set of video frames in a frame selection buffer and a stabilization buffer.

10. The system of claim 1 , wherein the time-lapse video frames are determined further based on a skipping bound.

11. A method for generating time-lapse videos, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, video information defining video content, the video content having a progress length, the video content including video frames that define visual content viewable as a function of progress through the progress length, the video frames corresponding to moments within the progress length;

obtaining, by the computing system, rotational position information of the image capture device, the rotational position information characterizing rotational positions of the image capture device during the capture period;

determining, by the computing system, time-lapse video frames from the video frames of the video content based on a spatiotemporal metric, the spatiotemporal metric determined based on a speed pattern of the time-lapse video frames, a desired speed pattern for time-lapse video content, moments corresponding to the time-lapse video frames, angular velocity of the image capture device during capture of the time-lapse video frames, and angular acceleration of the image capture device during capture of the time-lapse video frames; and

generating, by the computing system, the time-lapse video content based on the time-lapse video frames.

12. The method of claim 11 , wherein the spatiotemporal metric characterizes spatial smoothness and temporal regularity of the time-lapse video frames, the spatial smoothness determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames and the temporal regularity determined based on the moments corresponding to the time-lapse video frames.

13. The method of claim 12 , wherein the spatial smoothness is determined further based on one or more transformations applied to the time-lapse video frames.

14. The method of claim 12 , wherein the spatiotemporal metric is determined further based on a comparison of the speed pattern of the time-lapse video frames and the desired speed pattern for the time-lapse video content, and differences between the moments corresponding to the time-lapse video frames.

15. The method of claim 12 , wherein the spatiotemporal metric is determined further based on the visual content of the time-lapse video frames, and the spatiotemporal metric further characterizes content characteristics of the time-lapse video frames.

16. The method of claim 15 , wherein the speed pattern of the time-lapse video frames is determined based on the content characteristics of the time-lapse video frames.

17. The method of claim 16 , wherein the speed pattern of the time-lapse video frames includes a speed-up for a sub-set of the time-lapse video frames based on the content characteristics of the sub-set of the time-lapse video frames indicating no highlight event within the sub-set of the time-lapse video frames.

18. The method of claim 11 , wherein determining the time-lapse video frames includes:

selecting a set of video frames of the video content based on the spatiotemporal metric; and

stabilizing at least some of the set of video frames.

19. The method of claim 18 , wherein the time-lapse video content is generated based on storage of the set of video frames in a frame selection buffer and a stabilization buffer.

20. The method of claim 11 , wherein the time-lapse video frames and the time-lapse video frames are determined further based on a skipping bound.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2020
From: DERBANNE, THOMAS; DOUADY, CESAR; KARPUSHIN, MAXIM
To: GOPRO, INC.
Reel/Frame 054610/0930 →
Continuity (3)
Continuation 16786947 · Feb 10, 2020
Continuation 15978813 · May 14, 2018
Related Publication 20210090607A1 · Mar 25, 2021
Cited By (1)
US 12,211,520