IP Library Granted Patent US 11,606,489
Granted Patent B1
US 11,606,489 · App. 16/917,054 · Granted Mar 14, 2023

Systems and methods for generating time-lapse videos

Inventors: Thomas Derbanne (Paris, FR); Maxim Karpushin (Paris, FR); Nicolas Rahmouni (Paris, FR)
Assignee: GoPro, Inc.
H04N5/2256G06T7/248G06T7/70G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,606,489
App. No.
16/917,054
Granted
Mar 14, 2023
Kind
B1
Abstract

Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.

Claims (63)

1. An image capture device for generating time-lapse videos using a dynamic time-lapse video frame rate, the image capture device comprising:

a housing;

an image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content;

an optical element carried by the housing and configured to guide light within a field of view to the image sensor;

a position sensor carried by the housing and configured to generate a position output signal conveying position information of the image capture device, the position information characterizing positions of the image capture device; and

one or more physical processors carried by the housing, the one or more physical processors configured by machine-readable instructions to:

determine a position-based time-lapse video frame rate factor based on the position information, the position-based time-lapse video frame rate factor using the positions of the image capture device measured by the position sensor to encourage generation of time-lapse video frames from the visual content captured by the image sensor with the image capture device pointed or oriented in same direction;

determine a visual-based time-lapse video frame rate factor based on the visual information, the visual-based time-lapse video frame rate factor using apparent motion between pairs of images captured by the image sensor to increase or slow down values of the dynamic time-lapse video frame rate;

determine the values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor, the dynamic time-lapse video frame rate defining a rate that changes for generating the time-lapse video frames based on the visual content; and

generate the time-lapse video frames based on the values of the dynamic time-lapse video frame rate.

2. The image capture device of claim 1 , wherein generation of the time-lapse video frames based on the values of the dynamic time-lapse video frame rate includes selection of the time-lapse video frames by the image capture device based on the values of the dynamic time-lapse video frame rate.

3. The image capture device of claim 1 , wherein determination of the position-based time-lapse video frame rate factor based on the position information includes:

determination of periodic motion of the image capture device based on the position information; and

determination of the position-based time-lapse video frame rate factor based on the periodic motion of the image capture device.

4. The image capture device of claim 3 , wherein the periodic motion of the image capture device includes the image capture device alternating between different rotational positions, with the field of view of the optical element being pointed in same direction at periodic moments.

5. The image capture device of claim 1 , wherein:

the position-based time-lapse video frame rate factor includes a first set of scores for different values of the dynamic time-lapse video frame rate;

the visual-based time-lapse video frame rate factor includes a second set of scores for different values of the dynamic time-lapse video frame rate; and

the values of the dynamic time-lapse video frame rate are determined based on combination of the first set of scores from the position-based time-lapse video frame rate factor and the second set of scores from the visual-based time-lapse video frame rate factor.

6. The image capture device of claim 1 , wherein determination of the values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor includes:

determination of an initial value of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor; and

adjustment of the initial value of the dynamic time-lapse video frame rate based on the visual-based time-lapse video frame rate factor.

7. The image capture device of claim 1 , wherein determination of the visual-based time-lapse video frame rate factor based on the visual information includes:

determination of the apparent motion between the visual content of a pair of images captured by the image sensor; and

determination of the visual-based time-lapse video frame rate factor based on the apparent motion between the visual content of the pair of images captured by the image sensor.

8. The image capture device of claim 7 , wherein the pair of images captured by the image sensor includes a pair of sequential images captured by the image sensor.

9. The image capture device of claim 7 , wherein the apparent motion between the visual content of the pair of images captured by the image sensor is determined based on optical flow between the pair of images captured by the image sensor.

10. A method for generating time-lapse videos using a dynamic time-lapse video frame rate, the method performed by an image capture device including one or more processors, an image sensor, an optical element, and a position sensor, the image sensor configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content, the optical element configured to guide light within a field of view to the image sensor, the position sensor configured to generate a position output signal conveying position information of the image capture device, the position information characterizing positions of the image capture device, the method comprising:

determining a position-based time-lapse video frame rate factor based on the position information, the position-based time-lapse video frame rate factor using the positions of the image capture device measured by the position sensor to encourage generation of time-lapse video frames from the visual content captured by the image sensor with the image capture device pointed or oriented in same direction;

determining a visual-based time-lapse video frame rate factor based on the visual information, the visual-based time-lapse video frame rate factor using apparent motion between pairs of images captured by the image sensor to increase or slow down values of the dynamic time-lapse video frame rate;

determining the values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor, the dynamic time-lapse video frame rate defining a rate that changes for generating the time-lapse video frames based on the visual content; and

generating the time-lapse video frames based on the values of the dynamic time-lapse video frame rate.

11. The method of claim 10 , wherein generating the time-lapse video frames based on the values of the dynamic time-lapse video frame rate includes selecting the time-lapse video frames by the image capture device based on the values of the dynamic time-lapse video frame rate.

12. The method of claim 10 , wherein determining the position-based time-lapse video frame rate factor based on the position information includes:

determining periodic motion of the image capture device based on the position information; and

determining the position-based time-lapse video frame rate factor based on the periodic motion of the image capture device.

13. The method of claim 12 , wherein the periodic motion of the image capture device includes the image capture device alternating between different rotational positions, with the field of view of the optical element being pointed in same direction at periodic moments.

14. The method of claim 10 , wherein:

the position-based time-lapse video frame rate factor includes a first set of scores for different values of the dynamic time-lapse video frame rate;

the visual-based time-lapse video frame rate factor includes a second set of scores for different values of the dynamic time-lapse video frame rate; and

the values of the dynamic time-lapse video frame rate are determined based on combination of the first set of scores from the position-based time-lapse video frame rate factor and the second set of scores from the visual-based time-lapse video frame rate factor.

15. The method of claim 10 , wherein determining the values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor includes:

determining an initial value of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor; and

adjusting the initial value of the dynamic time-lapse video frame rate based on the visual-based time-lapse video frame rate factor.

16. The method of claim 10 , wherein determining the visual-based time-lapse video frame rate factor based on the visual information includes:

determining the apparent motion between the visual content of a pair of images captured by the image sensor; and

determining the visual-based time-lapse video frame rate factor based on the apparent motion between the visual content of the pair of images captured by the image sensor.

17. The method of claim 16 , wherein the pair of images captured by the image sensor includes a pair of sequential images captured by the image sensor.

18. The method of claim 16 , wherein the apparent motion between the visual content of the pair of images captured by the image sensor is determined based on optical flow between the pair of images captured by the image sensor.

19. An image capture device for generating time-lapse videos using a dynamic time-lapse video frame rate, the image capture device comprising:

a housing;

an image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content;

an optical element carried by the housing and configured to guide light within a field of view to the image sensor;

a position sensor carried by the housing and configured to generate a position output signal conveying position information of the image capture device, the position information characterizing positions of the image capture device; and

one or more physical processors carried by the housing, the one or more physical processors configured by machine-readable instructions to:

determine a position-based time-lapse video frame rate factor based on the position information, the position-based time-lapse video frame rate factor using the positions of the image capture device measured by the position sensor to encourage generation of time-lapse video frames from the visual content captured by the image sensor with the image capture device pointed or oriented in same direction;

determine a visual-based time-lapse video frame rate factor based on the visual information, the visual-based time-lapse video frame rate factor using apparent motion between pairs of images captured by the image sensor to increase or slow down values of the dynamic time-lapse video frame rate;

determine the values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor, the dynamic time-lapse video frame rate defining a rate that changes for generating the time-lapse video frames based on the visual content; and

generate the time-lapse video frames based on the values of the dynamic time-lapse video frame rate, wherein at least some of the time-lapse video frames are stabilized based on a punchout of the at least some of the time-lapse video frames.

20. The image capture device of claim 19 , wherein:

the position-based time-lapse video frame rate factor includes a first set of scores for different values of the dynamic time-lapse video frame rate;

the visual-based time-lapse video frame rate factor includes a second set of scores for different values of the dynamic time-lapse video frame rate; and

the values of the dynamic time-lapse video frame rate are determined based on combination of the first set of scores from the position-based time-lapse video frame rate factor and the second set of scores from the visual-based time-lapse video frame rate factor.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2020
From: DERBANNE, THOMAS; KARPUSHIN, MAXIM; RAHMOUNI, NICOLAS
To: GOPRO, INC.
Reel/Frame 053089/0943 →
Continuity (2)
Provisional Application 62897535 · Sep 9, 2019
Provisional Application 62869711 · Jul 2, 2019
Cited By (2)
US 12,244,962 US 12,720,010