Granted Patent B2

US 12,244,962 · App. 18/416,553 · Granted Mar 4, 2025

Inventors: Thomas Derbanne (Paris, FR); Maxim Karpushin (Paris, FR); Nicolas Rahmouni (Paris, FR)

Assignee: GoPro, Inc.

H04N7/0127G06T7/248G06T7/269G06T7/70H04N5/2628H04N23/56G06T2207/10016G06T2207/30244

Abstract

Claims (68)

1. A system for generating time-lapse videos using a dynamic time-lapse video frame rate, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain visual information, the visual information defining visual content of images captured by an image sensor, the image sensor carried by an image capture device;

obtain position information, the position information characterizing positions of the image capture device, the position information generated based on the positions of the image capture device measured by a position sensor, the position sensor carried by the image capture device;

determine a position-based time-lapse video frame rate factor based on the positions of the image capture device measured by the position sensor;

determine a visual-based time-lapse video frame rate factor based on apparent motion between the visual content of pairs of the images captured by the image sensor;

determine values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor, the dynamic time-lapse video frame rate defining a rate for generating time-lapse video frames based on the visual content of the images captured by the image sensor;

generate the time-lapse video frames based on the values of the dynamic time-lapse video frame rate; and

present the time-lapse video frames on a display.

2. The system of claim 1 , wherein:

the images are stored in a buffer; and

generation of the time-lapse video frames based on the values of the dynamic time-lapse video frame rate includes selection of the time-lapse video frames from the images stored in the buffer based on the values of the dynamic time-lapse video frame rate.

3. The system of claim 2 , wherein determination of the visual-based time-lapse video frame rate factor includes:

determination of the apparent motion between the visual content of a given pair of the images captured by the image sensor; and

determination of the visual-based time-lapse video frame rate factor based on the apparent motion between the visual content of the given pair of the images captured by the image sensor.

4. The system of claim 3 , wherein the apparent motion between the visual content of the given pair of the images captured by the image sensor is determined based on optical flow between the given pair of the images captured by the image sensor.

5. The system of claim 4 , wherein the apparent motion between the visual content of the given pair of the images captured by the image sensor is determined as one or more values that indicate length, direction, and/or type of the optical flow between the given pair of the images captured by the image sensor.

6. The system of claim 1 , wherein determination of the position-based time-lapse video frame rate factor includes:

determination of periodic motion of the image capture device based on the positions of the image capture device; and

determination of the position-based time-lapse video frame rate factor based on the periodic motion of the image capture device.

7. The system of claim 6 , wherein the periodic motion of the image capture device includes the image capture device alternating between different rotational positions, with a field of view of the image capture device being pointed in same direction at periodic moments.

8. The system of claim 1 , wherein:

the position-based time-lapse video frame rate factor includes a first set of scores for different values of the dynamic time-lapse video frame rate;

the visual-based time-lapse video frame rate factor includes a second set of scores for different values of the dynamic time-lapse video frame rate; and

the values of the dynamic time-lapse video frame rate are determined based on combination of the first set of scores from the position-based time-lapse video frame rate factor and the second set of scores from the visual-based time-lapse video frame rate factor.

9. The system of claim 1 , wherein determination of the values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor includes:

determination of an initial value of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor; and

adjustment of the initial value of the dynamic time-lapse video frame rate based on the visual-based time-lapse video frame rate factor.

10. A method for generating time-lapse videos using a dynamic time-lapse video frame rate, the method performed by a system including one or more processors, the method comprising:

obtaining visual information, the visual information defining visual content of images captured by an image sensor, the image sensor carried by an image capture device;

obtaining position information, the position information characterizing positions of the image capture device, the position information generated based on the positions of the image capture device measured by a position sensor, the position sensor carried by the image capture device;

determining a position-based time-lapse video frame rate factor based on the positions of the image capture device measured by the position sensor;

determining a visual-based time-lapse video frame rate factor based on apparent motion between the visual content of pairs of the images captured by the image sensor;

determining values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor, the dynamic time-lapse video frame rate defining a rate for generating time-lapse video frames based on the visual content of the images captured by the image sensor;

generating the time-lapse video frames based on the values of the dynamic time-lapse video frame rate; and

presenting the time-lapse video frames on a display.

11. The method of claim 10 , wherein:

the images are stored in a buffer; and

generating the time-lapse video frames based on the values of the dynamic time-lapse video frame rate includes selecting the time-lapse video frames from the images stored in the buffer based on the values of the dynamic time-lapse video frame rate.

12. The method of claim 11 , wherein determining the visual-based time-lapse video frame rate factor includes:

determining the apparent motion between the visual content of a given pair of the images captured by the image sensor; and

determining the visual-based time-lapse video frame rate factor based on the apparent motion between the visual content of the given pair of the images captured by the image sensor.

13. The method of claim 12 , wherein the apparent motion between the visual content of the given pair of the images captured by the image sensor is determined based on optical flow between the given pair of the images captured by the image sensor.

14. The method of claim 13 , wherein the apparent motion between the visual content of the given pair of the images captured by the image sensor is determined as one or more values that indicate length, direction, and/or type of the optical flow between the given pair of the images captured by the image sensor.

15. The method of claim 10 , wherein determining the position-based time-lapse video frame rate factor includes:

determining periodic motion of the image capture device based on the positions of the image capture device; and

determining the position-based time-lapse video frame rate factor based on the periodic motion of the image capture device.

16. The method of claim 15 , wherein the periodic motion of the image capture device includes the image capture device alternating between different rotational positions, with a field of view of the image capture device being pointed in same direction at periodic moments.

17. The method of claim 10 , wherein:

the position-based time-lapse video frame rate factor includes a first set of scores for different values of the dynamic time-lapse video frame rate;

the visual-based time-lapse video frame rate factor includes a second set of scores for different values of the dynamic time-lapse video frame rate; and

the values of the dynamic time-lapse video frame rate are determined based on combination of the first set of scores from the position-based time-lapse video frame rate factor and the second set of scores from the visual-based time-lapse video frame rate factor.

18. The method of claim 10 , wherein determining the values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor includes:

determining an initial value of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor; and

adjusting the initial value of the dynamic time-lapse video frame rate based on the visual-based time-lapse video frame rate factor.

19. A system for generating time-lapse videos using a dynamic time-lapse video frame rate, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain visual information, the visual information defining visual content of images captured by an image sensor, the image sensor carried by an image capture device;

obtain position information, the position information characterizing positions of the image capture device, the position information generated based on the positions of the image capture device measured by a position sensor, the position sensor carried by the image capture device;

determine a position-based time-lapse video frame rate factor based on the positions of the image capture device measured by the position sensor;

determine a visual-based time-lapse video frame rate factor based on apparent motion between the visual content of pairs of the images captured by the image sensor;

determine values of the dynamic time-lapse video frame rate based on the position-based time-lapse video frame rate factor and the visual-based time-lapse video frame rate factor, the dynamic time-lapse video frame rate defining a rate for generating time-lapse video frames based on the visual content of the images captured by the image sensor;

generate the time-lapse video frames based on the values of the dynamic time-lapse video frame rate, wherein at least some of the time-lapse video frames are stabilized based on a punchout of the visual content of the images captured by the image sensor; and

present the time-lapse video frames on a display.

20. The system of claim 19 , wherein:

the position-based time-lapse video frame rate factor includes a first set of scores for different values of the dynamic time-lapse video frame rate;

the visual-based time-lapse video frame rate factor includes a second set of scores for different values of the dynamic time-lapse video frame rate; and

the values of the dynamic time-lapse video frame rate are determined based on combination of the first set of scores from the position-based time-lapse video frame rate factor and the second set of scores from the visual-based time-lapse video frame rate factor.

Assignments (3)

Continuity (5)

References Cited (20)