IP Library › Granted Patent US 11,647,289
Granted Patent B2
US 11,647,289 · App. 17/575,222 · Granted May 9, 2023

Systems and methods for stabilizing videos

Inventors: Cesar Douady (Les Molieres, FR); Thomas Derbanne (Paris, FR); Maxim Karpushin (Paris, FR)
Assignee: GoPro, Inc.
H04N5/2328H04N5/144H04N5/2252H04N5/2253H04N5/2254H04N5/23258H04N5/23267H04N5/232933
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,647,289
App. No.
17/575,222
Granted
May 9, 2023
Kind
B2
Abstract

Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Claims (33)

1. A system for stabilizing videos, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain visual information, the visual information defining visual content captured by an image capture device during a capture duration, the visual content having a field of view;

obtain angular acceleration information, the angular acceleration information characterizing angular accelerations of the image capture device at different moments within the capture duration;

determine intentionality of motion of the image capture device as a function of progress through the capture duration based on the angular acceleration information, wherein:

the intentionality of the motion of the image capture device is determined as being fully intentional based on the angular acceleration of the image capture device being smaller than a fully intentional angular acceleration threshold value; and

the intentionality of the motion of the image capture device is determined as being fully unintentional based on the angular acceleration of the image capture device being greater than a fully unintentional angular acceleration threshold value, the fully intentional angular acceleration threshold value being smaller than the fully unintentional angular acceleration threshold value; and

stabilize the visual content based on the intentionality of the motion of the image capture device.

2. The system of claim 1 , wherein portions of the capture duration of the visual content are stabilized differently based on the intentionally of the motion of the image capture device for the portions being different.

3. The system of claim 2 , wherein the one or more physical processors and a display are carried by the image capture device, and the visual content stabilized based on the intentionality of the motion of the image capture device is presented on the display as a preview of a video during the capture duration.

4. The system of claim 3 , wherein the image capture device performs a different stabilization of the visual content to generate more stabilized visual content, the more stabilized visual content being more stabilized than the visual content stabilized based on the intentionality of the motion of the image capture device.

5. The system of claim 1 , wherein determination of the intentionality of the motion of the image capture device as being intermediately intentional includes determination of a value of intentionality between a fully intentional value and a fully unintentional value.

6. The system of claim 1 , wherein the intentionality of the motion of the image capture device is determined as values of a stabilizer state variable.

7. The system of claim 1 , wherein the stabilization of the visual content based on the intentionality of the motion of the image capture device includes determination of a viewing window for the visual content as the function of progress through the capture duration based on the intentionality of the motion of the image capture device, the viewing window defining one or more extents of the visual content, further wherein the viewing window for the visual content is centered on a center of the field of view for a portion of the capture duration in which the intentionality of the motion of the image capture device is determined as being fully intentional and the viewing window for the visual content deviates from the center of the field of view for a portion of the capture duration in which the intentionality of the motion of the image capture device is determined as being fully unintentional.

8. The system of claim 7 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a centering parameter that moves the viewing window towards the center of the field of view, wherein an impact of the centering parameter on the placement of the viewing window is determined based on the intentionality of the motion of the image capture device.

9. The system of claim 7 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on an inertia parameter that maintains a portion of speed of movement of the viewing window, wherein an impact of the inertia parameter on the placement of the viewing window is determined based on the intentionality of the motion of the image capture device.

10. The system of claim 7 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a deviation parameter that limits deviation of the viewing window from the center of the field of view.

11. A method for stabilizing videos, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, visual information, the visual information defining visual content captured by an image capture device during a capture duration, the visual content having a field of view;

obtaining, by the computing system, angular acceleration information, the angular acceleration information characterizing angular accelerations of the image capture device at different moments within the capture duration;

determining, by the computing system, intentionality of motion of the image capture device as a function of progress through the capture duration based on the angular acceleration information, wherein:

the intentionality of the motion of the image capture device is determined as being fully intentional based on the angular acceleration of the image capture device being smaller than a fully intentional angular acceleration threshold value; and

the intentionality of the motion of the image capture device is determined as being fully unintentional based on the angular acceleration of the image capture device being greater than a fully unintentional angular acceleration threshold value, the fully intentional angular acceleration threshold value being smaller than the fully unintentional angular acceleration threshold value; and

stabilizing, by the computing system, the visual content based on the intentionality of the motion of the image capture device.

12. The method of claim 11 , wherein portions of the capture duration of the visual content are stabilized differently based on the intentionally of the motion of the image capture device for the portions being different.

13. The method of claim 12 , wherein the one or more physical processors and a display are carried by the image capture device, and the visual content stabilized based on the intentionality of the motion of the image capture device is presented on the display as a preview of a video during the capture duration.

14. The method of claim 13 , wherein the image capture device performs a different stabilization of the visual content to generate more stabilized visual content, the more stabilized visual content being more stabilized than the visual content stabilized based on the intentionality of the motion of the image capture device.

15. The method of claim 11 , wherein determining the intentionality of the motion of the image capture device as being intermediately intentional includes determining a value of intentionality between a fully intentional value and a fully unintentional value.

16. The method of claim 11 , wherein the intentionality of the motion of the image capture device is determined as values of a stabilizer state variable.

17. The method of claim 11 , wherein stabilizing the visual content based on the intentionality of the motion of the image capture device includes determining a viewing window for the visual content as the function of progress through the capture duration based on the intentionality of the motion of the image capture device, the viewing window defining one or more extents of the visual content, further wherein the viewing window for the visual content is centered on a center of the field of view for a portion of the capture duration in which the intentionality of the motion of the image capture device is determined as being fully intentional and the viewing window for the visual content deviates from the center of the field of view for a portion of the capture duration in which the intentionality of the motion of the image capture device is determined as being fully unintentional.

18. The method of claim 17 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a centering parameter that moves the viewing window towards the center of the field of view, wherein an impact of the centering parameter on the placement of the viewing window is determined based on the intentionality of the motion of the image capture device.

19. The method of claim 17 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on an inertia parameter that maintains a portion of speed of movement of the viewing window, wherein an impact of the inertia parameter on the placement of the viewing window is determined based on the intentionality of the motion of the image capture device.

20. The method of claim 17 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a deviation parameter that limits deviation of the viewing window from the center of the field of view.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2022
From: DERBANNE, THOMAS; DOUADY, CESAR; KARPUSHIN, MAXIM
To: GOPRO, INC.
Reel/Frame 058649/0582 →
Continuity (4)
Continuation 16992479 · Aug 13, 2020
Continuation 16391705 · Apr 23, 2019
Provisional Application 62733237 · Sep 19, 2018
Related Publication 20220141367A1 · May 5, 2022
Cited By (2)
US 12,256,147 US 12,289,523