IP Library Granted Patent US 11,671,707
Granted Patent B2
US 11,671,707 · App. 17/372,027 · Granted Jun 6, 2023

Systems and methods for dynamic stabilization adjustment

Inventors: Nicolas Rahmouni (Paris, FR); Maxim Karpushin (Paris, FR); Thomas Derbanne (Paris, FR)
Assignee: GoPro, Inc.
H04N23/683H04N5/2628H04N23/6812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,671,707
App. No.
17/372,027
Granted
Jun 6, 2023
Kind
B2
Abstract

An image capture device may capture visual content during a capture duration. The context of capture of the visual content by the image capture device may be assessed and used to determine values of stabilization parameters for the visual content.

Claims (34)

1. A system for dynamic stabilization adjustment, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain visual information defining visual content of a video, the visual content captured by an image capture device during a capture duration, the visual content having a field of view;

assess context of the capture of the visual content by the image capture device;

determine one or more stabilization parameter values for the visual content based on the context of the capture of the visual content by the image capture device, the one or more stabilization parameter values controlling placement of a viewing window within the field of view of the visual content for stabilization of the visual content, the viewing window defining an extent of the visual content to be included within a punchout of the visual content for the stabilization of the visual content, wherein the one or more stabilization parameter values include a weight balance parameter value, the weight balance parameter value controlling an extent to which the placement of the viewing window minimizes a combination of rotational velocity and rotational acceleration of the image capture device; and

effectuate the stabilization of the visual content based on the one or more stabilization parameter values.

2. The system of claim 1 , wherein the context of the capture of the visual content by the image capture device includes a direction of gravity on the image capture device during the capture of the visual content by the image capture device.

3. The system of claim 1 , wherein the context of the capture of the visual content by the image capture device includes a motion type or a mounting type of the image capture device.

4. The system of claim 1 , wherein the one or more stabilization parameter values further include a horizon leveling parameter value, the horizon leveling parameter value controlling an extent to which the viewing window is rotated with respect to the field of view of the visual content to depict an upright scene within the stabilized visual content.

5. The system of claim 1 , wherein the one or more stabilization parameter values further include a margin-distortion parameter value, the margin-distortion parameter value controlling an amount of stabilization margin between the field of view of the visual content and the viewing window.

6. The system of claim 1 , wherein the one or more stabilization parameter values further include a margin-distortion parameter value, the margin-distortion parameter value controlling whether a linear field of view distortion or projection or a wide field of view distortion or projection is used to arrange the visual content based on the context of the capture of the visual content by the image capture device.

7. The system of claim 1 , wherein the one or more stabilization parameter values further include a motion blur parameter value, the motion blur parameter value controlling an extent to which motion blur within the visual content is taken into account for the stabilization of the visual content.

8. The system of claim 1 , wherein the one or more stabilization parameter values further include a stickiness parameter value, the stickiness parameter value controlling an extent to which the placement of the viewing window is allowed to deviate from a center of the field of view of the visual content based on the context of the capture of the visual content by the image capture device.

9. A method for dynamic stabilization adjustment, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, visual information defining visual content of a video, the visual content captured by an image capture device during a capture duration, the visual content having a field of view;

assessing, by the computing system, context of the capture of the visual content by the image capture device;

determining, by the computing system, one or more stabilization parameter values for the visual content based on the context of the capture of the visual content by the image capture device, the one or more stabilization parameter values controlling placement of a viewing window within the field of view of the visual content for stabilization of the visual content, the viewing window defining an extent of the visual content to be included within a punchout of the visual content for the stabilization of the visual content, wherein the one or more stabilization parameter values include a weight balance parameter value, the weight balance parameter value controlling an extent to which the placement of the viewing window minimizes a combination of rotational velocity and rotational acceleration of the image capture device; and

effectuating, by the computing system, the stabilization of the visual content based on the one or more stabilization parameter values.

10. The method of claim 9 , wherein the context of the capture of the visual content by the image capture device includes a direction of gravity on the image capture device during the capture of the visual content by the image capture device.

11. The method of claim 9 , wherein the context of the capture of the visual content by the image capture device includes a motion type or a mounting type of the image capture device.

12. The method of claim 9 , wherein the one or more stabilization parameter values further include a horizon leveling parameter value, the horizon leveling parameter value controlling an extent to which the viewing window is rotated with respect to the field of view of the visual content to depict an upright scene within the stabilized visual content.

13. The method of claim 9 , wherein the one or more stabilization parameter values further include a margin-distortion parameter value, the margin-distortion parameter value controlling an amount of stabilization margin between the field of view of the visual content and the viewing window.

14. The method of claim 9 , wherein the one or more stabilization parameter values further include a margin-distortion parameter value, the margin-distortion parameter value controlling whether a linear field of view distortion or projection or a wide field of view distortion or projection is used to arrange the visual content based on the context of the capture of the visual content by the image capture device.

15. The method of claim 9 , wherein the one or more stabilization parameter values further include a motion blur parameter value, the motion blur parameter value controlling an extent to which motion blur within the visual content is taken into account for the stabilization of the visual content.

16. The method of claim 9 , wherein the one or more stabilization parameter values further include a stickiness parameter value, the stickiness parameter value controlling an extent to which the placement of the viewing window is allowed to deviate from a center of the field of view of the visual content based on the context of the capture of the visual content by the image capture device.

17. The system of claim 1 , wherein the weight balance parameter value controlling the extent to which the placement of the viewing window minimizes the combination of the rotational velocity and the rotational acceleration of the image capture device includes the weight balance parameter value controlling whether a fixed-viewpoint stabilization, a flowing motion stabilization, or a mix between the fixed-viewpoint stabilization and the flowing motion stabilization is used for the visual content.

18. The method of claim 9 , wherein the weight balance parameter value controlling the extent to which the placement of the viewing window minimizes the combination of the rotational velocity and the rotational acceleration of the image capture device includes the weight balance parameter value controlling whether a fixed-viewpoint stabilization, a flowing motion stabilization, or a mix between the fixed-viewpoint stabilization and the flowing motion stabilization is used for the visual content.

19. A system for dynamic stabilization adjustment, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain visual information defining visual content of a video, the visual content captured by an image capture device during a capture duration, the visual content having a field of view;

assess context of the capture of the visual content by the image capture device, the context of the capture of the visual content by the image capture device includes a motion type or a mounting type of the image capture device;

determine one or more stabilization parameter values for the visual content based on the context of the capture of the visual content by the image capture device, the one or more stabilization parameter values controlling placement of a viewing window within the field of view of the visual content for stabilization of the visual content, the viewing window defining an extent of the visual content to be included within a punchout of the visual content for the stabilization of the visual content, wherein the one or more stabilization parameter values include a weight balance parameter value, the weight balance parameter value controlling an extent to which the placement of the viewing window minimizes a combination of rotational velocity and rotational acceleration of the image capture device; and

effectuate the stabilization of the visual content based on the one or more stabilization parameter values.

20. The system of claim 19 , wherein the weight balance parameter value controlling the extent to which the placement of the viewing window minimizes the combination of the rotational velocity and the rotational acceleration of the image capture device includes the weight balance parameter value controlling whether a fixed-viewpoint stabilization, a flowing motion stabilization, or a mix between the fixed-viewpoint stabilization and the flowing motion stabilization is used for the visual content.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2021
From: RAHMOUNI, NICOLAS; KARPUSHIN, MAXIM; DERBANNE, THOMAS
To: GOPRO, INC.
Reel/Frame 056814/0173 →
Continuity (2)
Continuation 16719005 · Dec 18, 2019
Related Publication 20210337124A1 · Oct 28, 2021
Cited By (1)
US 12,284,439