IP Library Granted Patent US 10,750,092
Granted Patent B2
US 10,750,092 · App. 16/391,705 · Granted Aug 18, 2020

Systems and methods for stabilizing videos

Inventors: Cesar Douady (Les Molieres, FR); Thomas Derbanne (Paris, FR); Maxim Karpushin (Paris, FR)
Assignee: GoPro, Inc.
H04N5/2328H04N5/144H04N5/2252H04N5/2253H04N5/2254H04N5/23258H04N5/23267H04N5/232933
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,750,092
App. No.
16/391,705
Granted
Aug 18, 2020
Kind
B2
Abstract

Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Claims (29)

1. An image capture device that stabilizes videos, the image capture device comprising:

a housing;

an optical element carried by the housing and configured to guide light within a field of view to an image sensor;

the image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon during a capture duration, the visual information defining visual content having the field of view;

an angular acceleration sensor carried by the housing and configured to generate an angular acceleration output signal based on angular accelerations of the housing during the capture duration, the angular acceleration output signal conveying angular acceleration information that characterizes the angular accelerations of the housing at different moments within the capture duration; and

one or more physical processors configured by machine-readable instructions to:

determine intentionality of motion of the housing as a function of progress through the capture duration based on the angular acceleration information, wherein the intentionality of the motion of the housing is determined as being one or more of fully intentional, fully unintentional, and/or intermediately intentional, wherein the intentionality of the motion of the housing is determined as being fully intentional based on the angular acceleration of the housing being smaller than a fully intentional angular acceleration threshold value and as being fully unintentional based on the angular acceleration of the housing being greater than a fully unintentional angular acceleration threshold value, the fully intentional angular acceleration threshold value being smaller than the fully unintentional angular acceleration threshold value;

determine a viewing window for the visual content as the function of progress through the capture duration based on the intentionality of the motion of the housing, the viewing window defining one or more extents of the visual content; and

generate stabilized visual content of a video based on the viewing window, the stabilized visual content including a punchout of the one or more extents of the visual content within the viewing window.

2. The image capture device of claim 1 , further comprising a display carried by the housing, wherein the stabilized visual content is presented on the display as a preview of the video.

3. The image capture device of claim 2 , wherein the stabilized visual content is different from visual content of the video.

4. The image capture device of claim 1 , wherein determination of the intentionality of the motion of the housing as being intermediately intentional includes determination of a value of intentionality between a fully intentional value and a fully unintentional value.

5. The image capture device of claim 1 , wherein the viewing window for the visual content is determined as the function of progress through the capture duration based on the intentionality of the motion of the housing such that the viewing window for the visual content is centered on a center of the field of view for a portion of the capture duration in which the intentionality of the motion of the housing is determined as being fully intentional and the viewing window for the visual content deviates from the center of the field of view for a portion of the capture duration in which the intentionality of the motion of the housing is determined as being fully unintentional.

6. The image capture device of claim 5 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a centering parameter that moves the viewing window towards the center of the field of view, wherein an impact of the centering parameter on the placement of the viewing window is determined based on the intentionality of the motion of the housing.

7. The image capture device of claim 5 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on an inertia parameter that maintains a portion of speed of movement of the viewing window, wherein an impact of the inertia parameter on the placement of the viewing window is determined based on the intentionality of the motion of the housing.

8. The image capture device of claim 5 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a deviation parameter limit deviation of the viewing window from the center of the field of view.

9. A method for stabilizing videos, the method performed by an image capture device including one or more processors, an optical element, an image sensor, and an angular acceleration sensor, the optical element configured to guide light within a field of view to the image sensor, the method comprising:

generating, by the image sensor, a visual output signal conveying visual information based on light that becomes incident thereon during a capture duration, the visual information defining visual content having the field of view;

generating, by the angular acceleration sensor, an angular acceleration output signal based on angular accelerations of the image capture device during the capture duration, the angular acceleration output signal conveying angular acceleration information that characterizes the angular accelerations of the image capture device at different moments within the capture duration;

determining, by the one or more processors, intentionality of motion of the image capture device as a function of progress through the capture duration based on the angular acceleration information, wherein the intentionality of the motion of the image capture device is determined as being one or more of fully intentional, fully unintentional, and/or intermediately intentional, wherein the intentionality of the motion of the image capture device is determined as being fully intentional based on the angular acceleration of the image capture device being smaller than a fully intentional angular acceleration threshold value and as being fully unintentional based on the angular acceleration of the image capture device being greater than a fully unintentional angular acceleration threshold value, the fully intentional angular acceleration threshold value being smaller than the fully unintentional angular acceleration threshold value;

determining, by the one or more processors, a viewing window for the visual content as the function of progress through the capture duration based on the intentionality of the motion of the image capture device, the viewing window defining one or more extents of the visual content; and

generating, by the one or more processors, stabilized visual content of a video based on the viewing window, the stabilized visual content including a punchout of the one or more extents of the visual content within the viewing window.

10. The method of claim 9 , wherein the image capture device further comprises a display, and the stabilized visual content is presented on the display as a preview of the video.

11. The method of claim 10 , wherein the stabilized visual content is different from visual content of the video.

12. The method of claim 9 , wherein determination of the intentionality of the motion of the image capture device as being intermediately intentional includes determination of a value of intentionality between a fully intentional value and a fully unintentional value.

13. The method of claim 9 , wherein the viewing window for the visual content is determined as the function of progress through the capture duration based on the intentionality of the motion of the image capture device such that the viewing window for the visual content is centered on a center of the field of view for a portion of the capture duration in which the intentionality of the motion of the image capture device is determined as being fully intentional and the viewing window for the visual content deviates from the center of the field of view for a portion of the capture duration in which the intentionality of the motion of the image capture device is determined as being fully unintentional.

14. The method of claim 13 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a centering parameter that moves the viewing window towards the center of the field of view, wherein an impact of the centering parameter on the placement of the viewing window is determined based on the intentionality of the motion of the image capture device.

15. The method of claim 13 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on an inertia parameter that maintains a portion of speed of movement of the viewing window, wherein an impact of the inertia parameter on the placement of the viewing window is determined based on the intentionality of the motion of the image capture device.

16. The method of claim 13 , wherein placement of the viewing window for the visual content with respect to the field of view of the visual content is determined based on a deviation parameter that limit deviation of the viewing window from the center of the field of view.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2019
From: DOUADY, CESAR; DERBANNE, THOMAS; KARPUSHIN, MAXIM
To: GOPRO, INC.
Reel/Frame 048970/0971 →
Continuity (2)
Provisional Application 62733237 · Sep 19, 2018
Related Publication 20200092480A1 · Mar 19, 2020
Cited By (4)
US 12,256,147 US 12,284,439 US 12,289,522 US 12,289,523