IP Library Granted Patent US 10,778,895
Granted Patent B1
US 10,778,895 · App. 16/225,378 · Granted Sep 15, 2020

Systems and methods for stabilizing videos

Inventor: Vincent Garcia (Issy-les-Moulineaux, FR)
Assignee: GoPro, Inc.
H04N5/23267H04N5/2327H04N5/23218H04N5/23254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,778,895
App. No.
16/225,378
Granted
Sep 15, 2020
Kind
B1
Abstract

A video, such as a spherical video, may include motion due to motion of one or more image capture devices during capture of the video. Motion of the image capture devices during the capture of the video may cause the playback of the video to appear jerky/shaky. The video may be stabilized by using both a horizontal feature and a fixed feature captured within the video.

Claims (29)

1. A system that stabilizes videos, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining a spherical video, the spherical video including spherical video content having a progress length, the spherical video content including visual content viewable from a point of view as a function of progress through the progress length, the visual content captured by an image capture device, the image capture device rotated during capture of the visual content such that the visual content of the spherical video includes depiction of jerky or shaky motion;

identify a horizontal feature within the visual content;

identify a fixed feature within the visual content, the fixed feature different from the horizontal feature, the fixed feature depicting an object that is fixed in space for stabilization of the visual content; and

stabilize the spherical video based on the horizontal feature and the fixed feature within the visual content to compensate for the rotation of the image capture device during capture of the visual content, stabilization of the visual content removing the depiction of the jerky or shaky motion from the visual content of the spherical video, the stabilization of the spherical video performed by rotating the visual content, rotation of the visual content based on the horizontal feature including orienting video frames of the spherical video according to position of the horizontal feature to provide tilt stabilization and rotation of the visual content based on the fixed feature including orienting the video frames of the spherical video according to position of the fixed feature to provide lateral stabilization, the tilt stabilization including sloping of the horizontal feature removed from the visual content and the lateral stabilization including side-to-side stabilization of the visual content.

2. The system of claim 1 , wherein the fixed feature includes a depiction of a distant object within the visual content.

3. The system of claim 2 , wherein the distant object includes a light source.

4. The system of claim 3 , wherein the distant object is identified based on identification of a round shape and saturation of pixels within the round shape.

5. The system of claim 4 , wherein the distant object includes the Sun.

6. The system of claim 5 , wherein position of the fixed feature within the visual content is changed for stabilization of the spherical video as the function of progress through the progress length to account for movement of the Sun during the progress length.

7. The system of claim 1 , wherein the horizontal feature includes a depiction of a horizon within the visual content.

8. The system of claim 7 , wherein the horizon is identified based on variance of pixel characteristic within the visual content.

9. The system of claim 8 , wherein the horizon is identified such that a first variance of pixel characteristics below the horizon and a second variance of pixel characteristics above the horizon are minimized.

10. The system of claim 1 , wherein the video frames are oriented according to the position of the horizontal feature and the position of the fixed feature to minimize displacement of the horizontal feature and the fixed feature between the video frames.

11. A method for stabilizing videos, the method performing by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, video information defining a spherical video, the spherical video including spherical video content having a progress length, the spherical video content including visual content viewable from a point of view as a function of progress through the progress length, the visual content captured by an image capture device, the image capture device rotated during capture of the visual content such that the visual content of the spherical video includes depiction of jerky or shaky motion;

identifying, by the computing system, a horizontal feature within the visual content;

identifying, by the computing system, a fixed feature within the visual content, the fixed feature different from the horizontal feature, the fixed feature depicting an object that is fixed in space for stabilization of the visual content; and

stabilize, by the computing system, the spherical video based on the horizontal feature and the fixed feature within the visual content to compensate for the rotation of the image capture device during capture of the visual content, stabilization of the visual content removing the depiction of the jerky or shaky motion from the visual content of the spherical video, the stabilization of the spherical video performed by rotating the visual content, rotation of the visual content based on the horizontal feature including orienting video frames of the spherical video according to position of the horizontal feature to provide tilt stabilization and rotation of the visual content based on the fixed feature including orienting the video frames of the spherical video according to position of the fixed feature to provide lateral stabilization, the tilt stabilization including sloping of the horizontal feature removed from the visual content and the lateral stabilization including side-to-side stabilization of the visual content.

12. The method of claim 11 , wherein the fixed feature includes a depiction of a distant object within the visual content.

13. The method of claim 12 , wherein the distant object includes a light source.

14. The method of claim 13 , wherein the distant object is identified based on identification of a round shape and saturation of pixels within the round shape.

15. The method of claim 14 , wherein the distant object includes the Sun.

16. The method of claim 15 , wherein position of the fixed feature within the visual content is changed for stabilization of the spherical video as the function of progress through the progress length to account for movement of the Sun during the progress length.

17. The method of claim 11 , wherein the horizontal feature includes a depiction of a horizon within the visual content.

18. The method of claim 17 , wherein the horizon is identified based on variance of pixel characteristic within the visual content.

19. The method of claim 18 , wherein the horizon is identified such that a first variance of pixel characteristics below the horizon and a second variance of pixel characteristics above the horizon are minimized.

20. The method of claim 11 , wherein the video frames are oriented according to the position of the horizontal feature and the position of the fixed feature to minimize displacement of the horizontal feature and the fixed feature between the video frames.

Assignments (3)
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2019
From: GARCIA, VINCENT
To: GOPRO, INC.
Reel/Frame 047961/0837 →
Cited By (1)
US 12,470,828