IP Library Granted Patent US 11,336,832
Granted Patent B1
US 11,336,832 · App. 17/006,536 · Granted May 17, 2022

Systems and methods for horizon leveling videos

Inventors: Daryl Stimm (Encinitas, CA); Kyler William Schwartz (Valley Center, CA); Jonathan Leland Thorn (San Leandro, CA)
Assignee: GoPro, Inc.
H04N5/23299G06T3/40G06T5/006H04N5/22525H04N5/232935H04N5/232945
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,336,832
App. No.
17/006,536
Granted
May 17, 2022
Kind
B1
Abstract

A video may be captured by an image capture device in motion. A horizon-leveled view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The placement of the punchout of the video may be changed based on different rotational positions of to provide a view in which a horizon depicted within the video is leveled.

Claims (29)

1. A system for horizon leveling videos, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining a video, the video including video content captured by an image capture device during a capture duration, the video content having a progress length, the video content including visual content captured at different moments within the capture duration, the visual content viewable as a function of progress through the progress length, the visual content having a field of view;

obtain rotational position information for the video, the rotational position information characterizing rotational positions of the image capture device as a function of progress through the capture duration;

determine a viewing window for the visual content as a function of progress through the progress length based on the rotational positions of the image capture device as the function of progress through the capture duration, the viewing window defining extents of the visual content to be included within horizon-leveled visual content as the function of progress through the progress length, wherein determination of the viewing window includes determination of a placement of the viewing window within the field of view of the visual content as the function of progress through the progress length based on the rotational positions of the image capture device as the function of progress through the capture duration; and

generate the horizon-leveled visual content based on the viewing window, the horizon-leveled visual content including a punchout of the extents of the visual content defined by the viewing window, wherein inclusion of the extents of the visual content defined by the viewing window within the horizon-leveled visual content effectuates horizon leveling of the visual content.

2. The system of claim 1 , wherein the viewing window has a one-by-one aspect ratio, the one-by-one aspect ratio reducing impact of an off-axis horizon depicted within the horizon-leveled visual content.

3. The system of claim 1 , wherein the visual content includes a distortion such that a straight line within a scene depicted within the visual content appears as a curved line, the distortion of the visual content reducing impact of an off-axis horizon depicted within the horizon-leveled visual content.

4. The system of claim 3 , wherein the distortion includes a barrel distortion or a pincushion distortion.

5. The system of claim 3 , wherein the visual content includes the distortion based on capture of the visual content through a wide field of view optical element.

6. The system of claim 3 , wherein the visual content includes the distortion based on application of the distortion to non-distorted visual content, the distortion applied to the non-distorted visual content based on the visual content including the non-distorted visual content.

7. The system of claim 1 , wherein the determination of the viewing window further includes determination of a size of the viewing window as the function of progress through the progress length based on the rotational positions of the image capture device as the function of progress through the capture duration.

8. The system of claim 7 , wherein the size of the viewing window changes as the function of progress through the progress length to simulate changes in zoom for the visual content.

9. The system of claim 1 , wherein the determination of the placement of the viewing window within the field of view of the visual content includes determination of a rotation of the viewing window within the field of view of the visual content.

10. The system of claim 1 , wherein the determination of the placement of the viewing window within the field of view of the visual content includes determination of a location of the viewing window within the field of view of the visual content, the location of the viewing window within the field of view of the visual content determining framing of the visual content.

11. A method for horizon leveling videos, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, video information defining a video, the video including video content captured by an image capture device during a capture duration, the video content having a progress length, the video content including visual content captured at different moments within the capture duration, the visual content viewable as a function of progress through the progress length, the visual content having a field of view;

obtaining, by the computing system, rotational position information for the video, the rotational position information characterizing rotational positions of the image capture device as a function of progress through the capture duration;

determining, by the computing system, a viewing window for the visual content as a function of progress through the progress length based on the rotational positions of the image capture device as the function of progress through the capture duration, the viewing window defining extents of the visual content to be included within horizon-leveled visual content as the function of progress through the progress length, wherein determining the viewing window includes determining a placement of the viewing window within the field of view of the visual content as the function of progress through the progress length based on the rotational positions of the image capture device as the function of progress through the capture duration; and

generating, by the computing system, the horizon-leveled visual content based on the viewing window, the horizon-leveled visual content including a punchout of the extents of the visual content defined by the viewing window, wherein inclusion of the extents of the visual content defined by the viewing window within the horizon-leveled visual content effectuates horizon leveling of the visual content.

12. The method of claim 11 , wherein the viewing window has a one-by-one aspect ratio, the one-by-one aspect ratio reducing impact of an off-axis horizon depicted within the horizon-leveled visual content.

13. The method of claim 11 , wherein the visual content includes a distortion such that a straight line within a scene depicted within the visual content appears as a curved line, the distortion of the visual content reducing impact of an off-axis horizon depicted within the horizon-leveled visual content.

14. The method of claim 13 , wherein the distortion includes a barrel distortion or a pincushion distortion.

15. The method of claim 13 , wherein the visual content includes the distortion based on capture of the visual content through a wide field of view optical element.

16. The method of claim 13 , wherein the visual content includes the distortion based on application of the distortion to non-distorted visual content, the distortion applied to the non-distorted visual content based on the visual content including the non-distorted visual content.

17. The method of claim 11 , wherein determining the viewing window further includes determining a size of the viewing window as the function of progress through the progress length based on the rotational positions of the image capture device as the function of progress through the capture duration.

18. The method of claim 17 , wherein the size of the viewing window changes as the function of progress through the progress length to simulate changes in zoom for the visual content.

19. The method of claim 11 , wherein determining the placement of the viewing window within the field of view of the visual content includes determining a rotation of the viewing window within the field of view of the visual content.

20. The method of claim 11 , wherein the determining the placement of the viewing window within the field of view of the visual content includes determining a location of the viewing window within the field of view of the visual content, the location of the viewing window within the field of view of the visual content determining framing of the visual content.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2020
From: STIMM, DARYL; SCHWARTZ, KYLER WILLIAM; THORN, JONATHAN LELAND
To: GOPRO, INC.
Reel/Frame 053634/0372 →
Continuity (1)
Provisional Application 62894649 · Aug 30, 2019
Cited By (4)
US 12,284,439 US 12,302,028 US 12,531,960 US 12,538,029