IP Library › Granted Patent US 11,750,790
Granted Patent B2
US 11,750,790 · App. 17/361,070 · Granted Sep 5, 2023

Systems and methods for stabilizing views of videos

Inventors: Daryl Stimm (Encinitas, CA); William Edward MacDonald (San Mateo, CA); Kyler William Schwartz (Valley Center, CA)
Assignee: GoPro, Inc.
H04N13/167H04N13/117
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,750,790
App. No.
17/361,070
Granted
Sep 5, 2023
Kind
B2
Abstract

A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

Claims (35)

1. A method of stabilized viewing of spherical video content, comprising:

obtaining a spherical video having a progress length;

obtaining a trajectory of viewing direction for the spherical video, the trajectory of viewing direction including viewing directions for moments within the progress length of the spherical video;

generating a stabilized trajectory of viewing direction for the spherical video based on multiple margin constraints, separate margin constraints limiting deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction with respect to separate axes of rotation for the viewing directions; and

generating a stabilized video based on the stabilized viewing trajectory of viewing direction for the spherical video.

2. The method of claim 1 , wherein the trajectory of viewing direction is identified by a user as a function of progress through the progress length of the spherical video.

3. The method of claim 2 , wherein the trajectory of viewing direction is identified by the user via user interaction with a touchscreen display.

4. The method of claim 2 , wherein the trajectory of viewing direction is identified by the user via user rotation of a mobile device.

5. The method of claim 1 , wherein the stabilized trajectory of viewing direction is generated to account for jerkiness or shakiness in the trajectory of viewing direction.

6. The method of claim 1 , wherein the separate axes of rotation for the viewing directions include a yaw axis, a pitch axis, and a roll axis.

7. The method of claim 6 , wherein the multiple margin constraints include a yaw axis constraint, a pitch axis constraint, and a roll axis constraint.

8. The method of claim 7 , wherein:

the yaw axis constraint limits deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction for rotation about the yaw axis;

the pitch axis constraint limits deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction for rotation about the pitch axis; and

the roll axis constraint limits deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction for rotation about the roll axis.

9. The method of claim 7 , wherein the stabilized trajectory of viewing direction for the spherical video is generated further based on a viewing size constraint.

10. The method of claim 9 , wherein the viewing size constraint limits deviation of a viewing size associated with the stabilized trajectory of viewing direction from a viewing size associated with the trajectory of viewing direction.

11. A system for stabilizing viewing of spherical video content, comprising:

one or more physical processors configured by machine-readable instructions to:

obtain a spherical video having a progress length;

obtain a trajectory of viewing direction for the spherical video, the trajectory of viewing direction including viewing directions for moments within the progress length of the spherical video;

generate a stabilized trajectory of viewing direction for the spherical video based on multiple margin constraints, separate margin constraints limiting deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction with respect to separate axes of rotation for the viewing directions; and

generate a stabilized video based on the stabilized viewing trajectory of viewing direction for the spherical video.

12. The system of claim 11 , wherein the trajectory of viewing direction is identified by a user as a function of progress through the progress length of the spherical video.

13. The system of claim 12 , wherein the trajectory of viewing direction is identified by the user via user interaction with a touchscreen display.

14. The system of claim 12 , wherein the trajectory of viewing direction is identified by the user via user rotation of a mobile device.

15. The system of claim 11 , wherein the stabilized trajectory of viewing direction is generated to account for jerkiness or shakiness in the trajectory of viewing direction.

16. The system of claim 11 , wherein the separate axes of rotation for the viewing directions include a yaw axis, a pitch axis, and a roll axis.

17. The system of claim 16 , wherein the multiple margin constraints include a yaw axis constraint, a pitch axis constraint, and a roll axis constraint.

18. The system of claim 17 , wherein:

the yaw axis constraint limits deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction for rotation about the yaw axis;

the pitch axis constraint limits deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction for rotation about the pitch axis; and

the roll axis constraint limits deviation of the stabilized trajectory of viewing direction from the trajectory of viewing direction for rotation about the roll axis.

19. The system of claim 17 , wherein the stabilized trajectory of viewing direction for the spherical video is generated further based on a viewing size constraint.

20. The system of claim 19 , wherein the viewing size constraint limits deviation of a viewing size associated with the stabilized trajectory of viewing direction from a viewing size associated with the trajectory of viewing direction.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2021
From: STIMM, DARYL; MACDONALD, WILLIAM EDWARD; SCHWARTZ, KYLER WILLIAM
To: GOPRO, INC.
Reel/Frame 056710/0668 →
Continuity (3)
Continuation 16878075 · May 19, 2020
Continuation 16047472 · Jul 27, 2018
Related Publication 20210329215A1 · Oct 21, 2021
Cited By (1)
US 12,519,917