IP Library › Granted Patent US 12,531,960
Granted Patent B1
US 12,531,960 · App. 18/431,558 · Granted Jan 20, 2026

Systems and methods for framing videos based on image capture device motion

Inventors: Emmanuel Simon (Paris, FR); Guillaume Oulès (Bordeaux, FR); Ralph McEntagart (Paris, FR)
Assignee: GoPro, Inc.
H04N5/2628G06T5/70G06T7/60G06T7/74G06T2207/10016G06T2207/30244H04N23/683
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,531,960
App. No.
18/431,558
Granted
Jan 20, 2026
Kind
B1
Abstract

A video may be framed using information on direction-locking of the video. The video may be rotated based on changes in the orientation of the image capture device during video capture to simulate a video captured with the image capture device pointed in the same direction (e.g., north direction). Panning may be used to frame the video in the direction of the motion of the image capture device. The direction and amount of panning may be determined by inverting the pan rotation that was performed on the video to direction-lock the video.

Claims (50)

1 . A system for framing videos, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining a video, the video having a progress length, the video including visual content viewable as a function of progress through the progress length, the visual content having a field of view, the video captured by an image capture device, wherein the visual content is rotated based on changes in orientation of the image capture device during the capture of the video to direction-lock the visual content and simulate a view as if captured by the image capture device without the changes in orientation;

obtain gravity-direction information for the video, the gravity-direction information characterizing a direction of gravity with respect to the image capture device during the capture of the video;

obtain orientation information for the video, the orientation information characterizing the orientations of the image capture device during the capture of the video, wherein the orientation information for the video is obtained based on inversion of the rotation of the visual content to direction-lock the visual content;

horizon level the visual content based on the direction of gravity with respect to the image capture device during the capture of the video;

determine panning of the image capture device during the capture of the video based on the orientations of the image capture device during the capture of the video, wherein changes in pitch positions and changes in roll positions are discarded from the orientations of the image capture device during the capture of the video for the determination of the panning of the image capture device and changes in pan positions from the orientations of the image capture device during the capture of the video are smoothed for the determination of the panning of the image capture device;

position a viewing window within the field of view of the visual content based on the panning of the image capture device during the capture of the video; and

present the visual content on an electronic display based on the viewing window.

2 . The system of claim 1 , wherein:

the viewing window is positioned within the field of view of the visual content to simulate roll of the image capture device during the capture of the video;

the positioning of the viewing window to simulate the roll of the image capture device is determined based on the panning of the image capture device during the capture of the video; and

an amount of the simulated roll of the image capture device is determined based on a speed of the panning of the image capture device.

3 . A system for framing videos, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining a video, the video having a progress length, the video including visual content viewable as a function of progress through the progress length, the visual content having a field of view, the video captured by an image capture device, wherein the visual content is rotated based on changes in orientation of the image capture device during the capture of the video to direction-lock the visual content and simulate a view as if captured by the image capture device without the changes in orientation;

obtain gravity-direction information for the video, the gravity-direction information characterizing a direction of gravity with respect to the image capture device during the capture of the video;

obtain orientation information for the video, the orientation information characterizing the orientations of the image capture device during the capture of the video;

horizon level the visual content based on the direction of gravity with respect to the image capture device during the capture of the video;

determine panning of the image capture device during the capture of the video based on the orientations of the image capture device during the capture of the video;

position a viewing window within the field of view of the visual content based on the panning of the image capture device during the capture of the video; and

present the visual content on an electronic display based on the viewing window.

4 . The system of claim 3 , wherein the video includes a spherical video, the spherical video including visual content having a spherical field of view.

5 . The system of claim 3 , wherein the orientation information for the video is obtained based on inversion of the rotation of the visual content to direction-lock the visual content.

6 . The system of claim 3 , wherein changes in pitch positions and changes in roll positions are discarded from the orientations of the image capture device during the capture of the video for the determination of the panning of the image capture device.

7 . The system of claim 6 , wherein changes in pan positions from the orientations of the image capture device during the capture of the video are smoothed for the determination of the panning of the image capture device.

8 . The system of claim 3 , wherein:

the viewing window is positioned within the field of view of the visual content to simulate roll of the image capture device during the capture of the video; and

the positioning of the viewing window to simulate the roll of the image capture device is determined based on the panning of the image capture device during the capture of the video.

9 . The system of claim 8 , wherein an amount of the simulated roll of the image capture device is determined based on a speed of the panning of the image capture device.

10 . The system of claim 3 , wherein the viewing window is positioned within the field of view of the visual content based on the panning of the image capture device for entirety of the progress length of the video.

11 . The system of claim 3 , wherein the viewing window is positioned within the field of view of the visual content based on the panning of the image capture device for a portion of the progress length of the video in which motion information for the video is unavailable, the motion information characterizing a direction of motion of the image capture device during the capture of the video in the earth reference frame.

12 . A method for framing videos, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, video information defining a video, the video having a progress length, the video including visual content viewable as a function of progress through the progress length, the visual content having a field of view, the video captured by an image capture device, wherein the visual content is rotated based on changes in orientation of the image capture device during the capture of the video to direction-lock the visual content and simulate a view as if captured by the image capture device without the changes in orientation;

obtaining, by the computing system, gravity-direction information for the video, the gravity-direction information characterizing a direction of gravity with respect to the image capture device during the capture of the video;

horizon leveling, by the computing system, the visual content based on the direction of gravity with respect to the image capture device during the capture of the video;

obtaining, by the computing system, orientation information for the video, the orientation information characterizing the orientations of the image capture device during the capture of the video;

determining, by the computing system, panning of the image capture device during the capture of the video based on the orientations of the image capture device during the capture of the video;

positioning, by the computing system, a viewing window within the field of view of the visual content based on the panning of the image capture device during the capture of the video; and

presenting, by the computing system, the visual content on an electronic display based on the viewing window.

13 . The method of claim 12 , wherein the video includes a spherical video, the spherical video including visual content having a spherical field of view.

14 . The method of claim 12 , wherein the orientation information for the video is obtained based on inversion of the rotation of the visual content to direction-lock the visual content.

15 . The method of claim 12 , wherein changes in pitch positions and changes in roll positions are discarded from the orientations of the image capture device during the capture of the video for determining the panning of the image capture device.

16 . The method of claim 15 , wherein changes in pan positions from the orientations of the image capture device during the capture of the video are smoothed for determining the panning of the image capture device.

17 . The method of claim 12 , wherein:

the viewing window is positioned within the field of view of the visual content to simulate roll of the image capture device during the capture of the video; and

the positioning of the viewing window to simulate the roll of the image capture device is determined based on the panning of the image capture device during the capture of the video.

18 . The method of claim 17 , wherein an amount of the simulated roll of the image capture device is determined based on a speed of the panning of the image capture device.

19 . The method of claim 12 , wherein the viewing window is positioned within the field of view of the visual content based on the panning of the image capture device for entirety of the progress length of the video.

20 . The method of claim 12 , wherein the viewing window is positioned within the field of view of the visual content based on the panning of the image capture device for a portion of the progress length of the video in which motion information for the video is unavailable, the motion information characterizing a direction of motion of the image capture device during the capture of the video in the earth reference frame.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2024
From: SIMON, EMMANUEL; OULÈS, GUILLAUME; MCENTAGART, RALPH
To: GOPRO, INC.
Reel/Frame 066385/0415 →
References Cited (8)
US 10230925B2 · Maciejewski · 2019 [cited by examiner]
US 11336832B1 · Stimm · 2022 [cited by examiner]
US 12302000B2 · Stimm · 2025 [cited by examiner]
US 20150341536A1 · Huang · 2015 [cited by examiner]
US 20200177824A1 · Yamaku · 2020 [cited by examiner]
US 20210095966A1 · Li · 2021 [cited by applicant]
US 20230408264A1 · Wang · 2023 [cited by applicant]
Stojkovic et al.: Object Location Prediction in Real-time using LSTM Neural Network and Polynomial Regression [online] [Retrieved Sep. 18, 2025] <URL: https://arxiv.org/pdf/2311.13950> (Year: 2023). [cited by applicant]