IP Library Granted Patent US 11,200,918
Granted Patent B1
US 11,200,918 · App. 16/947,348 · Granted Dec 14, 2021

Video framing based on device orientation

Inventors: Scott Corbin (San Mateo, CA); Joshua Hamill (Poway, CA); Daryl Stimm (Encinitas, CA); Kyler William Schwartz (Valley Center, CA)
Assignee: GoPro, Inc.
G11B27/034G06F3/04847G06F3/04883G11B27/036G11B27/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,200,918
App. No.
16/947,348
Granted
Dec 14, 2021
Kind
B1
Abstract

A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.

Claims (27)

1. A system for utilizing device orientation for video framing, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining a video, the video including video content having a progress length, the video content including visual content viewable as a function of progress through the progress length, the visual content having a field of view;

obtain framing information for the video, the framing information characterizing framings of the visual content at moments within the progress length, the framings of the visual content including a first framing at a first moment, an individual framing of the visual content defining a positioning of a viewing window within the field of view of the visual content at a corresponding moment within the progress length, the viewing window defining extents of the visual content to be included within a presentation of the video content, wherein the framing information is determined based on a user's interaction with a mobile device, the mobile device including a display, the mobile device providing a presentation of the extents of visual content defined by the viewing window on the display to facilitate the user's interaction with the mobile device to determine the framing information, wherein the mobile device further provides visual indications of the framings of the visual content at the moments within the progress length within the presentation of the extents of the visual content defined by the viewing window, the visual indications of the framings of the visual content at the moments presented during presentation of other moments within the progress length on the display such that presentation on the display of a second moment different from the first moment within the progress length includes a first visual indication of the first framing of the visual content at the first moment within the progress length; and

provide the framing information for the video to a video editing application that utilizes the framing information to provide preliminary framings of the visual content at the moments within the progress length.

2. The system of claim 1 , wherein the individual framing of the visual content defines the positioning of the viewing window within the field of view of the visual content based on a viewing direction and a viewing size of the viewing window.

3. The system of claim 2 , wherein the individual framing of the visual content further defines the positioning of the viewing window within the field of view of the visual content based on a viewing rotation and/or a viewing projection of the viewing window.

4. The system of claim 2 , wherein the framing information characterizes the viewing direction based on the framing information including orientation information of the mobile device.

5. The system of claim 2 , wherein the user's interaction with the mobile device determines the framing information based on the user controlling orientation of the mobile device to set the viewing direction.

6. The system of claim 5 , wherein the user's interaction with the mobile device determines the framing information further based on the user controlling zooming operation of the mobile device to set the viewing size.

7. The system of claim 6 , wherein the display of the mobile device includes a touchscreen display, and the zooming operation of the mobile device is controlled by the user based on the user making a stretching gesture or a pinching gesture on the touchscreen display.

8. The system of claim 1 , wherein the framing information characterizes the framings of the visual content at non-adjacent moments within the progress length, and the framings of the visual content for a duration of the progress length between the non-adjacent moments are determined based on the framings of the visual content at the non-adjacent moments.

9. The system of claim 1 , wherein the visual indications of the framings of the visual content include outlines of the positioning of the viewing window overlaid on top of the visual content presented on the display.

10. The system of claim 1 , wherein the visual indications of the framings of the visual content include arrows at a periphery of the display to indicate directions of the framings of the visual content that are outside a current framing of the visual content.

11. The system of claim 1 , wherein the visual indications of the framings of the visual content change based on distances between a current moment presented on the display and the moments corresponding to the framings of the visual content.

12. The system of claim 1 , wherein the visual indications of the framings of the visual content changing based on the distances between the current moment presented on the display and the moments corresponding to the framings of the visual content include size, shape, and/or color of the visual indications changing based on the distances between the current moment presented on the display and the moments corresponding to the framings of the visual content.

13. A method for utilizing device orientation for video framing, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, video information defining a video, the video including video content having a progress length, the video content including visual content viewable as a function of progress through the progress length, the visual content having a field of view;

obtaining, by the computing system, framing information for the video, the framing information characterizing framings of the visual content at moments within the progress length, the framings of the visual content including a first framing at a first moment, an individual framing of the visual content defining a positioning of a viewing window within the field of view of the visual content at a corresponding moment within the progress length, the viewing window defining extents of the visual content to be included within a presentation of the video content, wherein the framing information is determined based on a user's interaction with a mobile device, the mobile device including a display, the mobile device providing a presentation of the extents of visual content defined by the viewing window on the display to facilitate the user's interaction with the mobile device to determine the framing information, wherein the mobile device further provides visual indications of the framings of the visual content at the moments within the progress length within the presentation of the extents of the visual content defined by the viewing window, the visual indications of the framings of the visual content at the moments presented during presentation of other moments within the progress length on the display such that presentation on the display of a second moment different from the first moment within the progress length includes a first visual indication of the first framing of the visual content at the first moment within the progress length; and

providing, by the computing system, the framing information for the video to a video editing application that utilizes the framing information to provide preliminary framings of the visual content at the moments within the progress length.

14. The method of claim 13 , wherein the individual framing of the visual content defines the positioning of the viewing window within the field of view of the visual content based on a viewing direction and a viewing size of the viewing window.

15. The method of claim 14 , wherein the individual framing of the visual content further defines the positioning of the viewing window within the field of view of the visual content based on a viewing rotation and/or a viewing projection of the viewing window.

16. The method of claim 14 , wherein the framing information characterizes the viewing direction based on the framing information including orientation information of the mobile device.

17. The method of claim 14 , wherein the user's interaction with the mobile device determines the framing information based on the user controlling orientation of the mobile device to set the viewing direction.

18. The method of claim 17 , wherein the user's interaction with the mobile device determines the framing information further based on the user controlling zooming operation of the mobile device to set the viewing size.

19. The method of claim 18 , wherein the display of the mobile device includes a touchscreen display, and the zooming operation of the mobile device is controlled by the user based on the user making a stretching gesture or a pinching gesture on the touchscreen display.

20. The method of claim 13 , wherein the framing information characterizes the framings of the visual content at non-adjacent moments within the progress length, and the framings of the visual content for a duration of the progress length between the non-adjacent moments are determined based on the framings of the visual content at the non-adjacent moments.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: CORBIN, SCOTT; HAMILL, JOSHUA; STIMM, DARYL; SCHWARTZ, KYLER WILLIAM
To: GOPRO, INC.
Reel/Frame 053344/0182 →
Cited By (3)
US 12,425,533 US 12,452,400 US 12,518,796