IP Library Granted Patent US 10,687,039
Granted Patent B1
US 10,687,039 · App. 15/981,667 · Granted Jun 16, 2020

Systems and methods for identifying viewing directions for video content

Inventors: Mark Vaden (San Diego, CA); Ingrid A. Cotoros (Hillsborough, CA); Scott Novell (Carlsbad, CA); Valérian Dottel (Allevard, FR); Guillaume Tilloux (Francin, FR); Loïc Bailliard (Grenoble, FR); Loïc Lanoir (La Trinité, FR)
Assignee: GoPro, Inc.
H04N13/117H04N13/366
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,687,039
App. No.
15/981,667
Granted
Jun 16, 2020
Kind
B1
Abstract

Video information and sensor information may be obtained. The video information may define spherical video content having a progress length. The spherical video content may define visual content viewable from a point a view as a function of progress through the progress length of the spherical video content. The spherical video content may be captured by one or more image capture devices. The sensor information may characterize capture of the spherical video content. A viewing direction for the spherical video content may be determined based on the sensor information and/or other information. The viewing direction may define a direction of view for the spherical video content from the point of view as the function of progress through the progress length of the spherical video content. The spherical video content may be presented on a display based on the viewing direction.

Claims (27)

1. A system that identifies viewing directions for video content, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining spherical video content, the spherical video content having a progress length, the spherical video content defining visual content viewable from a point of view as a function of progress through the progress length of the spherical video content, the spherical video content captured by one or more image sensors of an image capture device, the image capture device carried during capture of the spherical video content by a person riding a vehicle, forward motion of the vehicle causing forward motion of the image capture device, the image capture device rotated by the person during the capture of the spherical video content such that a front direction of the spherical video content is pointed away from the forward motion of the image capture device during the capture of the spherical video content, the image capture device rotated by the person independently of the forward motion of the vehicle;

obtain sensor information generated by a motion sensor or a location sensor separate from the one or more image sensors of the image capture device, the sensor information characterizing the forward motion of the image capture device during the capture of the spherical video content;

determine a viewing direction for the spherical video content based on the forward motion of the image capture device and the rotation of the image capture device that causes the front direction of the spherical video content to be pointed away from the forward motion of the image capture device, the viewing direction determined to be pointed in the forward motion of the image capture device during the capture of the spherical video content and to compensate for the rotation of the image capture device by the person during the capture of the spherical video content such that a punch-out view of the spherical video content follows and stays centered in the forward motion of the image capture device during the capture of the spherical video content, the viewing direction defining a direction of view for the spherical video content from the point of view as the function of progress through the progress length of the spherical video content; and

present the spherical video content on a display based on the viewing direction such that the presentation of the spherical video content includes the punch-out view of the spherical video content that follows and stays centered in the forward motion of the image capture device during the capture of the spherical video content.

2. The system of claim 1 , wherein the motion sensor or the location sensor is carried by the vehicle.

3. The system of claim 1 , wherein the motion sensor or the location sensor is carried by the image capture device.

4. The system of claim 1 , wherein the sensor information further characterizes a tilt of the vehicle, and the viewing direction is determined based on the tilt of the vehicle such that the viewing direction is directed towards back of the vehicle rather than the forward motion of the image capture device based on the tilt of the vehicle exceeding a threshold angle.

5. The system of claim 1 , wherein:

the image capture device is carried by the person based on the image capture device being carried on the person's head; and

the image capture device rotates independently of the forward motion of the vehicle based on rotation of the person's head.

6. The system of claim 5 , wherein the image capture device being carried on the person's head includes the image capture device being mounted on a helmet worn by the person.

7. The system of claim 6 , wherein the determination of the viewing direction to be pointed in the forward motion of the image capture device during the capture of the spherical video content and to compensate for the rotation of the image capture device by the person during the capture of the spherical video content includes the viewing direction being determined to compensate for the rotation of the person's head during the capture of the spherical video content.

8. The system of claim 1 , wherein the one or more physical processors are further configured by the machine-readable instructions to stabilize the spherical video content based on the viewing direction.

9. A method for identifying viewing directions for video content, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, video information defining spherical video content, the spherical video content having a progress length, the spherical video content defining visual content viewable from a point of view as a function of progress through the progress length of the spherical video content, the spherical video content captured by one or more image sensors of an image capture device, the image capture device carried during capture of the spherical video content by a person riding a vehicle, forward motion of the vehicle causing forward motion of the image capture device, the image capture device rotated by the person during the capture of the spherical video content such that a front direction of the spherical video content is pointed away from the forward motion of the image capture device during the capture of the spherical video content, the image capture device rotated by the person independently of the forward motion of the vehicle;

obtaining, by the computing system, sensor information generated by a motion sensor or a location sensor separate from the one or more image sensors of the image capture device, the sensor information characterizing the forward motion of the image capture device during the capture of the spherical video content;

determining, by the computing system, a viewing direction for the spherical video content based on the forward motion of the image capture device and the rotation of the image capture device that causes the front direction of the spherical video content to be pointed away from the forward motion of the image capture device, the viewing direction determined to be pointed in the forward motion of the image capture device during the capture of the spherical video content and to compensate for the rotation of the image capture device by the person during the capture of the spherical video content such that a punch-out view of the spherical video content follows and stays centered in the forward motion of the image capture device during the capture of the spherical video content, the viewing direction defining a direction of view for the spherical video content from the point of view as the function of progress through the progress length of the spherical video content; and

presenting, by the computing system, the spherical video content on a display based on the viewing direction such that the presentation of the spherical video content includes a punch-out view of the spherical video content that follows and stays centered in the forward motion of the image capture device during the capture of the spherical video content.

10. The method of claim 9 , wherein the motion sensor or the location sensor is carried by the vehicle.

11. The method of claim 9 , wherein the sensor information further characterizes a tilt of the vehicle, and the viewing direction is determined based on the tilt of the vehicle such that the viewing direction is directed towards back of the vehicle rather than the forward motion of the image capture device based on the tilt of the vehicle exceeding a threshold angle.

12. The method of claim 9 , wherein:

the image capture device is carried by the person based on the image capture device being carried on the person's head; and

the image capture device rotates independently of the forward motion of the vehicle based on rotation of the person's head.

13. The method of claim 12 , wherein the image capture device being carried on the person's head includes the image capture device being mounted on a helmet worn by the person.

14. The method of claim 13 , wherein determining the viewing direction to be pointed in the forward motion of the image capture device during the capture of the spherical video content and to compensate for the rotation of the image capture device by the person during the capture of the spherical video content includes the viewing direction being determined to compensate for the rotation of the person's head during the capture of the spherical video content.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
SECURITY INTEREST Recorded Sep 5, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047016/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2018
From: VADEN, MARK; COTOROS, INGRID A.; NOVELL, SCOTT; DOTTEL, VALÉRIAN; TILLOUX, GUILLAUME; BAILLIARD, LOÏC; LANOIR, LOÏC
To: GOPRO, INC.
Reel/Frame 046505/0270 →
Cited By (5)
US 12,249,042 US 12,309,343 US 12,363,373 US 12,614,567 US 12,647,547