IP Library Granted Patent US 10,129,470
Granted Patent B2
US 10,129,470 · App. 14/887,122 · Granted Nov 13, 2018

Apparatus and method for generating an output video stream from a wide field video stream

Inventors: Alexandre Jenny (Challes-les-Eaux, FR); Yann Renaud Gilquin (Chambery, FR)
Assignee: GoPro, Inc.
H04N5/23238G06T3/0031H04N9/3179
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,129,470
App. No.
14/887,122
Granted
Nov 13, 2018
Kind
B2
Abstract

System and methods are disclosed for generating an output video stream from a wide field video stream. The wide field video stream may be created from compiling a plurality of video stream capturing different viewpoints of the same environment simultaneously. Upon selecting a wide field video stream, a first geometric function may be utilized to generate individual intermediate points that correspond to locations in a wide field video stream to be displayed on a particular display space. A second geometric function may be further utilized to generate reference points so that a the pixel on the output video stream are determined from the intermediate points of the wide field video stream of the first geometric function. Upon the execution of the first and second geometric function, an output video stream is generated for display on the determined display space.

Claims (48)

1. A method for generating an output video stream comprising:

obtaining a wide field video stream;

obtaining a specified first projection and a second projection of content from the wide field video stream to be displayed on a display space, the display space including a first screen and a second screen, the first screen and the second screen individually including multiple display points to display the content from the wide field video stream, the multiple display points including a first display point of the first screen and a second display point of the second screen;

executing a first geometric function to generate intermediate points for the display points for the first screen and the second screen, wherein:

for the first screen the first geometric function takes as parameters the first projection and a first field of view within the wide field video stream, wherein individual intermediate points for the first screen correspond to locations in the wide field video stream at which the content is to be presented on the first screen in the first projection such that the intermediate points for the first screen include a first intermediate point that corresponds to a first location in the wide field video stream at which the content to be presented at the first display point is located, and

for the second screen the first geometric function takes as parameters the second projection and a second field of view within the wide field video stream, wherein individual intermediate points for the second screen correspond to locations in the wide field video stream at which the content is to be presented on the second screen in the second projection such that the intermediate points for the second screen include a second intermediate point that corresponds to a second location in the wide field video stream at which the content to be presented at the second display point is located;

generating a first output video stream from the wide field video stream by determining reference points of the content of the wide field video stream for the intermediate points for the first screen, wherein individual reference points for the first screen are at least one pixel of the first output video stream determined from the content at the locations in the wide field video stream at which the content is to be presented on the first screen, such that a first reference point for the first intermediate point is at least one pixel of the first output video stream determined from the content at the first location in the wide field video stream;

generating a second output video stream from the wide field video stream by determining reference points of the content of the wide field video stream for the intermediate points of the second screen, wherein individual reference points for the second screen are at least one pixel of the second output video stream determined from the content at the locations in the wide field video stream at which the content is to be presented on the second screen, such that a second reference point for the first intermediate point is at least one pixel of the second output video stream determined from the content at the second location in the wide field video stream; and

effectuating a presentation of the first output video stream on the first screen concurrently with a presentation of the second output video stream on the second screen;

wherein the display space comprises a virtual reality headset such that the first screen presents the first output video stream to a first eye of a user and the second screen presents the second output video stream to a second eye of the user creating an immersive experience.

2. The method of claim 1 , wherein the intermediate points for the first screen correspond to at least one pixel of the content of the wide field video stream to be displayed on the first screen of the display space.

3. The method of claim 1 , wherein determining the reference points of the content of the wide field video stream for the intermediate points for the first screen comprises executing a second geometric function such that the second geometric function takes as parameters the intermediate points for the first screen such that determining the first reference point includes executing the second geometric function that takes as a parameter the first intermediate point.

4. The method of claim 1 , wherein the at least one pixel of the output video stream of the first reference point corresponds to at least one pixel of the content of the wide field video stream at the location in the wide field video stream that corresponds to the first intermediate point.

5. The method of claim 1 , further comprising modifying the first field of view by updating a coordinate of the intermediate points for the first screen; and modifying the first field of view by updating an angle of the first field of view.

6. The method of claim 5 , wherein modifying the first field of view further comprises modifying an orientation of a virtual video camera located in a spherical coordinate system.

7. The method of claim 5 , wherein modifying the first field of view further comprises:

converting the coordinate on the intermediate point for the first screen in a three dimensional coordinate system into a spherical coordinate system; and

modifying an orientation of a virtual camera; and

normalizing the coordinate in the spherical coordinate system to generate a new coordinate on the intermediate point for the first screen in the three dimensional coordinate system.

8. The method of claim 7 , wherein modifying the orientation of the virtual camera comprises a latitude angle of the virtual camera in the spherical coordinate system, a longitude angle of the virtual camera in the spherical coordinate system, and a field of angle value of the virtual camera.

9. The method of claim 1 , further comprising executing the first geometric function with a graphical processor unit to generate a corresponding image of the first output video stream.

10. The method of claim 1 , further comprising:

defining an effect filter to be applied to an image of the first output video stream.

11. The method of claim 10 , wherein the effect filter comprises one or more of a contrast filter, a luminosity filter, a saturation filter, a color filter, or an image deformation filter.

12. A device configured to manage an output video stream comprising:

an element configured to:

select a wide field video stream;

obtain a specified first projection and a second projection of content from the wide field video stream to be displayed on a display space, the display space including a first screen and a second screen, the first screen and the second screen individually including multiple points to display the content from the wide field video stream, the multiple display points including a first display point of the first screen and a second display point of the second screen;

execute a first geometric function to generate intermediate points for the points on the display space for the first screen and the second screen, wherein:

for the first screen the first geometric function takes as parameters the first projection and a first field of view within the wide field video stream, wherein individual intermediate points for the first screen correspond to locations in the wide field video stream at which the content is to be presented on the first screen in the first projection such that the intermediate points for the first screen include a first intermediate point that corresponds to a first location in the wide field video stream at which the content to be presented at the first display point is located, and

for the second screen the first geometric function takes as parameters the second projection and a second field of view within the wide field video stream, wherein individual intermediate points for the second screen correspond to locations in the wide field video stream at which the content is to be presented on the second screen in the second projection such that the intermediate points for the second screen include a second intermediate point that corresponds to a second location in the wide field video stream at which the content to be presented at the second display point is located;

generate a first output video stream from the wide field video stream by executing a second geometric function that takes as parameters the intermediate points for the first screen, the execution of the second geometric function determines reference points of the content of the wide field video stream for the intermediate points for the first screen, wherein individual reference points for the first screen are at least one pixel of the first output video stream determined from the content at the locations in the wide field video stream at which the content is to be presented on the first screen, such that a first reference point for the first intermediate point is at least one pixel of the first output video stream determined from the content at the first location in the wide field video stream;

generate a second output video stream from the wide field video stream by executing the second geometric function that takes as parameters the intermediate points for the second screen, the execution of the second geometric function determines reference points of the content of the wide field video stream for the intermediate points for the second screen, wherein individual reference points for the second screen are at least one pixel of the second output video stream determined from the content at the locations in the wide field video stream at which the content is to be presented on the second screen, such that a second reference point for the second intermediate point is at least one pixel of the second output video stream determined from the content at the second location in the wide field video stream; and

effectuate a presentation of the first output video stream on the first screen concurrently with a presentation of the second output video stream on the second screen;

wherein display space comprises a virtual reality headset such that the first screen presents the first output video stream to a first eye of a user and the second screen presents the second output video stream to a second eye of the user creating an immersive experience.

13. The device of claim 12 , further comprising a touchscreen, an accelerometer, a gyroscope, a magnetometer, a space for displaying the wide field video stream, a pointing device, and a moving detecting gestural interface.

14. The device of claim 13 , further comprising the display space.

15. A system configured to generate an output video stream from a wide field video stream, the system comprising:

one or more physical processors configured by machine-readable instructions to:

select a wide field video stream corresponding to an assembly of multiple video streams, the wide field video stream including different fields of view of a same environment;

obtain a specific first projection and a second projection of the wide field video stream to be displayed on a display space, the display space including a first screen and a second screen, the first screen and the second screen individually including multiple points to display the content from the wide field video stream, the multiple display points including a first display point of the first screen and a second display point of the second screen;

execute a first geometric function to generate intermediate points for the display points for the first screen and the second, wherein:

for the first screen the first geometric function takes as parameters the first projection and a first field of view in the wide field video stream, wherein the intermediate points for the first screen correspond to locations in the wide field video stream at which the content is to be presented on the first screen in the first projection such that the intermediate points for the first screen include a first intermediate point that corresponds to a first location in the wide field video stream at which the content to be presented at the first display point is located, and

for the second screen the first geometric function takes as parameters the second projection and a second field of view within the wide field video stream, wherein individual intermediate points for the second screen correspond to locations in the wide field video stream at which the content is to be presented on the second screen in the second projection such that the intermediate points for the second screen include a second intermediate point that corresponds to a second location in the wide field video stream at which the content to be presented at the second display point is located:

generate a first output video stream from the wide field video stream by determining reference points of the content of the wide field video stream for the intermediate points for the first screen, wherein individual reference points for the first screen are at least one pixel of the first output video stream determined from the content at the locations in the wide field video stream at which the content is to be presented on the first screen, such that a first reference point for the first intermediate point is at least one pixel of the first output video stream determined from the content at the first location in the wide field video stream;

generate a second output video stream from the wide field video stream by determining reference points of the content of the wide field video stream for the intermediate points of the second screen, wherein individual reference points for the second screen are at least one pixel of the second output video stream determined from the content at the locations in the wide field video stream at which the content is to be presented on the second screen, such that a second reference point for the first intermediate point is at least one pixel of the second output video stream determined from the content at the second location in the wide field video stream; and

effectuate a presentation of the first output video stream on the first screen concurrently with a presentation of the second output video stream on the second screen;

wherein the display space comprises a virtual reality headset such that the first screen presents the first output video stream to a first eye of a user and the second screen presents the second output video stream to a second eye of the user creating an immersive experience.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
SECURITY INTEREST Recorded Feb 22, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041777/0440 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2016
From: JENNY, ALEXANDRE; GILQUIN, YANN RENAUD
To: GOPRO, INC.
Reel/Frame 039791/0084 →
Priority Claims (1)
FR 13 53565 · Apr 19, 2013 · national
Continuity (3)
Continuation PCTEP2014058008 · Apr 18, 2014
Related Publication 20160112635A1 · Apr 21, 2016
Related Publication 20180255241A9 · Sep 6, 2018