Granted Patent B2

US 12,309,343 · App. 18/312,467 · Granted May 20, 2025

Inventors: Mark Vaden (San Diego, CA); Ingrid A. Cotoros (Hillsborough, CA); Scott Novell (Carlsbad, CA); Valerian Dottel (Allevard, FR); Guillaume Tilloux (Chapareillan, FR); Loic Bailliard (Annecy, FR); Loic Lanoir (La Trinite, FR)

Assignee: GoPro, Inc.

H04N13/117H04N13/366

Abstract

Claims (61)

1. A system for identifying viewing directions for video content, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining the video content, the video content having a progress length, the video content captured by an image capture device;

obtain sensor information, the sensor information characterizing locations of the image capture device and locations of an object during capture of the video content, the sensor information generated based on a first GPS sensor of the image capture device and a second GPS sensor of the object;

determine orientation of the image capture device to the object during the capture of the video content based on the locations of the image capture device and the locations of the object during the capture of the video content, the orientation of the image capture device to the object including directions of the object from the image capture device and distances between the object and the image capture device;

determine a viewing direction for the video content based on the orientation of the image capture device to the object during the capture of the video content, wherein:

the distances between the object and the image capture device during the capture of the video content are used to determine whether or not the viewing direction is determined for corresponding parts of the progress length of the video content and

the directions of the object from the image capture device during the capture of the video content are used to determine where the viewing direction is pointed for one or more parts of the progress length of the video content; and

present the video content on a display based on the viewing direction to include a view of the object.

2. The system of claim 1 , wherein the video content includes spherical video content, the spherical video content defining visual content from a point a view as a function of progress through the progress length of the spherical video content.

3. The system of claim 1 , wherein the orientation of the image capture device to the object during the capture of the video content is determined further based on visual analysis of the video content.

4. The system of claim 1 , wherein determination of the viewing direction for the video content based on the orientation of the image capture device to the object during the capture of the video content simulates stabilization of the video content.

5. The system of claim 1 , wherein the orientation of the image capture device to the object changes during the capture of the video content due to motion of the image capture device and/or motion of the object.

6. A method for identifying viewing directions for video content, the method performed by a computing system including one or more processors, the method comprising:

obtaining video information defining the video content, the video content having a progress length, the video content captured by an image capture device;

obtaining sensor information, the sensor information characterizing locations of the image capture device and locations of an object during capture of the video content, the sensor information generated based on a first GPS sensor of the image capture device and a second GPS sensor of the object;

determining orientation of the image capture device to the object during the capture of the video content based on the locations of the image capture device and the locations of the object during the capture of the video content, the orientation of the image capture device to the object including directions of the object from the image capture device and distances between the object and the image capture device;

determining a viewing direction for the video content based on the orientation of the image capture device to the object during the capture of the video content, wherein:

the distances between the object and the image capture device during the capture of the video content are used to determine whether or not the viewing direction is determined for corresponding parts of the progress length of the video content and

the directions of the object from the image capture device during the capture of the video content are used to determine where the viewing direction is pointed for one or more parts of the progress length of the video content; and

presenting the video content on a display based on the viewing direction to include a view of the object.

7. The method of claim 6 , wherein the video content includes spherical video content, the spherical video content defining visual content from a point a view as a function of progress through the progress length of the spherical video content.

8. The method of claim 6 , wherein the orientation of the image capture device to the object during the capture of the video content is determined further based on visual analysis of the video content.

9. The method of claim 6 , wherein determining the viewing direction for the video content based on the orientation of the image capture device to the object during the capture of the video content simulates stabilization of the video content.

10. The method of claim 6 , wherein the orientation of the image capture device to the object changes during the capture of the video content due to motion of the image capture device and/or motion of the object.

11. A system for identifying viewing directions for video content, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain video information defining the spherical video content, the spherical video content having a progress length, the spherical video content defining visual content from a point a view as a function of progress through the progress length of the spherical video content, the spherical video content captured by an image capture device;

obtain sensor information, the sensor information characterizing locations of the image capture device and locations of an object during capture of the video content, the sensor information generated based on a first GPS sensor of the image capture device and a second GPS sensor of the object;

determine orientation of the image capture device to the object during the capture of the video content based on the locations of the image capture device and the locations of the object during the capture of the video content, the orientation of the image capture device to the object including directions of the object from the image capture device and distances between the object and the image capture device;

determine a viewing direction for the video content based on the orientation of the image capture device to the object during the capture of the video content, wherein:

the distances between the object and the image capture device during the capture of the video content are used to determine whether or not the viewing direction is determined for corresponding parts of the progress length of the video content and

the directions of the object from the image capture device during the capture of the video content are used to determine where the viewing direction is pointed for one or more parts of the progress length of the video content; and

present the video content on a display based on the viewing direction to include a view of the object.

12. The system of claim 11 , wherein:

the viewing direction is determined for a given part of the progress length of the video content based on the distances between the object and the image capture device during the capture of the video content indicating the object approaching the image capture device, the object moving away from the image capture device, or the object passing the image capture device during the capture of the video content; and

the viewing direction for the given part of the progress length of the video content is determined based on the directions of the object from the image capture device during the capture of the video content to include the object approaching the image capture device, the object moving away from the image capture device, or the object passing the image capture device in the presentation of the video content.

13. The system of claim 3 , wherein determination of the orientation of the image capture device to the object during the capture of the video content based on (i) the locations of the image capture device and the locations of the object during the capture of the video content and (ii) the visual analysis of the video content includes:

determination of approximate directions of the object from the image capture device based on the locations of the image capture device and the locations of the object characterized by the sensor information; and

limitation of the visual analysis of the video content to image portions of the video content corresponding to the approximate directions of the object from the image capture device to fine-tune direction determination.

14. The system of claim 1 , wherein:

the viewing direction is determined for a given part of the progress length of the video content based on the distances between the object and the image capture device during the capture of the video content indicating the object approaching the image capture device during the capture of the video content; and

the viewing direction for the given part of the progress length of the video content is determined based on the directions of the object from the image capture device during the capture of the video content to include the object approaching the image capture device in the presentation of the video content.

15. The system of claim 1 , wherein:

the viewing direction is determined for a given part of the progress length of the video content based on the distances between the object and the image capture device during the capture of the video content indicating the object moving away from the image capture device during the capture of the video content; and

the viewing direction for the given part of the progress length of the video content is determined based on the directions of the object from the image capture device during the capture of the video content to include the object moving away from the image capture device in the presentation of the video content.

16. The system of claim 1 , wherein:

the viewing direction is determined for a given part of the progress length of the video content based on the distances between the object and the image capture device during the capture of the video content indicating the object passing the image capture device during the capture of the video content; and

the viewing direction for the given part of the progress length of the video content is determined based on the directions of the object from the image capture device during the capture of the video content to include the object passing the image capture device in the presentation of the video content.

17. The method of claim 8 , wherein determining the orientation of the image capture device to the object during the capture of the video content based on (i) the locations of the image capture device and the locations of the object during the capture of the video content and (ii) the visual analysis of the video content includes:

determining approximate directions of the object from the image capture device based on the locations of the image capture device and the locations of the object characterized by the sensor information; and

limiting the visual analysis of the video content to image portions of the video content corresponding to the approximate directions of the object from the image capture device to fine-tune direction determination.

18. The method of claim 6 , wherein:

the viewing direction is determined for a given part of the progress length of the video content based on the distances between the object and the image capture device during the capture of the video content indicating the object approaching the image capture device during the capture of the video content; and

the viewing direction for the given part of the progress length of the video content is determined based on the directions of the object from the image capture device during the capture of the video content to include the object approaching the image capture device in the presentation of the video content.

19. The method of claim 6 , wherein:

the viewing direction is determined for a given part of the progress length of the video content based on the distances between the object and the image capture device during the capture of the video content indicating the object moving away from the image capture device during the capture of the video content; and

the viewing direction for the given part of the progress length of the video content is determined based on the directions of the object from the image capture device during the capture of the video content to include the object moving away from the image capture device in the presentation of the video content.

20. The method of claim 6 , wherein:

the viewing direction is determined for a given part of the progress length of the video content based on the distances between the object and the image capture device during the capture of the video content indicating the object passing the image capture device during the capture of the video content; and

the viewing direction for the given part of the progress length of the video content is determined based on the directions of the object from the image capture device during the capture of the video content to include the object passing the image capture device in the presentation of the video content.

Assignments (3)

Continuity (4)

References Cited (17)