IP Library Patent Application 15717436
Patent Application
App. No. 15/717,436

SYSTEMS AND METHODS FOR GENERATING AUDIO-ENHANCED IMAGES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/717,436
Abstract

Image information may define spherical image content. Audio information may define audio content having a duration. The audio content may be captured before, during, and/or after capture of the spherical image content. Image-audio information defining audio-enhanced spherical image content may be generated. The image-audio information may include the image information and the audio information within a structure such that a viewing of the audio-enhanced spherical image content includes a presentation of the visual content on a display with a playback of the audio content. The presentation of the visual content may enable movement of a viewing window during the playback of the audio content. The viewing window may define extents of the visual content viewable from a point of view and presented on the display. The image-audio information may be stored in one or more storage media.

Claims (40)

1 . A system that generates an audio-enhanced spherical image, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain image information defining a spherical image, the spherical image depicting visual content viewable from a point of view;

obtain audio information defining audio content, the audio content having a duration, the audio content being captured before, during, and after capture of the spherical image;

generate image-audio information defining an audio-enhanced spherical image, the image-audio information including the image information and the audio information within a structure such that a consumption of the audio-enhanced spherical image includes a presentation of the spherical image on a display with a concurrent playback of the duration of the audio content, the presentation of the spherical image enabling movement of a viewing window during the playback of the duration of the audio content, the viewing window defining extents of the spherical image viewable from the point of view and presented on the display; and

effectuate storage of the image-audio information in a storage medium.

2 . The system of claim 1 , wherein:

the audio content includes spatial sounds;

the audio information characterizes one or more directions of the spatial sounds within the audio content; and

the playback of the audio content changes based on the movement of the viewing window during the playback of the audio content and the one or more directions of the spatial sounds within the audio content.

3 . The system of claim 1 , wherein the spherical image is captured by an image capture device and the audio content is captured by an audio capture device of the image capture device.

4 . (canceled)

5 . The system of claim 1 , wherein the spherical image corresponds to a midpoint of the duration of audio content.

6 . The system of claim 1 , wherein the spherical image corresponds to a non-midpoint of the duration of audio content.

7 . The system of claim 1 , wherein the spherical image is determined prior to a determination of the audio content.

8 . The system of claim 1 , wherein the audio content is determined prior to a determination of the spherical image.

9 . The system of claim 1 , wherein the audio content is determined based on user selection, audio analysis, and/or highlight events.

10 . A method for generating an audio-enhanced image, the method performed by a computing system including one or more physical processors, the method comprising:

obtaining, by the computing system, image information defining a spherical image, the spherical image depicting visual content viewable from a point of view;

obtaining, by the computing system, audio information defining audio content, the audio content having a duration, the audio content captured before, during, and after capture of the spherical image;

generating, by the computing system, image-audio information defining an audio-enhanced spherical image, the image-audio information including the image information and the audio information within a structure such that a consumption of the audio-enhanced spherical image includes a presentation of the spherical image on a display with a concurrent playback of the duration of the audio content, the presentation of the spherical image enabling movement of a viewing window during the playback of the duration of the audio content, the viewing window defining extents of the spherical image viewable from the point of view and presented on the display; and

effectuating, by the computing system, storage of the image-audio information in a storage medium.

11 . The method of claim 10 , wherein:

the audio content includes spatial sounds;

the audio information characterizes one or more directions of the spatial sounds within the audio content; and

the playback of the audio content changes based on the movement of the viewing window during the playback of the audio content and the one or more directions of the spatial sounds within the audio content.

12 . The method of claim 10 , wherein the spherical image is captured by an image capture device and the audio content is captured by an audio capture device of the image capture device.

13 . (canceled)

14 . The method of claim 10 , wherein the spherical image corresponds to a midpoint of the duration of audio content.

15 . The method of claim 10 , wherein the spherical image corresponds to a non-midpoint of the duration of audio content.

16 . The method of claim 10 , wherein the spherical image is determined prior to a determination of the audio content.

17 . The method of claim 10 , wherein the audio content is determined prior to a determination of the spherical image content.

18 . The method of claim 10 , wherein the audio content is determined based on user selection, audio analysis, and/or highlight events.

19 . A system that generates an audio-enhanced spherical image, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain image information defining a spherical image, the spherical image depicting visual content viewable from a point of view;

obtain audio information defining audio content, the audio content having a duration, the audio content being captured before, during, and after capture of the spherical image, wherein the audio content includes spatial sounds and the audio information characterizes one or more directions of the spatial sounds within the audio content;

generate image-audio information defining an audio-enhanced spherical image, the image-audio information including the image information and the audio information within a structure such that a consumption of the audio-enhanced spherical image includes a presentation of the spherical image on a display with a playback of the duration of the audio content, the presentation of the spherical image enabling movement of a viewing window during the playback of the duration of the audio content, the viewing window defining extents of the visual content viewable from the point of view and presented on the display, wherein the playback of the audio content changes based on the movement of the viewing window during the playback of the audio content and the one or more directions of the spatial sounds within the audio content; and

effectuate storage of the image-audio information in a storage medium.

20 . The system of claim 19 , wherein the spherical image is captured by an image capture device and the audio content is captured by an audio capture device of the image capture device.

Assignments (3)
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Feb 9, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 044983/0718 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2017
From: BONNER, JESSICA
To: GOPRO, INC.
Reel/Frame 043717/0552 →