Spatial seeking in media files
View Patent ↗A method, apparatus, and computer program product are provided in order to playback video and/or audio files wherein a desired segment is selected and played back based on its spatial audio content. In the context of a method, playback of media data is provided. The method may include generating one or more spatial seek points for the media data and causing display of information corresponding to the one or more spatial seek points. The method may further include performing the generation of the one or more seek points based on receiving a request for spatial seek points, automatically upon receiving the media data or upon starting playback of the media data, or based on the format of the media data. The method may further include receiving a selection of one of the one or more spatial seek points and providing for playback of the media data from a time point corresponding to the selected spatial seek point. A corresponding apparatus and a computer program product are also provided.
1. A method comprising:
providing for spatial audio playback of media data;
generating, by a processor, one or more spatial seek points for the media data, wherein the spatial seek points correspond to a direction of a source of audio in the media data and indicate a location of the source of audio during a plurality of time segments within the media data;
causing display of information corresponding to the one or more spatial seek points to be provided to a user interface, wherein the one or more spatial seek points are associated with the location of the source of audio;
receiving a selection of one of the one or more spatial seek points;
providing for spatial audio playback of the source of audio starting from a point of time of a segment corresponding to the selected at least one of the one or more spatial seek points; and
causing display via the user interface of the selected at least one spatial seek point of the one or more spatial seek points to provide visual information about the spatial audio playback of the source of audio from the point of time during the time segment, the spatial audio playback comprises the direction of the source of audio during the time segment.
2. The method of claim 1 wherein generating the one or more spatial seek points for the media data is performed based on at least one of receiving a request for spatial seek points in the media data, automatically upon receiving the media data or upon starting playback of the media data, and a format of the media data.
3. The method of claim 2 wherein the request for spatial seek points in the media data comprises a requested location for spatial audio events in the media data.
4. The method of claim 1 further comprising causing storing of spatial seek point information for later use.
5. The method of claim 1 further comprising determining spatial audio characteristics of the media data for use in generating the one or more spatial seek points for the media data.
6. The method of claim 1 wherein causing display of information corresponding to the one or more spatial seek points comprises at least one of indicating start points of segments corresponding to spatial audio events from a requested location and causing display of a timeline indicating the spatial seek points and a thumbnail picture of a corresponding video segment for each of the spatial seek points on the timeline.
7. The method of claim 1 wherein the point of time is at a beginning point of time of the time segment.
8. The method of claim 1 further comprising causing display via the user interface of a further spatial seek point so as to provide playback of the media data from an associated time point of the further spatial seek point, wherein the associated time point of the further spatial seek point corresponds to a weaker indication of the direction of the source of audio.
9. An apparatus comprising at least one processor and at least one memory including computer program instructions, the at least one memory and the computer program instructions configured to, with the at least one processor, cause the apparatus at least to:
provide for spatial audio playback of media data;
generate one or more spatial seek points for the media data, wherein the one or more spatial seek points correspond to a direction of a source of audio in the media data and indicate a location of the source of audio during a plurality of time segments within the media data;
cause display of information corresponding to at least one or more spatial seek points to be provided to a user interface, wherein the one or more spatial seek points are associated with the location of the source of audio;
receive a selection of at least one of the one or more spatial seek points;
provide for spatial audio playback of the source of audio starting from a point of time of a segment corresponding to the at least one of the one or more spatial seek points; and
cause display via the user interface of the selected at least one spatial seek point of the one or more spatial seek points to provide visual information about the spatial audio playback of the source of audio from the point of time during the time segment, the spatial audio playback comprises the direction of the source of audio during the time segment.
10. The apparatus of claim 9 further configured to cause the apparatus to generate the one or more spatial seek points for the media data upon receiving a request for spatial seek points in the media data, automatically upon receiving the media data or upon starting playback of the media data, or based on a format of the media data.
11. The apparatus of claim 10 wherein the request for spatial seek points in the media data comprises a requested location for spatial audio events in the media data.
12. The apparatus of claim 9 further configured to cause the apparatus to store spatial seek point information for later use.
13. The apparatus of claim 9 further configured to cause the apparatus to determine spatial audio characteristics of the media data for use in generating the one or more spatial seek points for the media data.
14. The apparatus of claim 9 wherein causing display of information corresponding to the one or more spatial seek points comprises at least one of indicating start points of segments corresponding to spatial audio events from a requested location and causing display of a timeline indicating the spatial seek points and a thumbnail picture of a corresponding video segment for each of the spatial seek points on the timeline.
15. The apparatus of claim 9 wherein the point of time is at a beginning point of time of the time segment.
16. The apparatus of claim 9 further configured to cause the apparatus to cause display via the user interface of a further spatial seek point so as to provide playback of the media data from an associated time point of the further spatial seek point, wherein the associated time point of the further spatial seek point corresponds to a weaker indication of the direction of the source of audio.
17. A computer program product comprising at least one non-transitory computer-readable storage medium bearing computer program instructions embodied therein for use with a computer, the computer program instructions comprising program instructions configured to:
provide for spatial audio playback of media data;
generate one or more spatial seek points for the media data, wherein the spatial seek points correspond to a direction of a source of audio in the media data and indicate a location of the source of audio during a plurality of time segments within the media data;
cause display of information corresponding to at least one of the one or more spatial seek points to be provided to a user interface, wherein the one or more spatial seek points are associated with the location of the source of audio;
receive a selection of one of the one or more spatial seek points;
provide for spatial audio playback of the source of audio starting from a point of time of a segment corresponding to the at least one of the one or more spatial seek points; and
cause display via the user interface of the selected at least one spatial seek point of the one or more spatial seek points to provide visual information about the spatial audio playback of the source of audio from the point of time during the time segment, the spatial audio playback comprises the direction of the source of audio during the time segment.
18. The computer program product of claim 17 further comprising program instructions configured to generate the one or more spatial seek points for the media data based on at least one of receiving a request for spatial seek points in the media data, automatically upon receiving the media data or upon starting playback of the media data, or a format of the media data.
19. The computer program product of claim 17 wherein the point of time is at a beginning point of time of the time segment.
20. The computer program product of claim 17 further comprising program instructions configured to cause display via the user interface of a further spatial seek point so as to provide playback of the media data from an associated time point of the further spatial seek point, wherein the associated time point of the further spatial seek point corresponds to a weaker indication of the direction of the source of audio.