Systems and methods for displaying subjects of an audio portion of content and searching for content related to a subject of the audio portion
Systems and methods are described herein for displaying subjects of a portion of content and searching for content related to a particular subject in the content. Media data of content is analyzed during playback, and a number of audio signatures are identified. Each audio signature is associated, based on audio characteristics, with a particular subject within the content. The audio signature is stored, along with a timestamp corresponding to a playback position at which the audio signature begins, in association with an identifier of the particular subject. Upon receiving a command, icons representing each of a number of audio signatures at or near the current playback position are displayed. Upon receiving user selection of an icon corresponding to a particular signature, a portion of the content corresponding to the audio signature is played back or a search is performed for content related to the signature represented by the selected icon.
1. A method for displaying subjects of a portion of audio of content, the method comprising:
identifying, during playback of the content, a plurality of audio signatures corresponding to a plurality of sounds, respectively, in the audio of the content, wherein the plurality of audio signatures is associated with a plurality of subjects, respectively, within the content;
storing, for each respective audio signature of the plurality of audio signatures:
a timestamp at which a respective sound, of the plurality of sounds, that corresponds to the respective audio signature begins, and
an identifier of the respective audio signature;
receiving an input command;
generating for display a plurality of icons representing the plurality of audio signatures, respectively;
receiving a selection of an icon of the plurality of icons; and
performing a search for content related to the respective audio signature, of the plurality of audio signatures, that is represented by the selected icon.
2. The method of claim 1 , wherein the selection of the icon comprises a swipe gesture on a touchscreen interface.
3. The method of claim 2 , further comprising identifying a direction of the swipe gesture, wherein:
the direction of the swipe gesture is one of a plurality of directions; and
a type of the search for content related to the audio signature is based on the direction of the swipe.
4. The method of claim 3 , further comprising, in response to identifying a direction of the plurality of directions of the swipe gesture, performing a search for content containing a respective subject, of the plurality of subjects, that is associated with the audio signature represented by the selected icon.
5. The method of claim 3 , further comprising, in response to identifying a direction of the plurality of directions of the swipe gesture, performing a search for content having an audio signature similar to the audio signature represented by the selected icon.
6. The method of claim 3 , further comprising, in response to identifying a direction of the plurality of directions of the swipe gesture:
identifying the subject of the audio signature represented by the selected icon; and
performing a search for content published by the identified subject.
7. The method of claim 2 , wherein the swipe gesture passes through a second icon of the plurality of icons, the method further comprising:
retrieving a plurality of search results related to both the audio signature represented by the selected icon and the audio signature represented by the second icon.
8. The method of claim 1 , wherein the selection of the icon comprises a tap on a touchscreen interface.
9. The method of claim 8 , further comprising:
determining a duration of the tap;
in response to determining that the duration of the tap is below a threshold duration, performing a search for content containing the subject of the audio signature represented by the selected icon; and
in response to determining that the duration of the tap meets or exceeds the threshold duration:
identifying the subject of the audio signature represented by the selected icon; and
performing a search for content published by the identified subject.
10. The method of claim 8 , further comprising:
determining an intensity of the tap;
in response to determining that the intensity of the tap is below a threshold intensity, performing a search for content containing the subject of the audio signature represented by the selected icon; and
in response to determining that the intensity of the tap meets or exceeds the threshold intensity:
identifying the subject of the audio signature represented by the selected icon; and
performing a search for content published by the identified subject.
11. A system for searching for content related to a subject of a portion of audio of content, the system comprising;
memory; and
control circuitry configured to:
identify, during playback of the content, a plurality of audio signatures corresponding to a plurality of sounds, respectively, in the audio of the content, wherein the plurality of audio signatures is associated with a plurality of subjects, respectively, within the content;
store, in the memory, for each respective audio signature of the plurality of audio signature:
a timestamp at which a respective sound, of the plurality sounds, that corresponds to the respective audio signature begins, and
an identifier of the respective audio signature;
receive an input command;
generate for display a plurality of icons representing the plurality of audio signatures, respectively;
receive a selection of an icon of the plurality of icons; and
perform a search for content related to the respective audio signature, of the plurality of audio signatures, that is represented by the selected icon.
12. The system of claim 11 , wherein the selection of the icon comprises a swipe gesture on a touchscreen interface.
13. The system of claim 12 , wherein the control circuitry is further configured to identify a direction of the swipe gesture, wherein:
the direction of the swipe gesture is one of a plurality of directions; and
a type of the search for content related to the audio signature is based on the direction of the swipe.
14. The system of claim 13 , wherein the control circuitry is further configured to perform, in response to identifying a direction of the plurality of directions of the swipe gesture, a search for content containing a respective subject, of the plurality of subjects, that is associated with the audio signature represented by the selected icon.
15. The system of claim 13 , wherein the control circuitry is further configured to perform, in response to identifying a direction of the plurality of directions of the swipe gesture, a search for content having an audio signature similar to the audio signature represented by the selected icon.
16. The system of claim 13 , wherein the control circuitry is further configured to, in response to identifying a direction of the plurality of directions of the swipe gesture:
identify the subject of the audio signature represented by the selected icon; and
perform a search for content published by the identified subject.
17. The system of claim 12 , wherein the swipe gesture passes through a second icon of the plurality of icons, and wherein the control circuitry is further configured to:
retrieve a plurality of search results related to both the audio signature represented by the selected icon and the audio signature represented by the second icon.
18. The system of claim 11 , wherein the selection of the icon comprises a tap on a touchscreen interface.
19. The system of claim 18 , wherein the control circuitry is further configured to:
determine a duration of the tap;
in response to determining that the duration of the tap is below a threshold duration, perform a search for content containing the subject of the audio signature represented by the selected icon; and
in response to determining that the duration of the tap meets or exceeds the threshold duration:
identify the subject of the audio signature represented by the selected icon; and
perform a search for content published by the identified subject.
20. The system of claim 18 , wherein the control circuitry is further configured to:
determine an intensity of the tap;
in response to determining that the intensity of the tap is below a threshold intensity, perform a search for content containing the subject of the audio signature represented by the selected icon; and
in response to determining that the intensity of the tap meets or exceeds the threshold intensity:
identify the subject of the audio signature represented by the selected icon; and
perform a search for content published by the identified subject.