Systems and methods for displaying subjects of an audio portion of content and searching for content related to a subject of the audio portion
Systems and methods are described herein for displaying subjects of a portion of content and searching for content related to a particular subject in the content. Media data of content is analyzed during playback, and a number of audio signatures are identified. Each audio signature is associated, based on audio characteristics, with a particular subject within the content. The audio signature is stored, along with a timestamp corresponding to a playback position at which the audio signature begins, in association with an identifier of the particular subject. Upon receiving a command, icons representing each of a number of audio signatures at or near the current playback position are displayed. Upon receiving user selection of an icon corresponding to a particular signature, a portion of the content corresponding to the audio signature is played back or a search is performed for content related to the signature represented by the selected icon.
1. A method comprising:
identifying a first subject and a second subject within a media content item;
determining a first plurality of parameters related to the first identified subject and a second plurality of parameters related to the second identified subject, wherein at least one of the first plurality of parameters or the second plurality of parameters is determined based on video processing of objects and characters or actors;
storing the first plurality of parameters as a first subject signature for the first identified subject and the second plurality of parameters as a second subject signature for the second identified subject;
generating for display a first icon representing the first subject signature and a second icon representing the second subject signature;
receiving a selection of the first icon and the second icon, wherein the selection of the first icon and the second icon comprises a swipe gesture on a user interface passing through the first icon and the second icon; and
performing a search for content related to the first subject signature that is represented by the first selected icon and the second subject signature that is represented by the second selected icon.
2. The method of claim 1 , wherein at least one of the first subject or the second subject is an actor or character of the media content item.
3. The method of claim 1 , wherein the at least one of the first plurality of parameters or the second plurality of parameters comprises audio signatures and action signatures.
4. The method of claim 1 , wherein the user interface comprises a touchscreen interface.
5. The method of claim 1 , comprising identifying a direction of the swipe gesture, wherein:
the direction of the swipe gesture is one of a plurality of directions; and
a type of the search for content related to the subject signature is based on the direction of the swipe.
6. The method of claim 5 , comprising:
in response to identifying a direction of the plurality of directions of the swipe gesture, performing a search for content containing a respective subject, of at least one of the first plurality of subjects or the second plurality of subjects that is associated with at least one of the first subject signature represented by the first selected icon or the second subject signature represented by the second selected icon.
7. The method of claim 1 , comprising:
receiving a tap gesture of at least one of the first icon or the second icon.
8. The method of claim 7 , comprising:
determining a duration of the tap gesture;
in response to determining that the duration of the tap gesture is below a threshold duration, performing a search for content containing at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
in response to determining that the duration of the tap gesture meets or exceeds the threshold duration:
identifying the at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
performing a search for content published by the at least one of the first identified subject or the second identified subject.
9. The method of claim 7 , comprising:
determining an intensity of the tap gesture;
in response to determining that the intensity of the tap gesture is below a threshold intensity, performing a search for content containing at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
in response to determining that the intensity of the tap gesture meets or exceeds the threshold intensity:
identifying the at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
performing a search for content published by the at least one of the first identified subject or the second identified subject.
10. A system comprising:
circuitry configured to:
identify a first subject and a second subject within a media content item;
determine a first plurality of parameters related to the first identified subject and a second plurality of parameters related to the second identified subject, wherein at least one of the first plurality of parameters or the second plurality of parameters is determined based on video processing of objects and characters or actors;
store the first plurality of parameters as a first subject signature for the first identified subject and the second plurality of parameters as a second subject signature for the second identified subject;
generate for display a first icon representing the first subject signature and a second icon representing the second subject signature;
receive a selection of the first icon and the second icon, wherein the selection of the first icon and the second icon comprises a swipe gesture on a user interface passing through the first icon and the second icon; and
perform a search for content related to the first subject signature that is represented by the first selected icon and the second subject signature that is represented by the second selected icon.
11. The system of claim 10 , wherein at least one of the first subject or the second subject is an actor or character of the media content item.
12. The system of claim 10 , wherein the at least one of the first plurality of parameters or the second plurality of parameters comprises audio signatures and action signatures.
13. The system of claim 10 , wherein the user interface comprises a touchscreen interface.
14. The system of claim 10 , wherein the circuitry is configured to:
identify a direction of the swipe gesture, wherein:
the direction of the swipe gesture is one of a plurality of directions; and
a type of the search for content related to the subject signature is based on the direction of the swipe.
15. The system of claim 14 , wherein the circuitry is configured to:
in response to identifying a direction of the plurality of directions of the swipe gesture, perform a search for content containing a respective subject, of at least one of the first plurality of subjects or the second plurality of subjects that is associated with at least one of the first subject signature represented by the first selected icon or the second subject signature represented by the second selected icon.
16. The system of claim 10 , wherein the circuitry is configured to:
receive a tap gesture of at least one of the first icon or the second icon.
17. The system of claim 16 , wherein the circuitry is configured to:
determine a duration of the tap gesture;
in response to determining that the duration of the tap gesture is below a threshold duration, perform a search for content containing at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
in response to determining that the duration of the tap gesture meets or exceeds the threshold duration:
identify the at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
perform a search for content published by the at least one of the first identified subject or the second identified subject.
18. The system of claim 16 , wherein the circuitry is configured to:
determine an intensity of the tap gesture;
in response to determining that the intensity of the tap gesture is below a threshold intensity, perform a search for content containing at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
in response to determining that the intensity of the tap gesture meets or exceeds the threshold intensity:
identify the at least one of the first subject of the first subject signature represented by the first selected icon or the second subject of the second subject signature represented by the second selected icon; and
perform a search for content published by the at least one of the first identified subject or the second identified subject.