Systems and methods for displaying subjects of an audio portion of content and searching for content related to a subject of the audio portion
Systems and methods are described herein for displaying subjects of a portion of content and searching for content related to a particular subject in the content. Media data of content is analyzed during playback, and a number of audio signatures are identified. Each audio signature is associated, based on audio characteristics, with a particular subject within the content. The audio signature is stored, along with a timestamp corresponding to a playback position at which the audio signature begins, in association with an identifier of the particular subject. Upon receiving a command, icons representing each of a number of audio signatures at or near the current playback position are displayed. Upon receiving user selection of an icon corresponding to a particular signature, a portion of the content corresponding to the audio signature is played back or a search is performed for content related to the signature represented by the selected icon.
1 . A method comprising:
identifying a first subject and a second subject within a media content item;
determining, based on audio processing of at least one object of the media content item, a first parameter related to the first subject and a second parameter related to the second subject;
storing the first parameter as a first subject signature;
storing the second parameter as a second subject signature;
providing for display a first icon representing the first subject signature;
providing for display a second icon representing the second subject signature;
receiving a swipe gesture passing through the first icon and the second icon;
identifying a start point of the swipe gesture and an end point of the swipe gesture;
based at least in part on the identified start point and end point of the swipe gesture, identifying a direction of the swipe gesture;
determining a type of a search based on the identified direction of the swipe gesture; and
performing the type of the search for content related to the first subject signature and the second subject signature.
2 . The method of claim 1 , wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing at least one of the first subject signature or the second subject signature, and
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to at least one of the first subject signature or the second subject signature.
3 . The method of claim 1 , wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing at least one of the first subject signature or the second subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to at least one of the first subject signature or the second subject signature.
4 . The method of claim 1 , wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content having a signature similar to at least one of the first subject signature or second subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to at least one of the first subject signature or the second subject signature.
5 . The method of claim 1 , wherein:
the direction includes a first direction, a second direction, and a third direction,
the type of the search includes a first type, a second type, and a third type,
the swipe gesture in the first direction results in the first type of the search for content containing the at least one of the first subject signature or the second subject signature,
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to at least one of the first subject signature or the second subject signature, and
the swipe gesture in the third direction results in the third type of the search for content published by a subject corresponding to at least one of the first subject signature or the second subject signature.
6 . The method of claim 1 , comprising:
receiving a tap gesture of the icon;
identifying a duration of the tap gesture;
determining the type of the search based on the duration of the tap gesture; and
performing the type of the search for content related to at least one of the first subject signature or the second subject signature.
7 . The method of claim 6 , comprising:
determining that the duration of the tap gesture is below a threshold duration; and
performing the type of the search for content related to at least one of the first subject signature or the second subject signature based on the determining that the duration of the tap gesture is below the threshold duration.
8 . The method of claim 1 , comprising:
receiving a tap gesture of the icon;
identifying an intensity of the tap gesture;
determining the type of the search based on the intensity of the tap gesture; and
performing the type of the search for content related to at least one of the first subject signature or the second subject signature.
9 . The method of claim 8 , comprising:
determining that the intensity of the tap gesture is below a threshold intensity; and
performing the type of the search for content related to at least one of the first subject signature or the second subject signature based on the determining that the intensity of the tap gesture is below the intensity threshold.
10 . The method of claim 1 , wherein the object is at least one of a sound, a character, or an actor.
11 . A system comprising:
control circuitry configured to:
identify a first subject and a second subject within a media content item;
determine, based on audio processing of at least one object of the media content item, a first parameter related to the first subject and a second parameter related to the second subject;
store the first parameter as a first subject signature;
store the second parameter as a second subject signature;
provide for display a first icon representing the first subject signature and a second icon representing the second subject signature; and
input circuitry configured to:
receive a swipe gesture passing through the first icon and the second icon,
wherein the control circuitry is further configured to:
identify a start point of the swipe gesture and an end point of the swipe gesture;
based at least in part on the identified start point and end point of the swipe gesture, identify a direction of the swipe gesture;
determine a type of a search based on the identified direction of the swipe gesture; and
perform the type of the search for content related to the first subject signature and the second subject signature.
12 . The system of claim 11 , wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing at least one of the first subject signature or the second subject signature, and
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to at least one of the first subject signature or the second subject signature.
13 . The system of claim 11 , wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing at least one of the first subject signature or the second subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to at least one of the first subject signature or the second subject signature.
14 . The system of claim 11 , wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content having a signature similar to at least one of the first subject signature or the second subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to at least one of the first subject signature or the second subject signature.
15 . The system of claim 11 , wherein:
the direction includes a first direction, a second direction, and a third direction,
the type of the search includes a first type, a second type, and a third type,
the swipe gesture in the first direction results in the first type of the search for content containing the subject signature,
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to at least one of the first subject signature or the second subject signature, and
the swipe gesture in the third direction results in the third type of the search for content published by a subject corresponding to at least one of the first subject signature or the second subject signature.
16 . The system of claim 11 ,
wherein the input circuitry is configured to:
receive a tap gesture of the icon, and
wherein the control circuitry is configured to:
identify a duration of the tap gesture;
determine the type of the search based on the duration of the tap gesture; and
perform the type of the search for content related to at least one of the first subject signature or the second subject signature.
17 . The system of claim 16 , wherein the control circuitry is configured to:
determine that the duration of the tap gesture is below a threshold duration; and
perform the type of the search for content related to at least one of the first subject signature or the second subject signature based on the determining that the duration of the tap gesture is below the threshold duration.
18 . The system of claim 11 ,
wherein the input circuitry is configured to:
receive a tap gesture of the icon, and
wherein the control circuitry is configured to:
identify an intensity of the tap gesture;
determine the type of the search based on the intensity of the tap gesture; and
perform the type of the search for content related to at least one of the first subject signature or the second subject signature.
19 . The system of claim 18 , wherein the control circuitry is configured to:
determine that the intensity of the tap gesture is below a threshold intensity; and
perform the type of the search for content related to at least one of the first subject signature or the second subject signature based on the determining that the intensity of the tap gesture is below the intensity threshold.
20 . The system of claim 11 , wherein the object is at least one of a sound, a character, or an actor.