IP Library › Granted Patent US 9,542,488
Granted Patent B2
US 9,542,488 · App. 13/957,944 · Granted Jan 10, 2017

Associating audio tracks with video content

Inventor: Matthew Sharifi (Zurich, CH)
Assignee: Google Inc.
G06F17/30769G06F17/30743G06F17/30749H04N21/4394H04N21/4722H04N21/8113
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,542,488
App. No.
13/957,944
Granted
Jan 10, 2017
Kind
B2
Abstract

In one example, a system comprises at least one processor configured to determine an indication of an audio portion of video content, determine, based at least in part on the indication, one or more candidate audio tracks, determine, based at least in part on the one or more candidate audio tracks, one or more search terms, and provide a search query that includes the search terms. The at least one processor may be further configured to, in response to the search query, receive a response that indicates a number of search results, wherein each one of the search results is associated with content that includes the one or more search terms, select, based at least in part on the response, a particular audio track of the one or more candidate audio tracks, and send a message that associates the video content with at least the particular audio track.

Claims (58)

1. A method comprising:

determining, by a computing system comprising at least one computing device, an indication of an audio portion of video content;

determining, by the computing system and based at least in part on the indication, a plurality of candidate audio tracks;

determining, by the computing system and based at least in part on the plurality of candidate audio tracks and on the video content, a first plurality of search terms, wherein the first plurality of search terms comprises first text data that includes a title of the video content and further includes a title of a first candidate audio track of the plurality of candidate audio tracks;

determining, by the computing system and based at least in part on the plurality of candidate audio tracks and the video content, a second plurality of search terms, wherein the second plurality of search terms comprises second text data that includes the title of the video content and further includes a title of a second candidate audio track of the plurality of candidate audio tracks, the second candidate audio track being different than the first candidate audio track;

responsive to providing a first search query that includes the first plurality of search terms, receiving, by the computing system, a first response that indicates a number of first search results, wherein each one of the first search results is associated with content that includes the first plurality of search terms;

responsive to providing a second search query that includes the second plurality of search terms, receiving, by the computing system, a second response that indicates a number of second search results, wherein each one of the second search results is associated with content that includes the second plurality of search terms;

responsive to determining that the number of the first search results is greater than the number of the second search results, selecting, by the computing system, the first candidate audio track of the plurality of candidate audio tracks; and

sending, by the computing system, a message that associates the video content with at least the first candidate audio track.

2. The method of claim 1 , wherein determining the first plurality of search terms comprises:

determining the title of the first candidate audio track;

determining an artist of the first candidate audio track; and

determining the title of the video content,

such that the first text data of the first plurality of search terms further includes the artist of the first candidate audio track.

3. The method of claim 1 , wherein determining the first plurality of search terms comprises:

determining a composer of the first candidate audio track; and

determining the title of the video content,

such that the first text data of the first plurality of search terms further includes the composer of the first candidate audio track.

4. The method of claim 1 , wherein providing the first search query comprises sending first instructions to one or more external database servers to perform a first search based on the first search query, and wherein providing the second search query comprises sending second instructions to the one or more external database servers to perform a second search based on the second search query.

5. The method of claim 1 , wherein selecting the first candidate audio track comprises determining that the first candidate audio track is included in the audio portion of the video content at a time substantially the same as a time at which the second candidate audio track is included in the audio portion of the video content.

6. The method of claim 1 , wherein the first search query comprises instructions to restrict the first search results to content that includes the first plurality of search terms within a threshold distance from one another.

7. The method of claim 1 , wherein determining the indication of the audio portion of the video content comprises determining one or more audio fingerprints of the audio portion of the video content.

8. A system comprising:

at least one processor; and

a computer-readable storage medium storing instructions that, when executed, cause the at least one processor to:

determine an indication of an audio portion of video content;

determine, based at least in part on the indication, a plurality of candidate audio tracks;

determine, based at least in part on the plurality of candidate audio tracks and on the video content, a first plurality of search terms, wherein the first plurality of search terms comprises first text data that includes a title of the video content and further includes a title of a first candidate audio track of the plurality of candidate audio tracks;

determine, based at least in part on the plurality of candidate audio tracks and the video content, a second plurality of search terms, wherein the second plurality of search terms comprises second text data that includes the title of the video content and further includes a title of a second candidate audio track of the plurality of candidate audio tracks, the second candidate audio track being different than the first candidate audio track;

responsive to providing a first search query that includes the first plurality of search terms, receive a first response that indicates a number of first search results, wherein each one of the first search results is associated with content that includes the first plurality of search terms;

responsive to providing a second search query that includes the second plurality of search terms, receive a second response that indicates a number of second search results, wherein each one of the second search results is associated with content that includes the second plurality of search terms;

responsive to determining that the number of the first search results is greater than the number of the second search results, select the first candidate audio track of the plurality of candidate audio tracks; and

send a message that associates the video content with at least the first candidate audio track.

9. The system of claim 8 , wherein the instructions that cause the at least one processor to determine the first plurality of search terms further cause the at least one processor to:

determine the title of the first candidate audio track;

determine an artist of the first candidate audio track; and

determine the title of the video content,

such that the first text data of the first plurality of search terms further includes the artist of the first candidate audio track.

10. The system of claim 8 , wherein the instructions that cause the at least one processor to select the particular candidate audio track further cause the at least one processor to determine that the first candidate audio track is included in the audio portion of the video content at a time substantially the same as a time at which the second candidate audio track is included in the audio portion of the video content.

11. The system of claim 8 , wherein the first search query comprises instructions to restrict the first search results to content that includes the first plurality of search terms within a threshold distance from one another.

12. A computer-readable storage medium encoded with storing instructions that, when executed, cause one or more processors to perform operations comprising:

determining an indication of an audio portion of video content;

determining, based at least in part on the indication, a plurality of candidate audio tracks;

determining, based at least in part on the plurality of candidate audio tracks and on the video content, a first plurality of search terms, wherein the first plurality of search terms comprises first text data that includes a title of the video content and further includes a title of a first candidate audio track of the plurality of candidate audio tracks;

determining, based at least in part on the plurality of candidate audio tracks and the video content, a second plurality of search terms, wherein the second plurality of search terms comprises second text data that includes the title of the video content and further includes a title of a second candidate audio track of the plurality of candidate audio tracks, the second candidate audio track being different than the first candidate audio track;

responsive to providing a first search query that includes the first plurality of search terms, receiving a first response that indicates a number of first search results, wherein each one of the first search results is associated with content that includes the first plurality of search terms;

responsive to providing a second search query that includes the second plurality of search terms, receiving a second response that indicates a number of second search results, wherein each one of the second search results is associated with content that includes the second plurality of search terms;

responsive to determining that the number of the first search results is greater than the number of the second search results, selecting the first candidate audio track of the plurality of candidate audio tracks; and

sending a message that associates the video content with at least the first candidate audio track.

13. The computer-readable storage medium of claim 12 , wherein determining the first plurality of search terms comprises:

determining the title of the first candidate audio track;

determining an artist of the first candidate audio track; and

determining the title of the video content,

such that the first text data of the first plurality of search terms further includes the artist of the first candidate audio track.

14. The computer-readable storage medium of claim 12 , wherein providing the first search query comprises sending first instructions to one or more external database servers to perform a first search based on the first search query, and wherein providing the second search query comprises sending second instructions to the one or more external database servers to perform a second search based on the second search query.

15. The method of claim 1 , wherein the first search query comprises a first web search query, wherein the first search results comprise a first group of webpages that are each associated with web content that includes the first plurality of search terms, wherein the second search query comprises a second web search query, and wherein the second search results comprise a second group of webpages that are each associated with web content that includes the second plurality of search terms.

16. The system of claim 8 , wherein the first search query comprises a first web search query, wherein the first search results comprise a first group of webpages that are each associated with web content that includes the first plurality of search terms, wherein the second search query comprises a second web search query, and wherein the second search results comprise a second group of webpages that are each associated with web content that includes the second plurality of search terms.

17. The computer-readable storage medium of claim 12 , wherein the first search query comprises a first web search query, wherein the first search results comprise a first group of webpages that are each associated with web content that includes the first plurality of search terms, wherein the second search query comprises a second web search query, and wherein the second search results comprise a second group of webpages that are each associated with web content that includes the second plurality of search terms.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044097/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2013
From: SHARIFI, MATTHEW
To: GOOGLE INC.
Reel/Frame 031128/0238 →
Continuity (1)
Related Publication 20150039646A1 · Feb 5, 2015